A Denodo virtualization project typically classifies the project duties of the primary implementation team into four Primary roles. Denodo Data Virtualization Project Roles Data Virtualization Architect Denodo Platform Administrator Data Virtualization Developer Denodo Platform Java Programmer Data Virtualization Internal Support Team Role To Project Team Member Alignment While the denodo project is grouped into security … More Technology – Denodo Data Virtualization Project Roles
Here are some denodo Virtualization references, which may be useful. Reference Name Link denodo Home Page https://www.denodo.com/en/about-us/our-company denodo Platform 7.0 Documentation https://community.denodo.com/docs/html/browse/7.0/ denodo Knowledge Base and Best Practices https://community.denodo.com/kb/ denodo Tutorials https://community.denodo.com/tutorials/ denodo Express 7.0 Download https://community.denodo.com/express/download Denodo Virtual Data Port (VDP) https://community.denodo.com/kb/download/pdf/VDP%20Naming%20Conventions?category=Operation JDBC / ODBC drivers for Denodo https://community.denodo.com/drivers/ Denodo Governance Bridge – User … More denodo Virtualization – Useful Links
Today, data-driven decision making is at the center of all things. The emergence of data science and machine learning has further reinforced the importance of data as the most critical commodity in today’s world. From FAAMG (the biggest five tech companies: Facebook, Amazon, Apple, Microsoft, and Google) to governments and non-profits, everyone is busy leveraging … More Technology – Using Logical Data Lakes
Here are a few references for the Microsoft SQL Server 2017 database, which may be helpful. Table Of Useful Microsoft SQL Server Database References Reference Type Link SQL Server 2017 Download Page https://www.microsoft.com/en-us/sql-server/sql-server-downloads SQL SERVER version, edition, and update level https://support.microsoft.com/en-us/help/321185/how-to-determine-the-version–edition-and-update-level-of-sql-server-a SQL Server 2017 Release Notes https://docs.microsoft.com/en-us/sql/sql-server/sql-server-2017-release-notes SQL Server Transact SQL Commands https://technet.microsoft.com/en-us/library/ms189826(v=sql.90).aspx Related References SQL … More Microsoft SQL Server – Useful links
OLTP Versus Data Warehousing I’ve tried to explain the difference between OLTP systems and a Data Warehouse to my managers many times, as I’ve worked at a hospital as a Data Warehouse Manager/data analyst for many years. Why was the list that came from the operational applications different than the one that came from the … More OLTP vs Data Warehousing
What does ACID mean in database technologies? Concerning databases, the acronym ACID means: Atomicity, Consistency, Isolation, and Durability. Why is ACID important? Atomicity, Consistency, Isolation, and Durability (ACID) are import to database, because ACID is a set of properties that guarantee that database transactions are processed reliably. Where is the ACID Concept described? Originally described … More Databases – What is ACID?
Here is a table quick reference of some common database and/or connection types, which use connection level isolation and the equivalent isolation levels. This quick reference may prove useful as a job aid reference, when working with and making decisions about isolation level usage. Database isolation levels Data sources Most restrictive isolation level More … More Databases – Database Isolation Level Cross Reference
Isolation levels are part of the ACID (Atomicity, Consistency, Isolation, Durability) paradigms in database control. Isolation levels allow developers and user to trade-off consistency for a potential gain in performance. Therefore, it is essential to understand them and how the apply in structured Query Language(SQL). The dashDB RDBMS has four isolations levels: Repeatable Read … More What are the dashDB isolation levels?
Some useful oracle documentation references. Reference Type Link Database SQL Language Reference (11.2) https://docs.oracle.com/cd/E11882_01/server.112/e41084/ Database SQL Language Reference (11.2) https://docs.oracle.com/cd/E11882_01/server.112/e16604/toc.htm Database SQL Language Reference (12c) https://docs.oracle.com/database/121/SQLRF/toc.htm Database (12c) SQL*Plus User’s Guide and Reference https://docs.oracle.com/database/121/SQPUG/toc.htm SQL Developer Documentation http://docs.oracle.com/cd/E12151_01/
Occasionally, a client will want a list of tools to work with Netezza / PureData, other than the Netezza Administrator Client. Honestly, there are several tools which could be used, if they have odbc and/or jdbc connectivity. However, these are the tools which keep being used across different customers. Open Source For customers willing to … More Netezza / PureData – What client tools to use with Netezza
Some recent research to eliminate some ETL Data Conversion issues, made me want to make an enhancement to the documentation provided by IBM, to prevent repeating the research. Netezza data types and their equivalent InfoSphere DataStage data types Netezza data types InfoSphere DataStage data types (SQL types) Notes BYTEINT TinyInt SMALLINT SmallInt INT … More Infosphere Datastage – Data type conversions from Netezza to DataStage
Aginity for Netezza an out complete feature, which auto completes brackets, quotes, and comment character, which some folks find useful and helpful. However, if you are an old-school style coder like me, you may find these annoying, to say the least. Usually, when I’m coding I want to write straight through without the need to … More Aginity for Netezza – How to disable and/or Enable the Autocomplete Function
During a recent project, I had reason to investigate what the maximum character field links for Netezza to be able to fit the data ETL ‘ed from the source. The constraints on Netezza character fields are not as long as some other databases, therefore, I thought I would document and a quick post for future … More Netezza / PureData – What is the maximum length of CHAR, VARCHAR, and NVARCHAR fields
Lately, I have been encountering a lot of date fields stored as integer. So, I thought it might be useful to write a quick post on how to convert a date stored as an integer to a date. The process is quite easy and intuitive, here are a few approaches for doing so. Basic To_Date Command … More Netezza / PureData – how to convert an integer to a date
Every once and a while, it happens that a SQL needs to be reused, but for whatever reason it was not saved. If it wasn’t too far back in time, you can recover the SQL from the User Query History. This is a fairly straight forward process, if not exactly obvious. The basic process is: … More How to get a previously run SQL in Aginity
The primary factors affecting the choices in the creation of Data Warehouse (DW) naming convention policy standards are the type of implementation, pattern of the implementation, and any preexisting conventions. Type of implementation The type of implementation will affect your naming convention choices. Basically, this boils down to, are you working with a Commercial-Off-The-Shelf (COTS) … More What are the Factor Affecting the Selection of Data Warehouse Naming Convention?
Effective Practices Effective practices are enablers, which can improve performance, data availability, environment stability, resource consumption, and data accuracy. Use of an Enterprise Scheduler The scheduling service in InfoSphere Information Server (IIS) leverages the operating system (OS) scheduler, the common enterprise scheduler can provide these capabilities beyond those of a common OS scheduler: Centralized control, … More Data Warehouse – Effective Practices
hey are a variety of uses for this logic within Netezza / Puredata SQL, when working with interfaces, ETL, ELT, Snapshot facts and/or tables, setting the processing / run control date, and the list goes on. However, rather than reinventing this logic each time, I thought I would save this code snippet for future use … More Netezza / PureData – how to set processing date to next day based on a timestamp
Tuning SQL is one of those skills, which is part art and part science. However, there are a few fundamental approaches, which can help ensure optimal SQL select statement performance. Structuring your SQL By Structuring SQL Statements, much performance can be gained through good SQL statement organization and sound logic. Where Clause Concepts: Use criteria … More Structured Query Language (SQL) Tuning
Sometimes, when converting fields from text to numeric fields in SQL, there is a need to remove one or more non-numeric values. These approaches have been useful for handling multiple non-numeric values. Removing non-numeric values – Approach 1: I have found this approach useful when working with character (Char, Varchar, NVARCHAR) fields being converted to non-integers outputs … More Oracle SQL – Removing Non-Numeric Characters