Tag: Database Administration

Technology - Denodo Data Virtualization Project Roles

Technology – Denodo Data Virtualization Project Roles

2019-09-27

A Denodo virtualization project typically classifies the project duties of the primary implementation team into four Primary roles. Denodo Data Virtualization Project Roles Data Virtualization Architect Denodo Platform Administrator Data Virtualization Developer Denodo Platform Java Programmer Data Virtualization Internal Support Team Role To Project Team Member Alignment While the denodo project is grouped into security … More Technology – Denodo Data Virtualization Project Roles

denodo Virtualization – Useful Links

2019-09-13

Here are some denodo Virtualization references, which may be useful. Reference Name Link denodo Home Page https://www.denodo.com/en/about-us/our-company denodo Platform 7.0 Documentation https://community.denodo.com/docs/html/browse/7.0/ denodo Knowledge Base and Best Practices https://community.denodo.com/kb/ denodo Tutorials https://community.denodo.com/tutorials/ denodo Express 7.0 Download https://community.denodo.com/express/download Denodo Virtual Data Port (VDP) https://community.denodo.com/kb/download/pdf/VDP%20Naming%20Conventions?category=Operation JDBC / ODBC drivers for Denodo https://community.denodo.com/drivers/ Denodo Governance Bridge – User … More denodo Virtualization – Useful Links

Technology – Using Logical Data Lakes

2019-08-01

Today, data-driven decision making is at the center of all things. The emergence of data science and machine learning has further reinforced the importance of data as the most critical commodity in today’s world. From FAAMG (the biggest five tech companies: Facebook, Amazon, Apple, Microsoft, and Google) to governments and non-profits, everyone is busy leveraging … More Technology – Using Logical Data Lakes

Microsoft SQL Server – Useful links

2018-01-09

Here are a few references for the Microsoft SQL Server 2017 database, which may be helpful. Table Of Useful Microsoft SQL Server Database References Reference Type Link SQL Server 2017 Download Page https://www.microsoft.com/en-us/sql-server/sql-server-downloads SQL SERVER version, edition, and update level https://support.microsoft.com/en-us/help/321185/how-to-determine-the-version–edition-and-update-level-of-sql-server-a SQL Server 2017 Release Notes https://docs.microsoft.com/en-us/sql/sql-server/sql-server-2017-release-notes SQL Server Transact SQL Commands https://technet.microsoft.com/en-us/library/ms189826(v=sql.90).aspx Related References SQL … More Microsoft SQL Server – Useful links

Databases – What is ACID?

2017-06-10

What does ACID mean in database technologies? Concerning databases, the acronym ACID means: Atomicity, Consistency, Isolation, and Durability. Why is ACID important? Atomicity, Consistency, Isolation, and Durability (ACID) are import to database, because ACID is a set of properties that guarantee that database transactions are processed reliably. Where is the ACID Concept described? Originally described … More Databases – What is ACID?

Databases – Database Isolation Level Cross Reference

2017-06-10

  Here is a table quick reference of some common database and/or connection types, which use connection level isolation and the equivalent isolation levels. This quick reference may prove useful as a job aid reference, when working with and making decisions about isolation level usage. Database isolation levels Data sources Most restrictive isolation level More … More Databases – Database Isolation Level Cross Reference

What are the dashDB isolation levels?

2017-06-01

  Isolation levels are part of the ACID (Atomicity, Consistency, Isolation, Durability) paradigms in database control.  Isolation levels allow developers and user to trade-off consistency for a potential gain in performance. Therefore, it is essential to understand them and how the apply in structured Query Language(SQL).  The dashDB RDBMS has four isolations levels: Repeatable Read … More What are the dashDB isolation levels?

Oracle Database – Useful links

2017-04-10

Some useful oracle documentation references. Reference Type Link Database SQL Language Reference (11.2) https://docs.oracle.com/cd/E11882_01/server.112/e41084/ Database SQL Language Reference (11.2) https://docs.oracle.com/cd/E11882_01/server.112/e16604/toc.htm Database SQL Language Reference (12c) https://docs.oracle.com/database/121/SQLRF/toc.htm Database (12c) SQL*Plus User’s Guide and Reference https://docs.oracle.com/database/121/SQPUG/toc.htm SQL Developer Documentation http://docs.oracle.com/cd/E12151_01/

Netezza / PureData – What client tools to use with Netezza

2017-03-17

Occasionally, a client will want a list of tools to work with Netezza / PureData, other than the Netezza Administrator Client.  Honestly, there are several tools which could be used, if they have odbc and/or jdbc connectivity.  However, these are the tools which keep being used across different customers. Open Source For customers willing to … More Netezza / PureData – What client tools to use with Netezza

Infosphere Datastage – Data type conversions from Netezza to DataStage

2017-03-12

Some recent research to eliminate some ETL Data Conversion issues, made me want to make an enhancement to the documentation provided by IBM, to prevent repeating the research. Netezza data types and their equivalent InfoSphere DataStage data types Netezza data types InfoSphere DataStage data types (SQL types) Notes   BYTEINT TinyInt     SMALLINT SmallInt     INT … More Infosphere Datastage – Data type conversions from Netezza to DataStage

Aginity for Netezza – How to disable and/or Enable the Autocomplete Function

2017-03-11

Aginity for Netezza an out complete feature, which auto completes brackets, quotes, and comment character, which some folks find useful and helpful.  However, if you are an old-school style coder like me, you may find these annoying, to say the least.  Usually, when I’m coding I want to write straight through without the need to … More Aginity for Netezza – How to disable and/or Enable the Autocomplete Function

Netezza / PureData – What is the maximum length of CHAR, VARCHAR, and NVARCHAR fields

2017-03-11

During a recent project, I had reason to investigate what the maximum character field links for Netezza to be able to fit the data ETL ‘ed from the source.  The constraints on Netezza character fields are not as long as some other databases, therefore, I thought I would document and a quick post for future … More Netezza / PureData – What is the maximum length of CHAR, VARCHAR, and NVARCHAR fields

Netezza / PureData – how to convert an integer to a date

2017-03-10

Lately, I have been encountering a lot of date fields stored as integer.  So, I thought it might be useful to write a quick post on how to convert a date stored as an integer to a date.   The process is quite easy and intuitive, here are a few approaches for doing so. Basic To_Date Command … More Netezza / PureData – how to convert an integer to a date

What are the Factor Affecting the Selection of Data Warehouse Naming Convention?

2016-11-17

The primary factors affecting the choices in the creation of Data Warehouse (DW) naming convention policy standards are the type of implementation, pattern of the implementation, and any preexisting conventions. Type of implementation The type of implementation will affect your naming convention choices. Basically, this boils down to, are you working with a Commercial-Off-The-Shelf (COTS) … More What are the Factor Affecting the Selection of Data Warehouse Naming Convention?

Data Warehouse – Effective Practices

2016-09-02

Effective Practices Effective practices are enablers, which can improve performance, data availability, environment stability, resource consumption, and data accuracy. Use of an Enterprise Scheduler The scheduling service in InfoSphere Information Server (IIS) leverages the operating system (OS) scheduler, the common enterprise scheduler can provide these capabilities beyond those of a common OS scheduler: Centralized control, … More Data Warehouse – Effective Practices

Netezza / PureData – how to set processing date to next day based on a timestamp

2016-08-10

hey are a variety of uses for this logic within Netezza / Puredata SQL, when working with interfaces, ETL, ELT, Snapshot facts and/or tables, setting the processing / run control date, and the list goes on.  However, rather than reinventing this logic each time, I thought I would save this code snippet for future use … More Netezza / PureData – how to set processing date to next day based on a timestamp

Structured Query Language (SQL) Tuning

2016-01-30

Tuning SQL is one of those skills, which is part art and part science.  However, there are a few fundamental approaches, which can help ensure optimal SQL select statement performance. Structuring your SQL By Structuring SQL Statements, much performance can be gained through good SQL statement organization and sound logic. Where Clause Concepts: Use criteria … More Structured Query Language (SQL) Tuning

Oracle SQL – Removing Non-Numeric Characters

2015-12-28

Sometimes, when converting fields from text to numeric fields in SQL, there is a need to remove one or more non-numeric values.  These approaches have been useful for handling multiple non-numeric values. Removing non-numeric values – Approach 1: I have found this approach useful when working with character (Char, Varchar, NVARCHAR) fields being converted to non-integers outputs … More Oracle SQL – Removing Non-Numeric Characters