Technology – Inmon Vs Kimball Approach to Data Warehouse Design

Inmon’s evolutionary approach to data warehouse design develops from operational relational database technology and development methods, while Kimball’s definition of business processes is more general. Both approaches describe techniques for maximizing data warehouse performance. Inmon also offers an explanation of how to declare grain, or the level of detail each data warehouse will contain. Kimball’s … More Technology – Inmon Vs Kimball Approach to Data Warehouse Design

Technology – What is a Surrogate Key in Data Warehousing?

A surrogate key is an artificial key, which functions as a proxy for a natural one. Similarly, a surrogate key in data- warehouses is used to maintain a link between the production and test systems. A surrogate can be an internal or external key. It is often the default key in data warehouses. A surrogate … More Technology – What is a Surrogate Key in Data Warehousing?

What Is The Data Fabric Approach?

What is The data fabric, and how does it automating discovery, creation, and ingestion help organizations? Data-fabric tools, which can be appliances, devices, or software, allow users to quickly, easily, and securely access and manage large amounts of data. Automating the discovery, creation, and ingestion, big data Fabric accelerates real-time insights from operational data silos, … More What Is The Data Fabric Approach?

Technology – What Can Dremio Do For You?

Dremio is a cloud-based platform providing business data lake storage and analytic solutions. Dremio’s is a major competitor with: Denodo, DataBrick, and Cloudera. Dremio provides fast, fault-tolerant, scalable, and flexible database access with MySQL, Informix, PHP, Java-location, and more. Their database engine is based on Apache Arrow and is designed for fast, low-cost, and high-throughput … More Technology – What Can Dremio Do For You?

Technology – The Advantages of Using Microsoft SQL Server Integration Services

Microsoft SQL Server Integration Services (SSIS) is designed to combine the features of SQL Server with components of Enterprise Management System (EMMS) so that they can work together for enterprise solutions. Its core area of expertise is bulk/batched data delivery. As a SQL Server collection member, Integration Services is a logical solution to common organizational … More Technology – The Advantages of Using Microsoft SQL Server Integration Services

Technology – When To Cache A Denodo View

Here’s a quick summary of practices about when to use cache when developing denotative views.  These guidelines come from the usual documentation and practical experience and may help you decide whether to cache a view. These are general guidelines, and they should happen the conflict with any guidance you’ve gotten from the Denodo; Please use … More Technology – When To Cache A Denodo View

How to save Denodo Virtual Data Port (VDP) VQL Shell results

In a recent project, I was asked by a new user of Denodo Virtual Data Port (VDP) how to save denodo VDP VQL Shell results. So, here is a simple outline of the process of exporting the VQL Shell results: Execute the VQL Shell SQL Click on the ‘Save’ button in the ‘Results’ tab to … More How to save Denodo Virtual Data Port (VDP) VQL Shell results

How to save Denodo Virtual Data Port (VDP) view results

In a recent project, I was asked by a new user of Denodo Virtual Data Port (VDP) how to save denodo VDP view results. So, here is a simple outline of the process of exporting the view results: Execute the view Click on the ‘Save’ button in the Results tab to save results A dialog … More How to save Denodo Virtual Data Port (VDP) view results

What is a Data Warehouse?

What is a Data Warehouse The description of what a data warehouse is varies greatly.  The definition that I give that seems to work is that a data warehouse a database repository that supports system interfaces, reporting and business analysis, data integration and domain normalization, and structure optimization.  The structure can vary greatly depending the … More What is a Data Warehouse?

Extraction, Transformation & Loading Vs. Enterprise Application Integration

Over recent years, business enterprises relying on accurate and consistent data to make informed decisions have been gravitating towards integration technologies. The subject of Enterprise Application Integration (EAI) and Extraction, Transformation & Loading (ETL) lately seems to pop up in most Enterprise Information Management conversations. From an architectural perspective, both techniques share a striking similarity. … More Extraction, Transformation & Loading Vs. Enterprise Application Integration

How to get a list of installed InfoSphere Information (IIS) Server products

Which File contains the list of Installed IIS products? The list of installed products can be obtained from the Version.xml file. Where is the Version.xml file located? The exact location of the Version.xml document depends on the operating system in use and where IIS was installed to, which is normally the default location of: For … More How to get a list of installed InfoSphere Information (IIS) Server products

Infosphere Knowledge Resources

IBM Knowledge Center The IBM Knowledge Center is the IBM product documentation Site designed to help you plan, install, configure, use, tune, monitor, troubleshoot, and maintain the product. URL:  https://www.ibm.com/support/knowledgecenter/ IBM InfoSphere Information Server Version 11.7.0 documentation The IBM InfoSphere Information Server Version 11.7.0 documentation provides IIS specific documentation about how to install and use … More Infosphere Knowledge Resources

Infosphere Information Server (IIS) – Where you can view DataStage and QualityStage Logs?

During the course of the week, the discussion happened regarding the different places where a person might read the DataStage and QualityStage logs in InfoSphere. I hadn’t really thought about it, but here are a few places that come to mind: IBM InfoSphere DataStage and QualityStage Operations Console IBM InfoSphere DataStage and QualityStage Director client IBM InfoSphere … More Infosphere Information Server (IIS) – Where you can view DataStage and QualityStage Logs?

Essbase Connector Error – Client Commands are Currently Not Being Accepted

While investigating a recent Infosphere Information Server (IIS), Datastage, Essbase Connect error I found the explanations of the probable causes of the error not to be terribly meaningful.  So, now that I have run our error to ground, I thought it might be nice to jot down a quick note of the potential cause of … More Essbase Connector Error – Client Commands are Currently Not Being Accepted

Parallel jobs on Windows fail with APT_IOPort::readBlkVirt;error

This a known error for windows systems and applies to DataStage and DataQuality jobs using the any or all the three join type stages (Join, Merge, and Lookup). Error Message <<Link name>>,0: APT_IOPort::readBlkVirt: read for block header, partition 0, [fd 4], returned -1 with errno 10,054 (Unknown error) Message ID IIS-DSEE-TFIO-00223 Applies To Windows systems … More Parallel jobs on Windows fail with APT_IOPort::readBlkVirt;error

DataStage – How to Pass the Invocation ID from one Sequence to another

When you are controlling a chain of sequences in the job stream and taking advantage of reusable (multiple instances) jobs it is useful to be able to pass the Invocation ID from the master controlling sequence and have it passed down and assigned to the job run.  This can easily be done with needing to … More DataStage – How to Pass the Invocation ID from one Sequence to another

DataStage – How to use single quoted parameter list in an Oracle Connector

While working with a client’s 9.1 DataStage version, I ran into a situation where they wanted to parameterize SQL where clause lists in an Oracle Connector stage, which honestly was not very straight forward to figure out.  First, if the APT_OSL_PARAM_ESC_SQUOTE is not set and single quotes are used in the parameter, the job creates unquoted … More DataStage – How to use single quoted parameter list in an Oracle Connector

What are the Core Capability of Infosphere Information Server?

Three Core Capabilities of Information Server InfoSphere Information Server (IIS) has three core capabilities: Information Governance Data Integration Data Quality What the Core Capabilities Provide The three-core capability translate in to the high-level business processes: Information Governance – Understand and collaborate Provides a centrally managed repository and approach, which provides: Information blueprints Relationship discovery across … More What are the Core Capability of Infosphere Information Server?

InfoSphere Information Server Suites

The Six Suites of Infosphere Information Server InfoSphere Information Server 11 Series is, primarily, made up of 6 suites / packages, which provide a mix of components: InfoSphere Information Governance Catalog BigInsights BigIntegrate BigInsights InfoSphere Information Server for Data Integration InfoSphere Information Server for Data Quality InfoSphere Information Server Enterprise Edition (is inclusive of all … More InfoSphere Information Server Suites

What are the dashDB isolation levels?

  Isolation levels are part of the ACID (Atomicity, Consistency, Isolation, Durability) paradigms in database control.  Isolation levels allow developers and user to trade-off consistency for a potential gain in performance. Therefore, it is essential to understand them and how the apply in structured Query Language(SQL).  The dashDB RDBMS has four isolations levels: Repeatable Read … More What are the dashDB isolation levels?

SFDC Salesforce Connector – Column Returns Null values, when SOQL Returns Data in Workbench

Recently, encountered a scenario, which is a little out of the norm while using the SFDC Connector.  Once the issue is understood, it is easily remedied. The problem / Error SOQL run in Salesforce workbench and column returns data The DataStage job/ETL runs without errors or warnings The target column output only returns null values … More SFDC Salesforce Connector – Column Returns Null values, when SOQL Returns Data in Workbench

IBM Db2 on Cloud, IBM Db2 Warehouse, IBM Db2 Warehouse on Cloud (Previously IBM dashDB), and IBM Integrated Analytics System – Useful links

Here are a few references for IBM Db2 on Cloud, IBM Db2 Warehouse, IBM Db2 Warehouse on Cloud (Previously IBM dashDB), and IBM Integrated Analytics System – Useful links, which hopefully will be helpful.  Table Of Useful IBM Db2 on Cloud, IBM Db2 Warehouse, IBM Db2 Warehouse on Cloud (Previously IBM dashDB), and IBM Integrated … More IBM Db2 on Cloud, IBM Db2 Warehouse, IBM Db2 Warehouse on Cloud (Previously IBM dashDB), and IBM Integrated Analytics System – Useful links

Technology – What is the convert function in DataStage?

In its simplest form, the convert function in Infosphere DataStage is a string replacement operation.  Convert can be used to replace a specific character, a list of characters, or a unicode character (e.g. thumbs Up Sign or Grinning Face). Convert Syntax convert(‘<<Value to be replaced’,'<<Replacement value >>’,<<Input field>>) Using the Convert Function to remove a … More Technology – What is the convert function in DataStage?