Datastage – The “APT_TSortOperator” will partition despite the preserve-partitioning flag on the data set on input port 0

Technology - Datastage - The APT_TSortOperator will partition despite the preserve-partitioning flag on the data set on input port 0

DataStage is a tool that allows users to perform ETL (extract, transform, load) on different kinds of data. It can extract data from external sources, such as relational databases, sequential files, and archives. It can also load data to any target.

DataStage is part of IBM’s Information Platforms Solutions suite. It is a powerful tool that facilitates business analysis, business intelligence, and data integration. It enables developers to be extra efficient and productive.

The DataStage engine supports both Windows and Linux operating systems. It can run graphical point-and-click techniques, and it offers an industry-leading parallel engine. It can handle large volumes of data and can integrate big data in motion.

DataStage can work on multiple machines in a cluster. It can also be used to implement high-performance batch data extraction. The user can create containers and job sequences. It also provides built-in scalability. Besides, it can be integrated with multiple data sources, including indexed and sequential files.

The main objective of DataStage is to enable business analysis and provide quality data. It provides users with a comprehensive view of the data and helps users make informed decisions. It also offers a variety of versions.

DataStage is a graphical ETL (extract, transform, and load) system. It can connect with a wide range of data sources, such as sequential and indexed files, relational databases, and archives. It offers a number of tools to help users develop and maintain a data warehouse. These include the Datastage Designer, Datastage Manager, and the Datastage Director.

APT_TSortOperator Warning
APT_TSortOperator Warning

The APT_TSortOperator  warning happens when there is a conflict in the portioning behavior between stages.  Usually, because the successor (down Stream) stage has the ‘Partitioning / Collecting’ and ‘Sorting’ property set in a way that conflicts with predecessor (upstream) stage’s properties, which it is set to preserver.  This can occur when the successor stage has the “Preserve Partitioning” property set to:

  • ‘Default (Propagate)’
  • ‘Propagate’, or
  • ‘Set’
Preserve Partitioning Property - list
Preserve Partitioning Property – list

Message ID

  • IIS-DSEE-TFOR-00074

Message Text

  • <<Link Name Where Warning Occurred>>: When checking operator: Operator of type “APT_TSortOperator”: will partition despite the preserve-partitioning flag on the data set on input port 0.

Warning Fixes

  • First, if the verify that the partitioning behaviors of both stages are correct
  • If so, set the predecessor ‘Preserve Partitioning’ property to “Clear”
  • If not, then correct the partitioning behavior of the stage which is in error

Clear Partitioning Property Screenshot

Preserve Partitioning Property - Set To Clear
Preserve Partitioning Property – Set To Clear

1 Comment

Leave a Reply

%d bloggers like this: