DataStage. DataStage (DS) is the industry standard ETL (Extract, Transform, and Load) tool. It has been rewritten to fit into IBM's cloud environment, as part of IBM Cloud Pak for Data.
Understand the Transformation Types and Job Configurations as this technical walk through shows how to transform data in Data Stage with Transformer Stage.
In this article, we are just going to focus on using loops for tables. Say that you have 20 or more tables of data that you need copied from a source database to a destination database on a daily or weekly basis.
Today we discuss how to use Shell Scripting within DataStage by listing possible uses and giving a walkthrough example of an Unzip Script within DataStage
Data should be consistent and complete, with primary keys defined. If we are unable to correct at the source (not able to change the source data), we must take measures to ensure integrity during the ingestion.