Columns being dynamically shuffled in a Dataset

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
sandy
Participant
Posts: 24
Joined: Sun Feb 01, 2004 1:14 am

Columns being dynamically shuffled in a Dataset

Post by sandy »

Hi,

We are facing a severe issue in our parallel jobs.

My jobs after processing the input data are writing it into a dataset. The table definition(order of columns) of the dataset and the mappings are in the correct order.
The issue is, when we make some minor changes to the code (not in the mappings or column definition) and run the jobs, the output columns in the dataset are not in the order as in the table definition for it i.e the schema of the dataset is changing dynamically with each such run and observed with the Dataset Management option in DataStage.

The dataset where this problem is observed is the final output dataset and hence the order of columns is very critical.
Please provide some suggestions/pointers as to the cause and solution to this issue.

Thanks in advance,
Post Reply