Hierarchical stage is dropping rows with Ctrl-Z

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
chanaka
Premium Member
Premium Member
Posts: 96
Joined: Tue Sep 15, 2009 4:06 am
Location: United States

Hierarchical stage is dropping rows with Ctrl-Z

Post by chanaka »

Hi Experts,

Wish you and your families a happy and prosperous new year ahead!

We have a hierarchy stage job that processes a large volume data file and put the modified records in to a DataSet. The problem we face is it is dropping the records whenever there are any free form texts within the incoming records that has a Ctrl+Z ascii control character. If we edit the file and remove the Ctrl+Z manually, that record will get processed without any issues. Just wanted to check to see if anyone else has faced a similar issue and have a way of making the hierarchy stage to process the problematic record by setting any environment variables.

Note: our intention is to not to do preprocessor step and remove the Ctrl+Z via a string replacement. Rather keep the special character as it is and process it.

Thanks in advance!
Post Reply