Set Of files

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

vzmz

You can strip the header records of with a combination head and tail commands or sed. Do a search. wc -l filename will tell you how many lines are in the file. These commands are very fast. So in a shell script I would validate the file and start the DataStage job after it passes maybe move the bad files to a separate folder. You should archive the good files when done to a different folder.

Kim.
Mamu Kim
Post Reply