Purging Files and Custom Log generation

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
bapajju
Participant
Posts: 82
Joined: Wed Nov 19, 2003 11:58 pm

Purging Files and Custom Log generation

Post by bapajju »

Hi all,
Can anybody let me know how to generate Custom Log reports and perform File PURGE Procesing through Parallel extender. We need to purge the files that have been processed without any eeror and if the file is not processed properly then it should not be moved from the input directory.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

If you download EtlStats and modify it to load to a hash file then you easily write a routine to read row counts and make sure there were no rejects. Then it could purge or archive the files.
Mamu Kim
Post Reply