Will Same Job committed rows come to Same Job CC before set?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
gnan_gun
Participant
Posts: 30
Joined: Thu Aug 02, 2007 5:31 am
Location: Mumbai, India

Will Same Job committed rows come to Same Job CC before set?

Post by gnan_gun »

My Job design flow is:
Extract the records from Oracle table.
Lookup the source records to FINANCIAL records in FIN_DATA table.
If any records matches then update the record in FIN_DATA column FLAG to 'N'. and Insert the same record in RET_DATA table with SRC column value 'RET'.
If Unmatched then have to check data in RET_DATA table and see is there any updates/inserts/deletes. For this Before set data extracting from RET_DATA table WHERE SRC='RET'.

My question is:
My source is 20Million+ Records. If 200 records matches in lookup, these 200 records going to RET_DATA table as a Insert. Is there any chance these 200 records will come to change capture before set?

If these records come then all records found as a deleted records in change capture.
Kirtikumar
Participant
Posts: 437
Joined: Fri Oct 15, 2004 6:13 am
Location: Pune, India

Post by Kirtikumar »

If you do not want these 200 records to be the part of before set then you can create an extract job and store this before set to a dataset. Then you can use this dataset for this process.
Regards,
S. Kirtikumar.
Post Reply