records dropping in transformer!!

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
kennyapril
Participant
Posts: 248
Joined: Fri Jul 30, 2010 9:04 am

records dropping in transformer!!

Post by kennyapril »

There were around 5 jobs which has no dropped records and all the fileds have been given NVL in the source query. All the jobs were running fine.

All of a sudden the records are getting dropped in the transformer stage which is between two lookups for all the 5 jobs.



please suggest me if I need to change anything


Thanks
Regards,
Kenny
kommven
Charter Member
Charter Member
Posts: 125
Joined: Mon Jul 12, 2004 12:37 pm

Post by kommven »

In Lookup Stage(s), Change Lookup condition from Drop to Continue.
I suspect a lookup failure is causing a drop.

You can enable/use "reject" in Lookup to capture/identify what are failing...

New rows in source are having values that are not there in lookup?
kennyapril
Participant
Posts: 248
Joined: Fri Jul 30, 2010 9:04 am

Post by kennyapril »

Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.

The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.
Regards,
Kenny
kennyapril
Participant
Posts: 248
Joined: Fri Jul 30, 2010 9:04 am

Post by kennyapril »

Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.

The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.
Regards,
Kenny
Post Reply