Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.
Moderators: chulett, rschirm, roy
-
kennyapril
- Participant
- Posts: 248
- Joined: Fri Jul 30, 2010 9:04 am
Post
by kennyapril »
There were around 5 jobs which has no dropped records and all the fileds have been given NVL in the source query. All the jobs were running fine.
All of a sudden the records are getting dropped in the transformer stage which is between two lookups for all the 5 jobs.
please suggest me if I need to change anything
Thanks
Regards,
Kenny
-
kommven
- Charter Member
- Posts: 125
- Joined: Mon Jul 12, 2004 12:37 pm
Post
by kommven »
In Lookup Stage(s), Change Lookup condition from Drop to Continue.
I suspect a lookup failure is causing a drop.
You can enable/use "reject" in Lookup to capture/identify what are failing...
New rows in source are having values that are not there in lookup?
-
kennyapril
- Participant
- Posts: 248
- Joined: Fri Jul 30, 2010 9:04 am
Post
by kennyapril »
Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.
The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.
Regards,
Kenny
-
kennyapril
- Participant
- Posts: 248
- Joined: Fri Jul 30, 2010 9:04 am
Post
by kennyapril »
Actually all the lookups have continue and I am capturing the rejects at the end of the job by filtering the '0' values.
The only thing is usually if a lookup failure occurs the value '0' is given when continue is used, but in this situation the records are dropping.
Regards,
Kenny