Unable to capture reject records while reading file with RCP

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
r.bhatia
Participant
Posts: 11
Joined: Mon Jun 30, 2008 12:45 am
Location: Manchester

Unable to capture reject records while reading file with RCP

Post by r.bhatia »

Hi All,

I have a generic extract job which uses RCP with the following design

seq_stage ---> filter_stage --> data_set

The seq_stage reads an ebcdic file using schema file

The problem with this job design is that even when the file is invalid (not in expected format as specified in schema file) the job creates the corresponding dataset with improper data.

I tried to introduce a reject link from seq_stage so that the records with improper data are rejected.

But I am getting the following warning:

isf_source: Record format type=implicit: cannot save rejected records.

And no reords are being rejected. I want to introduce record/row level
error handling in this genric job. Any suggestions on this?
rakesh bhatia
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Diable RCP in the Sequential File stage.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
John Smith
Charter Member
Charter Member
Posts: 193
Joined: Tue Sep 05, 2006 8:01 pm
Location: Australia

Post by John Smith »

In your sequential file stage with RCP turned ON, you should still include at least one or more defined columns e.g the first column of your file. If you can do that then you can get the reject records.
If not then you will need to validate the files before reading them in the job.
rachit82
Premium Member
Premium Member
Posts: 41
Joined: Thu Jul 17, 2008 9:49 am

8.5 changes are interesting

Post by rachit82 »

I got the same issue. check if you have selected the multi-node option and the report progress option. apparently these options coupled with the reject option for data cause the warnings. As far as i've seen, no solution is available but if i find something, i'll let you know.
Post Reply