How to capture duplicate reject row in the sequential file

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
arasan
Participant
Posts: 44
Joined: Wed Nov 30, 2005 3:54 am
Contact:

How to capture duplicate reject row in the sequential file

Post by arasan »

can any one tell how to capture the duplicate reject rows in the sequential file.

for example

source

rollno,name
101,pradeep
102,arasan
101,deepu

in the reject i should get one row after implementing the hob design through datastage.
wnogalski
Charter Member
Charter Member
Posts: 54
Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw

Post by wnogalski »

Store the Rejects in a HashedFile with key column set to rollno but this way you will only get the last version of rejected row with given rollno.
Regards,
Wojciech Nogalski
arasan
Participant
Posts: 44
Joined: Wed Nov 30, 2005 3:54 am
Contact:

Post by arasan »

i tried that but i am unable to capture the reject rows

source(SF)----->transformer----->hashfile
(reject hash file)

if i mplement the job design as this way i am not able to capture the rejected row.After the trasformer the rows from soure are passing directly to the target hash file.but when i view data in hash file i am getting two rows only.I know that hash file is doing is Job but the other rows that is not shoing in the hash file i need to capture it.

If i am wrong pls correct me....
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

By "reject" do you mean "duplicate"?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
WoMaWil
Participant
Posts: 482
Joined: Thu Mar 13, 2003 7:17 am
Location: Amsterdam

Post by WoMaWil »

as Ray already said is, that we need more information, what you finally want to reach. Rejects and Removing Dublicates is a strength of DataStage.

Only if we knew, what you finally want, we can give you a good solution.
Wolfgang Hürter
Amsterdam
arasan
Participant
Posts: 44
Joined: Wed Nov 30, 2005 3:54 am
Contact:

Post by arasan »

hi ray i want the duplicate row from the source sequential file to be captured .
wnogalski
Charter Member
Charter Member
Posts: 54
Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw

Post by wnogalski »

Count the rollno's using Aggregator and then filter the ones with count > 1.
Regards,
Wojciech Nogalski
DSguru2B
Charter Member
Charter Member
Posts: 6854
Joined: Wed Feb 09, 2005 3:44 pm
Location: Houston, TX

Post by DSguru2B »

Check out this post. In this post Craig elaborates a method thats taught by IBM to capture duplicates.
Creativity is allowing yourself to make mistakes. Art is knowing which ones to keep.
wnogalski
Charter Member
Charter Member
Posts: 54
Joined: Thu Jan 06, 2005 10:49 am
Location: Warsaw

Post by wnogalski »

That's a really smart - thanks for the tip DSguru2B :)
Regards,
Wojciech Nogalski
Post Reply