Unable to lookup when file is 2megs

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
deep
Participant
Posts: 30
Joined: Fri Dec 12, 2003 9:06 am

Unable to lookup when file is 2megs

Post by deep »

Hi

I have a parallel extender job which does a lookup on a file set using the lookup stage.I have around 100,000 rows in my file set.The lookup works for
some rows which are at the beginning but does not work for other rows which are towards the end of the file.
When i reduced the number of rows in the file set to be 1000.it worked fine.

Did anyone encounter such problems??

Thanks!
deep
Participant
Posts: 30
Joined: Fri Dec 12, 2003 9:06 am

Re: Unable to lookup when file is 2megs

Post by deep »

Hi

I did some more testing..,
There is a funnel stage in the job that builds the file set.
Once i removed the funnel and used a user defined sql to do the join it worked.I was using a continuous funnel.

Pls feel free to add any comments.

regards
deep wrote:Hi

I have a parallel extender job which does a lookup on a file set using the lookup stage.I have around 100,000 rows in my file set.The lookup works for
some rows which are at the beginning but does not work for other rows which are towards the end of the file.
When i reduced the number of rows in the file set to be 1000.it worked fine.

Did anyone encounter such problems??

Thanks!
Post Reply