Getting Warnings after using entire partitioning

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
aceflyer
Participant
Posts: 7
Joined: Sun Aug 07, 2005 11:26 am

Getting Warnings after using entire partitioning

Post by aceflyer »

HI
When doing a look up i am using entire partitioning , The warning message which i am getting is
APT_ParallelSortMergeOperator(10),0: Unbalanced input from partition 0: 10000 records buffered

Please advice over this

Thanks
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Can you explain your job design, APT_ParallelSortMergeOperator indicates the data collection part where it has been collected uneqully among the existing nodes. It it a sequential file at output?
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
ashwin141
Participant
Posts: 95
Joined: Wed Aug 24, 2005 2:26 am
Location: London, UK

Getting Warnings after using entire partitioning

Post by ashwin141 »

Hi

Can you please tell us about your Job design?

It may be because of combining of parallelSortMergeOperator.


Regards
Ashwin
Post Reply