Warning message: unbalanced input from partition
Posted: Thu Oct 21, 2004 8:40 am
New to Datastage,
I am receiving the following warning message:
APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered
APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered
The job that I am running is designed as follows:
Dataset ==> Transformer ==> Aggregator ==> Aggregator ==> LookupFile
The job is returning the correct output but I would like to resolve the warning messages. The problem seems to be with the input sort in the first aggregator. The input data is hash by a consumer-id (6 nodes) and the data needs to be sorted by a consumer-id, purchase-date. I have tried using the sort-stage but still received the same messages. Any help or direction to find answers would be appreciated.
Thanks,
Tom :D
I am receiving the following warning message:
APT_ParallelSortMergeOperator(0),2: Unbalanced input from partition 0: 10000 records buffered
APT_ParallelSortMergeOperator(1),0: Unbalanced input from partition 4: 10000 records buffered
The job that I am running is designed as follows:
Dataset ==> Transformer ==> Aggregator ==> Aggregator ==> LookupFile
The job is returning the correct output but I would like to resolve the warning messages. The problem seems to be with the input sort in the first aggregator. The input data is hash by a consumer-id (6 nodes) and the data needs to be sorted by a consumer-id, purchase-date. I have tried using the sort-stage but still received the same messages. Any help or direction to find answers would be appreciated.
Thanks,
Tom :D