How to increase performance Tuning in Aggregator Stage

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
zuri_2000
Participant
Posts: 9
Joined: Tue Nov 28, 2006 12:02 am

How to increase performance Tuning in Aggregator Stage

Post by zuri_2000 »

Hi Gurus

Im receiving records from 2 sources: oracle & flat file. Initially 1000 rows r there. but before loading into the target(oracle) it got increased to 15000 records. between source & target im using only one aggregator stage, none other stages r used. i had delay while loading datas in target. how to increase the performance.

Kindly let anyone enlighth me in this regard.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Sort your incoming data to match the aggregation method. Assert that sort order in the Aggregator using the Sort and Sort Order columns on the Inputs tab. Check the online help available from inside the stage via the Help button for details on the second step.

If you do those two things correctly, the Aggregator will not be a 'bottleneck' to processing and you'll get the best speed possible through the stage. Get it wrong, however, and it will either not work any differently than you are seeing now or blow up with a 'Row out of sequence' error.
-craig

"You can never have too many knives" -- Logan Nine Fingers
zuri_2000
Participant
Posts: 9
Joined: Tue Nov 28, 2006 12:02 am

Post by zuri_2000 »

Thanks Mr. Craig.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Let us know if you have any more questions once you try this out! First sign of success will be rows moving through the Aggregator at each 'sort break' rather than it absorbing all records, waiting, and only then starting to output records...
-craig

"You can never have too many knives" -- Logan Nine Fingers
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

It is also possible to tune the memory allocation of the Aggregator stage on a per-job basis, but sorted input renders this unnecessary because memory can be freed as soon as any of the sorted values changes.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply