Array Size - DTS Stage

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
senthil_tcs
Premium Member
Premium Member
Posts: 40
Joined: Tue Oct 14, 2008 3:30 pm
Location: London

Array Size - DTS Stage

Post by senthil_tcs »

Hello,

Need clarification on Array Size option in DTS Stage. Our job design is to read messages from queue, parse it and load the transaction into the target tables. DTS stage is used to ensure transaction control. The query is to understand if we give a value of 2,000 for Array Size, does it signify commit every 2,000 records or 2,000 transactions. In our case each transaction will translate into multiple records into multiple tables. Parent table will have 2,000 records (Say - Order) as we process 2,000 message for each run but child tables will have more than 2,000 (Say - Order Lineitem).

Thanks,
Senthil Kumar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Array size is merely the number of records transmitted at one burst. It should be calculated as the buffer or packet size divided by the estimated record size, rounded down to a whole number (ideally a multiple of two).

Number of records per commit (per transaction) is typically a separate property. Setting this to the same value as the array size, or some integer multiple thereof, is best practice because it avoids unnecessary overlaps.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply