Multiple readers in a sequential file stage.

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Ravindar
Participant
Posts: 30
Joined: Tue Mar 23, 2004 6:14 am
Location: Chennai, India

Multiple readers in a sequential file stage.

Post by Ravindar »

I want to know how multiple readers are working in a sequential file stage and for what purpose this option is given.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The obvious purpose is for parallelism. The sequential file stage has a "lookahead" capability. This, combined with foreknowledge of the file's size, means that it is possible to establish the equivalent of database cursors into a text file, so as to process all of its data more swiftly.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply