Simultaneous reading of a dataset

sswarup · Post by **sswarup** » Fri Oct 22, 2004 4:02 pm

Hi,
Can two independent jobs read one dataset simultaneously?

ray.wurlod · Post by **ray.wurlod** » Fri Oct 22, 2004 4:33 pm

Maybe, maybe not.

For a start, both jobs would have to run on exactly the same set of processing nodes. It may also be necessary to specify those in the same order (for example use the same configuration file for each job), so that the partitioning algorithm works the same way.

I don't imagine you would have any issues with locking, since both open the dataset for reading.

Why not try it, and let us know?

dsxdev · Post by **dsxdev** » Thu Oct 28, 2004 9:12 am

Hi

Rightly said by Ray it may be possible to read same Dataset by two different jobs if you specify same processing nodes This is necessary because Data in Dataset recides on Nodes.