Page 1 of 1

Multiple instances of DataStage Job

Posted: Mon Jul 19, 2004 2:46 am
by bks_prasad
Hi All,

Can anybody explain me about the practical advantage of executing multiple instances of DataStage Job. In which scenario I can go for this?

Regards
Prasad

Posted: Mon Jul 19, 2004 2:54 am
by amitdurve
Multi instance jobs can be used when say you want to do the same type of processing for multiple input files.
Rather than running the same jobs over and over again you could created routes using which you could process multiple files together.
If you didnt have multi instancing you would have had to make copies of these jobs, now you just call the same multi instance enabled job, just by passing a different invocation id as many times as you like.

Posted: Mon Jul 19, 2004 4:29 am
by bks_prasad
Hi,
thank you very much..Now I am able to work on multiple instances

Rgds
Prasad

Posted: Mon Jul 19, 2004 8:51 am
by kcbland
Multiple instances are incredibly useful for partitioning datastreams and using multiple copies of the job to process the data. Why have 1 job crunch the numbers on a 16 cpu system when you can have 16 copies of the job with each crunching 1/16th of the input datastream.

Posted: Mon Jul 19, 2004 5:39 pm
by rasi
Another advantage is that you get separate logs in your director for each instance. This is very useful to check what is the result for each invocation id's.

Thanks
Siva

Posted: Tue Jul 20, 2004 6:02 am
by ray.wurlod
There's actually only one physical log, but you get multiple views (one per invocation) in Director. Purge the log and all the views magically vanish!

Posted: Tue Jul 20, 2004 8:22 am
by s_boyapati
For example, if you want to process data from different geographical areas (time zones) due to volume of data and provide data to users in those areas as soon as you finish. In that case you need to process data using same methodology with different parameters. You can use multiple instances of the jobs or copies of the same jobs. But Multiple instances will give you more flexibility for scheduling etc....

Sree

Posted: Wed Jan 08, 2020 7:14 am
by rakesh.puli
Hi

Can a multiple instance job be a file to table load or only a table to table load ?

Thanks

Posted: Wed Jan 08, 2020 8:43 am
by chulett
There's no restriction of that nature.