Multiple instances of DataStage Job

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
bks_prasad
Participant
Posts: 10
Joined: Thu Mar 18, 2004 12:08 am

Multiple instances of DataStage Job

Post by bks_prasad »

Hi All,

Can anybody explain me about the practical advantage of executing multiple instances of DataStage Job. In which scenario I can go for this?

Regards
Prasad
amitdurve
Participant
Posts: 8
Joined: Tue May 11, 2004 5:32 am
Location: bangalore

Post by amitdurve »

Multi instance jobs can be used when say you want to do the same type of processing for multiple input files.
Rather than running the same jobs over and over again you could created routes using which you could process multiple files together.
If you didnt have multi instancing you would have had to make copies of these jobs, now you just call the same multi instance enabled job, just by passing a different invocation id as many times as you like.
bks_prasad
Participant
Posts: 10
Joined: Thu Mar 18, 2004 12:08 am

Post by bks_prasad »

Hi,
thank you very much..Now I am able to work on multiple instances

Rgds
Prasad
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Multiple instances are incredibly useful for partitioning datastreams and using multiple copies of the job to process the data. Why have 1 job crunch the numbers on a 16 cpu system when you can have 16 copies of the job with each crunching 1/16th of the input datastream.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
rasi
Participant
Posts: 464
Joined: Fri Oct 25, 2002 1:33 am
Location: Australia, Sydney

Post by rasi »

Another advantage is that you get separate logs in your director for each instance. This is very useful to check what is the result for each invocation id's.

Thanks
Siva
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

There's actually only one physical log, but you get multiple views (one per invocation) in Director. Purge the log and all the views magically vanish!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
s_boyapati
Premium Member
Premium Member
Posts: 70
Joined: Thu Aug 14, 2003 6:24 am
Contact:

Post by s_boyapati »

For example, if you want to process data from different geographical areas (time zones) due to volume of data and provide data to users in those areas as soon as you finish. In that case you need to process data using same methodology with different parameters. You can use multiple instances of the jobs or copies of the same jobs. But Multiple instances will give you more flexibility for scheduling etc....

Sree
rakesh.puli
Premium Member
Premium Member
Posts: 29
Joined: Wed Mar 22, 2017 10:45 pm

Post by rakesh.puli »

Hi

Can a multiple instance job be a file to table load or only a table to table load ?

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

There's no restriction of that nature.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply