Same job run parallel (along with multiinstance)

linit · Post by **linit** » Thu Nov 16, 2006 10:47 am

I have a server job which accepts date variable as a parameter. Now I get a set of dates (which is dynamic and varies, but max of 36 dates) which will be passed to this job as a parameter.

Now I have to run the same job simulteneously/parallel for the given set of dates. How can we achieve this in Server edition.

E.g.

If I get the set of 3 dates as
01/JAN/06
01/FEB/06
01/MAR/06
Then I have to run the same job 3 times in parallel with mentioned date as parameter

And if If I get the set of 4 dates as
01/JAN/06
01/FEB/06
01/MAR/06
01/MAY/06
Then I have to run the same job 4 times in parallel with mentioned date as parameter

Thanks in advance..

Krazykoolrohit · Post by **Krazykoolrohit** » Thu Nov 16, 2006 10:53 am

what kind of problem will running them sequentially pose?

Anyways, to run them parallely.

Goto job properties and click on "allow multiple instance". compile and run the job. You will see a new drop down called invocation ID. this is where you will have to give different dates for different parralel runs of the same job.

to automate this you will have to use a sequencer, where you can specify a parameter for the value of invocation IDs

ray.wurlod · Post by **ray.wurlod** » Thu Nov 16, 2006 12:06 pm

Does your machine have one CPU or two? Have you measured resource consumption on one instance of this job? Will the machine handle 36 times this demand? Your requirement to "run" the jobs may end up being "walk", "crawl" or even "refuse to go".

velagapudi_k · Post by **velagapudi_k** » Thu Nov 16, 2006 2:25 pm

Hi rohit,

Goto job properties and click on "allow multiple instance". compile and run the job. You will see a new drop down called invocation ID. this is where you will have to give different dates for different parralel runs of the same job.

to automate this you will have to use a sequencer, where you can specify a parameter for the value of invocation IDs

.
But how to run the same job paralelly.Even though you run the same job with different invocation IDs, the job will be running sequentially right, for example in linit's case it will run different dates only one after other but for not all the dates at the same time right. How can we run the same job parallelly for different dates?

linit · Post by **linit** » Fri Nov 17, 2006 5:55 am

Thanks for the replies, but with the steps mentioned by Krazykoolrohit, I will achieve to run the same job multiple times with different argument values. But along with this I need to run them in parallel for all given set of dates.

So how can we achieve running the same job simulteneously for given count of dates

Regarding the CPU, We have 16 CPU server and I hope that is not a problem.
And regarding the data amount, usually we get the data of around 80 million records split across 24 months i.e. 3.4 million for each month

Your immediate response would be highly appreciated.

Thanks in advance.

DSguru2B · Post by **DSguru2B** » Fri Nov 17, 2006 7:10 am

Try running 10 instances first and see how they behave. As Ray noted, some jobs might refuse to start as no resources might be present. Also you need to take into accord other activities happening on your server.
Use the sequence job to run your jobs in parallel.

linit · Post by **linit** » Tue Nov 21, 2006 10:47 am

I was trying use Startloop..Endloop activity in which I am calling a sequence which run the above job. However, I am not able to run parallel, they run in sequence.

Is there any way to run parallel using the Start..End loop activity...

Thanks in advance
Linit.

ray.wurlod · Post by **ray.wurlod** » Tue Nov 21, 2006 11:52 am

Please think about what you've just asked. You should be able to answer your own question. A Job activity waits until its job finishes.