Many Jobs in a sequence Abort, when executed in parallell

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
RudreshEswarappa
Participant
Posts: 21
Joined: Wed Aug 29, 2007 1:33 am
Location: Bangalore
Contact:

Many Jobs in a sequence Abort, when executed in parallell

Post by RudreshEswarappa »

Hi,

I have 5 sequences, each one of them has many jobs and most of these jobs are to be executed simultaneously in parallell. When the 5th sequence which has the other 4 sequences in it is executed, it can be observed in the director that 6-10 jobs execute at the same time. This does not affect the requirement, but most of thses jobs end up aborted after a while and all of them have the same warnings and error message in the log,

"main_program: Accept timed out retries = 16 - Warning
main_program: Accept timed out retries = 15 - Warning
main_program: Accept timed out retries = 14 - Warning
main_program: Accept timed out retries = 13 - Warning
main_program: Accept timed out retries = 12 - Warning
.
.
.
main_program: ORCHESTRATE step execution terminating due to SIGINT -ERROR
Parallel job was aborted -ERROR
"

Please can anyone help.
Rudresh Eswarappa
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Everyone knows that a DataStage server can support an infinite number of simultaneously executing jobs!
:roll:
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
umamahes
Premium Member
Premium Member
Posts: 110
Joined: Tue Jul 04, 2006 9:08 pm

Post by umamahes »

But you will get resource allocation probeem if you run infinite number of jobs at the same time.It depends on hardware,memory and other resources to run more jobs simultaneously.
HI
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

How exactly does one run an infinite number of jobs at the same time? Did you miss the Mr Rollie Eyes icon signifying... well, sarcasm?
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: Many Jobs in a sequence Abort, when executed in parallel

Post by chulett »

RudreshEswarappa wrote:Please can anyone help.
The short answer here is - run fewer jobs at the same time. Simple as that.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply