Taking DataStage jobs and running them in MPP environment

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
AhmadAliFilsoof
Participant
Posts: 4
Joined: Tue Oct 14, 2003 9:51 am

Taking DataStage jobs and running them in MPP environment

Post by AhmadAliFilsoof »

Can you take a Server job and run it in an MPP environment?
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Re: Taking DataStage jobs and running them in MPP environmen

Post by kcbland »

No
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
AhmadAliFilsoof
Participant
Posts: 4
Joined: Tue Oct 14, 2003 9:51 am

Post by AhmadAliFilsoof »

Ken, thank you.

Can you take a server job and run it in parallel extender in an MPP environment then?

thanks again.
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

My original answer was wrong, so I have edited it out. I'm now back to I'm not sure. However, no matter what, you're facing having to change your job to fit the model required to run a Server job as a container inside the parallel framework. You will lose a lot of the functionality that make Server jobs so flexible.


The easier path is usually to rewrite your job as a Parallel job and be done with it.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The answer is a qualified yes. You have to encase the server job in a shared container, which you can then use in a PX job design. Then the resource file governs its use in an SMP or MPP environment.
The qualification is that there are some restrictions on this (for example that the server job does not use COMMON). It's well described in the Parallel Job Developer's Guide, page 2-17 (Incorporating Server Job Functionality).
stewarth
Participant
Posts: 1
Joined: Thu Mar 13, 2003 6:15 am

Post by stewarth »

Actually the answer is NO!! DS Server jobs or Server shared containers can only be run on a SMP platform regardless of if PX is used or if a shared container is used within a PX job. A pure PX job can be run on SMP, Cluster and MPP hardware with little to no effort.

Stewart
Stewart
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The answer changes to yes at DS 7.0! :)
Although the manual specifies no for MPP at release 6.x, at least one person at Ascential claims to have it working, in another thread in this forum.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply