Server job to parallel job conversion

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Server job to parallel job conversion

Post by pandeesh »

Is there any methods/tools/best practices to convert a server job to parallel job?
pandeeswaran
ray.wurlod
Participant
Posts: 54596
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Analyse what it does and write it as a parallel job having regard to issues like partitioning and sorting.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Post by pandeesh »

Hi Ray,

Do any vendors developed any tools for autmating the server to parallel conversion?
pandeeswaran
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

Post by zulfi123786 »

There are utilities to convert one stage to another ex:- replace DB2 with teradata by tweaking the *.dsx file. But i guess there are NO tools for converting a server job to parallel job.

Ray must be having more details
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Post by pandeesh »

Thanks zulfi!!

Can you give more details about the utilities to convert one stage to another stage?

(i.e) i would like to replace a hashed file stage by lookup file set stage.

Thanks
pandeeswaran
zulfi123786
Premium Member
Premium Member
Posts: 730
Joined: Tue Nov 04, 2008 10:14 am
Location: Bangalore

Post by zulfi123786 »

These utilities are none but unix scripts(java/.net) programs that read a .dsx file in XML format and replace the content related to one stage with another stage (along with their associated properties). You can't apply the same for converting a server job to Paralle job (replacing hashfile with look up fileset).

you have to go through the content of the server job understand what it does and redo the desing with a parallel job by replacing the server stages with corresponding PX stages.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

:idea:

pandeesh - do me a favor and save me some work cleaning up after you all the time. There's absolutely no need to quote everything when you reply to something. There's a perfectly good Reply to topic link, please make use of it unless you really need to quote a portion of a previous text to highlight or clarify your anwer or question.

Thanks!
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Now that that is out of the way, as noted there really isn't a way to reliably convert Server jobs to Parallel jobs. I believe that IBM Consulting may have some tools they've built over the years that could do some of the work but that's only for when you pay them to come in and convert them for you and then do all of the finish work to make them actual viable jobs.

As noted, the only true solution is wetware based, not software based. A person needs to understand both methodologies, the strengths of both products so they can look at one and know the best way to build something equivalent or better in the other... whichever way you need to go, or whatever tool you are converting from/to.
-craig

"You can never have too many knives" -- Logan Nine Fingers
pandeesh
Premium Member
Premium Member
Posts: 1399
Joined: Sun Oct 24, 2010 5:15 am
Location: CHENNAI, TAMIL NADU

Post by pandeesh »

Thanks craig! :twisted: :twisted: :twisted:
pandeeswaran
jhmckeever
Premium Member
Premium Member
Posts: 301
Joined: Thu Jul 14, 2005 10:27 am
Location: Melbourne, Australia
Contact:

Re: Server job to parallel job conversion

Post by jhmckeever »

It's a super-old topic, but anyone stumbling over this question many years later may be pleased to know that an automated conversion is about to be released. Read more at: http://s2px.mettleci.io/
<b>John McKeever</b>
Data Migrators
<b><a href="https://www.mettleci.com">MettleCI</a> - DevOps for DataStage</b>
<a href="http://www.datamigrators.com/"><img src="https://www.datamigrators.com/assets/im ... l.png"></a>
Post Reply