DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
sangi1981
Participant



Joined: 13 Jun 2008
Posts: 99

Points: 1010

Post Posted: Fri Apr 21, 2017 8:56 am Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Parallel
OS: Unix
Additional info: 5000 Jobs
Hi all,
I write to ask for an advice about a massive upgrade of a Datastage Project.

There is a field called COD_X, that is used everywhere, in every job parallel, server, and sequence.
Number of object is about 5000.

On this field are applied some business transformation rules.

This field has type varchar(2).

DS Project insists on DB Oracle, where field COD_X is used in every primary key, but this is a problem out of scope for that forum.


Our objective is to upgrade this field from varchar(2) to varchar(5).

We can't modify every job.

So I ask for your help, to find a way to obtain the same result with little effort, but highly reliable.

Thanks in advance

Sandro
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 41778
Location: Denver, CO
Points: 214285

Post Posted: Fri Apr 21, 2017 9:12 am Reply with quote    Back to top    

sangi1981 wrote:
We can't modify every job.

I assume you meant manually or one by one. Obviously you'll need to modify every job.

There will be effort and risk so I would make sure you have good backups before proceeding with any effort of this nature. First thing that pops into my head is a dsx export of the entire project, then your favorite editor to make the appropriate size changes and then re-import the affected (or all) jobs.

How will you know what to change where? I would suggest taking an export of a job that will need to be changed. Then manually make the appropriate changes and create a new export. Use a comparison tool (I like UltraCompare) to list out everything that is different between the two and use that as your roadmap. First test before you go all crazy is to take another job, export it and make the changes you think you need to it, saving a copy of the original, unedited export as well so worst case you have something to fall back to. Then import the changes and verify the correctness of it. Lather, rinse, repeat until it comes out all shiny and clean... then proceed with the mass updates.

Good luck. Be curious what other advice people may have.

_________________
-craig

The black queen chants the funeral march, the cracked brass bells will ring
To summon back the fire witch to the court of the crimson king
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1039

Points: 6935

Post Posted: Fri Apr 21, 2017 10:38 am Reply with quote    Back to top    

I vote for DSX file export/edit as well.

You practice on one test job first of course.
Rate this response:  
Not yet rated
Mike



Group memberships:
Premium Members

Joined: 03 Mar 2002
Posts: 970
Location: Austin, TX
Points: 6243

Post Posted: Fri Apr 21, 2017 1:06 pm Reply with quote    Back to top    

Craig's very detailed explanation is exactly how I would approach it.

Also be aware that you will miss cases where the column gets mapped to a different name and that other column also needs its size adjusted.

Lots of risk. You'll have to regression test it all and fix anything that your mass update misses.

Mike
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 41778
Location: Denver, CO
Points: 214285

Post Posted: Fri Apr 21, 2017 6:40 pm Reply with quote    Back to top    

Yeah, even after all these years I didn't think there was another approach for a massive update like this so put that out there...

_________________
-craig

The black queen chants the funeral march, the cracked brass bells will ring
To summon back the fire witch to the court of the crimson king
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours