DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
perspicax



Group memberships:
Premium Members

Joined: 07 Dec 2017
Posts: 24
Location: USA
Points: 239

Post Posted: Sun Feb 02, 2020 8:25 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
There is job that I generated from Fasttrack. The job doesn't have much transformers except for few (4) lookups from dimension tables. The job that is generated looks as follows and seem like will save time and manual work.


Src Tbl > LookupContainer001 > Transformer > MappingContainer > Target

LookupContainer has all the lookups and filters. Transformer has few transformations implemented in the fasttrack design and most of the columns are a pass through. The problem is with a MappingContainer. Inside the mapping container there is a generic stage and documentation under 'Todos". The mapping container looks as follows

input > Generic001 > Output

Under Properties of Generic stage, the generic stage is expecting a value for Operator. Is there a value that I can supply to get a behavior of a Copy Stage and pass through all the columns from input to output?

Thanks
perspicax



Group memberships:
Premium Members

Joined: 07 Dec 2017
Posts: 24
Location: USA
Points: 239

Post Posted: Sun Feb 02, 2020 1:19 pm Reply with quote    Back to top    

Is there a way to model generic stage as copy stage? Sorry I am not too familiar with orchestrate scripts. Is there a documentation with examples? I could not figure this out from advanced developer guide
Rate this response:  
Not yet rated
asorrell
Site Admin

Group memberships:
Premium Members, DSXchange Team, Inner Circle, Server to Parallel Transition Group

Joined: 04 Apr 2003
Posts: 1704
Location: Colleyville, Texas
Points: 23166

Post Posted: Tue Feb 11, 2020 1:41 pm Reply with quote    Back to top    

You can replace the Generic stage with the Copy stage or any other stage required for job completion. The Generic is just a placeholder.

FastTrack provides a starting point, but you are expected to take the beginning job and add to it and modify it as required.

_________________
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
Rate this response:  
Not yet rated
perspicax



Group memberships:
Premium Members

Joined: 07 Dec 2017
Posts: 24
Location: USA
Points: 239

Post Posted: Wed Feb 12, 2020 7:31 pm Reply with quote    Back to top    

Thank you for the response. That is what I ended up doing. The only issue is that it breaks the mapping in the copy stage which was already taken care in the generic stage. The mapping breaks because the column names in target is different from source columns due to the naming standards. Auto match do not work and requires manually recreating the mapping in the copy stage.

I do not know a way to replace generic stage with copy stage without breaking the mapping. Is there a way to do it?
Rate this response:  
Not yet rated
asorrell
Site Admin

Group memberships:
Premium Members, DSXchange Team, Inner Circle, Server to Parallel Transition Group

Joined: 04 Apr 2003
Posts: 1704
Location: Colleyville, Texas
Points: 23166

Post Posted: Sun Feb 16, 2020 5:40 pm Reply with quote    Back to top    

You can retain the metadata on the input and output links, and temporarily keep a copy of the generic stage for a reference in case it has additional details.

1) Right click on the Generic Stage and copy it, then paste it back into an empty spot on the canvas. That should place it there with its input and output links so you can check back on it later.

2) Carefully detach the input and output links from their connections to the original Generica Stage. This means disconnecting them by dragging them off the stage, not deleting them!

3) Delete the original (now disconnected) Generic Stage

4) Drop the replacement stage where the old Generic Stage was, and reconnect the input and output links.

5) Correct the replacement stage, referring to the copied Generic Stage as required.

6) Delete the copied Generic Stage and its links when done.

_________________
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours