DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
ASU_ETL_DEV



Group memberships:
Premium Members

Joined: 09 Sep 2008
Posts: 39

Points: 382

Post Posted: Thu Aug 11, 2011 4:29 pm Reply with quote    Back to top    

DataStage® Release: 7x
Job Type: Server
OS: Unix
Hello,
I would be curious to know whether anybody has worked on an installation where Oracle GoldenGate was used as CDC tool to push changes to DataStage for transformation and loading, and what comments they might have on this solution.

Thank you.

_________________
ASU Developer
djwagner



Group memberships:
Premium Members

Joined: 31 Jul 2006
Posts: 17

Points: 273

Post Posted: Wed May 02, 2012 1:21 pm Reply with quote    Back to top    

We are investigating the same. Does anyone have an experience with this?
Rate this response:  
Not yet rated
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3564
Location: Australia, Melbourne
Points: 27712

Post Posted: Wed May 02, 2012 7:58 pm Reply with quote    Back to top    

DataStage has very good integration with InfoSphere CDC (formerly DataMirror) and you will find it is a hell of a lot cheaper to use this product combination than GoldenGate due to IBM's special pricing. With CDC for DataStage (called CDD by IBM) then you can have unlimited source databases whereas under the GoldenGate pricing you have to pay for every source. InfoSphere CDC does the same thing as GoldenGate and has a much better UI for managing table subscriptions. CDC also has a DataStage stage so you can share data with DataStage in memory in real time.

If you have to use GoldenGate with DataStage then probably the best design is to get GoldenGate to stage the data to a database table and use DataStage to read from that table. You might also be able to get GoldenGate to pass the data to some type of message queue or ESB and get DataStage to read from that. I don't know of any way to get GoldenGate to share data in memory with any ETL tool and I don't think it has ETL Guaranteed Data Delivery that you get from InfoSphere CDC+DataStage where a DataStage job that aborts can be restarted and process data from where is left off.

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours