DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
pauwel



Group memberships:
Premium Members

Joined: 04 Feb 2008
Posts: 2
Location: Brussels
Points: 20

Post Posted: Thu Feb 14, 2013 6:22 am Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Server
OS: Unix
More or less the same topic as this post but here we already have asynchronuous Oracle CDC in place (as part of Oracle Enterprise) but we want to process the Oracle change tables with Datastage. Any experience/best practises/reference solutions out there?
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3590
Location: Australia, Melbourne
Points: 28109

Post Posted: Thu Feb 14, 2013 8:55 pm Reply with quote    Back to top    

Which Oracle CDC do you have in place? Streams, Data Guard or GoldenGate? Do you currently use that to replicate to another target? Does that replication include audit information such as type of action (insert, update or delete)?

You need to plug DataStage into that flow of replicated data - either by going to a replica database, or replicating to file (not a great option). As far as I know there is no agent between DataStage and GoldenGate so no easy way to share data other than sharing via some staging/replica tables.

I would design a Warehouse where GoldenGate/InfoSphere CDC creates a set of persistent raw data tables and the Warehouse uses those to build an enterprise layer and data marts.

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
Not yet rated
pauwel



Group memberships:
Premium Members

Joined: 04 Feb 2008
Posts: 2
Location: Brussels
Points: 20

Post Posted: Wed Feb 20, 2013 8:46 am Reply with quote    Back to top    

We have Oracle CDC (layer on top of Streams) and Dataguard in place. We don't have Goldengate. So we want to implement Oracle CDC in asynchronous autolog mode meaning we will ship archive logs to a remote staging DB where the Oracle change tables will reside. I've browsed through chapter 16 of the Oracle DW guide a couple of times and understand that our Datastage ETL process will be a subscriber of the published Change Tables but now I have to work out how to process the info in these tables. The latter is what I'm looking for.
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42836
Location: Denver, CO
Points: 220819

Post Posted: Wed Feb 20, 2013 9:14 am Reply with quote    Back to top    

It's been years since I dealt with that so the details are a little fuzzy. However, we did have the archive logs shipped off to a standby server where we were subscribed to the change tables. I be ...

_________________
-craig

Your brain is full of spiders, you've got garlic in your soul, Mr. Grinch!
I wouldn't touch you With a thirty-nine-and-a-half foot pole!
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours