How about a Change Data Detection stage for all DS versions?

Do you have features you'd like to see in future releases of DataStage, MetaStage, Parameter Manager, Version Control or one of the other tools represented on this forum? Post your ideas here!

Moderators: chulett, rschirm

Post Reply
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

How about a Change Data Detection stage for all DS versions?

Post by jdmiceli »

Hi all,

I think I've read that Parallel server has some functionality for determining data changes when no update_dt is available. It would sure be nice if this functionality existed in all versions of DS, especially for us lowly Server users :wink:

I know there is CRC stuff available, but I would think this would be a basic requirement/necessity/nicety to have available.

Bestest,
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Wouldn't it be great? There is also the new parallel slowly changing dimension stage in the Hawk release that lets you maintain it from a single stage. There is almost no chance of it being introduced to server jobs as this is not the future direction of the product. Server jobs will continue to be supported but I wouldn't expect any new stages.
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

That figures...

Post by jdmiceli »

:evil:

Leave it to my company to buy the wrong version (wrong being relative of course).

Thanks for getting back to me so soon,

Bestest!
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Re: How about a Change Data Detection stage for all DS versi

Post by chulett »

jdmiceli wrote:I think I've read that Parallel server has some functionality for determining data changes when no update_dt is available.
Isn't that the Change Data Capture stage? From what I've heard, it uses CRC32 under the covers so more properly CDD rather than true CDC... and it's not like you couldn't do CDD in a Server job in a very similar fashion. It's just not all wrapped up in one shiny stage. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
jdmiceli
Premium Member
Premium Member
Posts: 309
Joined: Wed Feb 22, 2006 10:03 am
Location: Urbandale, IA

you are correct...

Post by jdmiceli »

Hi Craig,

I have not found that stage in our installation of the Server Edition. Is it available for it? I thought it was a Parallel Server/TX stage, not Server. If it is a plug-in or something, where would we find the code for it to install? Did it come with our installation discs, or do we need to purchase it separately from somewhere?

Thanks!
Bestest!

John Miceli
System Specialist, MCP, MCDBA
Berkley Technology Services


"Good Morning. This is God. I will be handling all your problems today. I will not need your help. So have a great day!"
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Sorry if my post was a little confusing. The CDC stage *is* a PX only stage, I was talking about emulating what it does under the covers in a Server job - not saying there was a Server stage equivalent.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply