Configuring Generic stage for Change capture operator

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
G.K.K
Participant
Posts: 61
Joined: Tue May 13, 2008 6:54 am

Configuring Generic stage for Change capture operator

Post by G.K.K »

Hi,
We are developing a generic job with change capture functionality incorporated using a generic stage since the number of change values keep varying at runtime and these change_value columns are to be passed as a single parameter seperated by commas.

How to specify the option name and option value in the generic stage for this specific scenario.

Note: We have given the following,
operator = changecapture
OptionName = Key
optionvalue = <FieldName>
OptionName = value
optionvalue = <parameter> # parameter contains the column1,column2 seperated by comma
optionname=keepCopy
optionname=keepEdit
optionname=keepDelete
optionname=keepInsert

Execution Results
With the above options, we are getting the below error
Fatal Error:
Generic_11: When processing argument -valueWhen processing name: column1,column2 is not a valid field selector: Expected identifier, got: column1,column2
How to fix this issue
nbalegar
Participant
Posts: 9
Joined: Fri Jul 08, 2011 2:47 am

Re: Configuring Generic stage for Change capture operator

Post by nbalegar »

The other way you can work to create a generic job for CDC is using the two column export stage one for join keys and another for value keys. you need to use the schema file,which has to be passed in the column export stage. For you scenario you can create two schema files for joining keys and value keys. probably the part of design will be like this

Before Data--->CE(joining keys)--->CE(value keys)--->CDC--->CI-->target DS.
G.K.K
Participant
Posts: 61
Joined: Tue May 13, 2008 6:54 am

Re: Configuring Generic stage for Change capture operator

Post by G.K.K »

Thanks for the input , the design worked.
premupdate
Participant
Posts: 47
Joined: Thu Oct 04, 2007 3:37 am
Location: chennai

Re: Configuring Generic stage for Change capture operator

Post by premupdate »

Hi Sir,

Could you please explain elaborately about the below design. For CDC we need two input links....

Below is your flow,

BeforeData --> CE(keys) --> CE (Value) --> CDC --> CI --> target DS

Thanks,
Cheers,
prem
UCDI
Premium Member
Premium Member
Posts: 383
Joined: Mon Mar 21, 2016 2:00 pm

Post by UCDI »

The user who posted that has not posted since 2012...
Post Reply