compare values in transformer stage

ravi7487 · Post by **ravi7487** » Sun Feb 13, 2011 6:25 pm

Hi,

how can i remove duplicates in transformer stage using stage variables?

I have only one column in my source,
payment ID
100
100
101
103
102
101
104

after sorting and hash partitioning in transformer stage, Could you please explain me the logic?

ds_sai · Post by **ds_sai** » Sun Feb 13, 2011 6:33 pm

Is it possible for you to use the distinct function in the Source when you are getting all these values or do you have specific requirement to do this in transformer stage..

ravi7487 · Post by **ravi7487** » Sun Feb 13, 2011 6:53 pm

Thank you for replying, I have to use transformerstage and stage variables. Please letme know the logic. Thank you verymuch

ray.wurlod · Post by **ray.wurlod** » Sun Feb 13, 2011 7:03 pm

Is this an interview question?

WHY must you use a Transformer stage?

Have you performed a Search of DSXchange? Very similar questions have been asked and answered even quite recently, such as this one.

ravi7487 · Post by **ravi7487** » Sun Feb 13, 2011 7:17 pm

chulett · Post by **chulett** » Sun Feb 13, 2011 8:22 pm

Switch the order of the stage variables.

ravi7487 · Post by **ravi7487** » Sun Feb 13, 2011 9:17 pm

Hi chulett, thanks for replying

now i gave as

If DSLink2.deptno = Lastvalue then 1 else 0 = Isdup
DSLink2.deptno= Lastvalue

constraint : Isdup=0

I could not remove duplicate values. Could you Please explain me the logic? Do I have to set any defualt value to Lastvalue?

Thanks

ravi7487 · Post by **ravi7487** » Mon Feb 14, 2011 2:12 am

can anyone please let me know the logic to compate two values using stage variables?

col1

100
100
200
300
200
400

what will be the initial value of the Lastvalue in the below logic?

If DSLink2.deptno = Lastvalue then 1 else 0 = Isdup
DSLink2.deptno= Lastvalue

constraint : Isdup=0

ray.wurlod · Post by **ray.wurlod** » Mon Feb 14, 2011 3:56 am

It has already been given, even in this thread.

ravi7487 · Post by **ravi7487** » Mon Feb 14, 2011 7:33 am

Ray, Chulett told me to switch the order of the stage variables, so i put it as

now i gave as

If DSLink2.deptno = Lastvalue then 1 else 0 = Isdup
DSLink2.deptno= Lastvalue

constraint : Isdup=0

i still not able to remove duplicate values? could you please help? to remove the duplicate values, the comparision is always from current variable to previous variable, but, for the first current variable, what will be the previous variable?

chulett · Post by **chulett** » Mon Feb 14, 2011 7:35 am

ravi7487 wrote:for the first current variable, what will be the previous variable?

Whatever you put in the Initial Value of the stage variable when you define it.

ravi7487 · Post by **ravi7487** » Mon Feb 14, 2011 7:52 am

Thank you for clarifying, But what initial value should I put in for the previous value?

chulett · Post by **chulett** » Mon Feb 14, 2011 7:59 am

Whatever non-null value will not match with anything that might come in on the first record.

ravi7487 · Post by **ravi7487** » Mon Feb 14, 2011 8:35 am

Please tell me the logic, I am not able to get it, thank you

ravi7487 · Post by **ravi7487** » Mon Feb 14, 2011 10:34 am

Could you please tell me the logic how to compare two values in transformer?

compare values in transformer stage

compare values in transformer stage

Re: compare values in transformer stage