DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
ponzio
Participant



Joined: 05 Dec 2005
Posts: 165
Location: Italy
Points: 1879

Post Posted: Wed Feb 22, 2006 6:20 am Reply with quote    Back to top    

Hi all.
In my experience the "undup" type of match ha some limitations:

1) groups created in a pass are not merged in the next passes

2) only master records and residuals are made available for
the subsequent passes


Undup independent seems to solve those limitations. To enter in a group I think it's enough that at least one of the match criteria expressed as a pass is matched, and this match doesn't need to be with the master record but it also can be with whichever of the records in the group.

The problmem with undup independent is that I don't know to which pass is related the weigth (I see in the extract file), because all the records in the group have the same pass number.

My question is: how can I know more about undup independent ?
How can I work with cut-offs ?

Thanks
ponzio
Participant



Joined: 05 Dec 2005
Posts: 165
Location: Italy
Points: 1879

Post Posted: Tue Mar 28, 2006 6:43 am Reply with quote    Back to top    

Any news ?
Rate this response:  
Not yet rated
ashok
Participant



Joined: 22 Jun 2004
Posts: 43

Points: 388

Post Posted: Thu Feb 01, 2007 9:46 pm Reply with quote    Back to top    

wt cut off's are explained very well in MatchConcepts, my suggestion is to work with 10/20 sample records and apply cut offs depending up on matching fields

To better understand use only one pass, later you can experiment with increasing number of passes.

Thanks
Ashok
Rate this response:  
Not yet rated
ashok
Participant



Joined: 22 Jun 2004
Posts: 43

Points: 388

Post Posted: Thu Feb 01, 2007 9:54 pm Reply with quote    Back to top    

Regarding first question?

Undup independent will also bring records which you might not want to consider as required matches, so be carefull while selecting passes for Undup independent, Like pass one has hard key match & pass to has fussey match

example-
Pass 1- 10 char name & tax id
Pass 2- Name & address

do some analysis and decide which method is best to opt.
Rate this response:  
Not yet rated
ponzio
Participant



Joined: 05 Dec 2005
Posts: 165
Location: Italy
Points: 1879

Post Posted: Thu May 17, 2007 4:48 am Reply with quote    Back to top    

Hi ashok
sorry for my delay...I forgot to check for new posts

Wink


Thanks for yours suggestions but my question is quite different...
and sincerely, I didn'y undertand your last post Embarassed

I know how weights cutoffs works with "undup" (I've been working on "big" projects with QS for 4 years also for Ascential/IBM)
...but the problems with cutoffs in "undup" is a little more particular...

Suppose you have 4 similar records as result of the first macth pass, then you setup a new cutoff for that pass and those records are splited into 2 match groups...
then suppose you setup the second match pass with others criterions.
With the criterions introduced by the second pass the 4 records should result similar and grouped in only one match group...
that is not possible because of the split done by the FIRST pass !


I know QS works this way and with "undup" only "single" records are added to match groups created in previous passes, no groups created in previous passess are added to others ...


My real question was related to the behaviuor of "undup independent" and how to use it Very Happy
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours