DSXchange

Stuart - your question about the retyping solved my problem. I had retyped the operands with empty variable hence it was getting empty values in the field.

Thanks you all for your help here

yes, both New and york are classified as B in previous step and also at the same point where the tokens are classified as B, multisuburb is set to "Y" so that I can identify the retyped tokens and source tokens. There is no chance of other pattern catching in between because this is happen...

ray.wurlod wrote:Check the classification of PVT. (It doesn't occur in USNAME out of the box, but PTY is classified as W.) ...

Its a custom ruleset like a preprocessor Ray. I have defined PVT as "O"

Hi Robert - here is the sample. & PATTERN {modpattern} + | + [ {} != "OF" "ON" "FOR" "AT" ] | B | O | O | $ COPY [1] temp CONCAT " " temp CONCAT [2] temp COPY [3] {Supressedsub} CONCAT " " temp CONCAT [4] temp CONCAT " " temp ...

I am completely sure that the pattern is working fine because the unknown tokens(+) are getting extracted perfectly. The issue is with the concatenation of the classifications tokens. whenever, I am trying to concatenate classifications tokens the entire string is getting lost hence its not coming u...

Yes, Supressedsub is exactly the same name(matches case) from dictionary.

Perhaps, I tried copying directly into Supressedsub without tmp variable. Still the result is same.

I have realized that when I am concatenating multiple classification tokens, I am getting this issue.

I have already tried that but still doesnt seem to be working.

Hi, I am not able to get the below one working whereas the one below is working just fine. The issue here is that the first dictionary field OrgName is being populated as expected but the second dictionary column Supressedsub is not working. what am I doing incorrectly? + | + [ {} != "OF" ...

Yes, I am trying to standardize branches and franchises to the same name. I cant unplug all the names because some of suburb names are part of the name itself. Hence, I need to have the names tokenized so as to be able to identify if the given suburb is part of the org name or a location indicator.

Thanks Robert. This is very close to what I was looking for but not the same. With the help of the the table I am able to validate if the city is present or not. But I cant process it any further like suppress the city name. I think I missed to mention at the beginning that the standardization is pa...

Hi, I am trying to suppress text between 2 characters(this could be same or different like a double quote or open and closed bracket) Below is the example input and output. Input : Hello (Within Bracket) Outside bracket ( within bracket) Hello (Open Bracket without closed Hello ****WORLD** Hello *WO...

Hi Robert - I am trying to standardize cities and suburb names, to have it handled as a single token I have to concatenate the string within the code and then retype it to the classification I am looking for. But the concern here is since the number of names with multiple tokens are too many the pat...

Hi, I am aware that multiple tokens can be handled via manual programming. However, I am looking for an alternate way to manual programming as I have a very huge list of multiple tokens in thousands to be standardized to their corresponding values. I know it works when I have to standardize a single...

I definitely agree with you Vincent. As a work around I tried mocking parallel processing and frequent commit intervals using clover etl and the turn around time reduced to 1/3rd of the actual time. I haven't tested it with DS. Ill try and compare the difference. I hope its not as sluggish as clover...

The concern here wasn't about license but about the sharing of the resources between MDM and DS. I did load the initial load by doing the bulk load and unl files which was pretty fast to process.