DSXchange

Hi All,
Following is the code being used in Ab Initio:
out.pd_into_ovrdrft_cd :: string_replace(re_replace(in.pd_into_od_cd, "[\001-\037|\177-\377]", " "), char_string(0), " " );

My understanding is Within the column pd_into_od_cd, any occurrence of a value between \001 and \037 (control characters) or between \177 and \377 (non-ASCII characters or non-printable characters) should be replaced finally by 1 space

Can we use same code in a convert function? Or is there other way of doing this?

Thanks in advance.
-Amit

The Ab Initio code looks like a direct interlude to the unix tr command; which you can use as a filter in the source sequential stage. The syntax of the DataStage CONVERT function is very different, you explicitly specify two strings, and each position value in one string is convert to the value in the same position in the other string. So you would need to explicitly list those characters you wish to convert in one string and then have another string of the same lenght filled with spaces.

Convert() does not support ranges or octal representation, but you can set up a stage variable containing a string of all the characters to be converted, and a single Convert() function can then be used to replace them with " " from a stage variable containing the same number of space characters as there are unwanted characters in the first string. Or you could use a UNIX command such as tr (perhaps in an External Filter stage) which can handle regular expressions as in your example.

Just thinking aloud, but could this translation be done using a custom NLS map?

katz

Hi,

I am sorry Ray, since I am not a premium member of this forum I am not able to see your copleter response here. I am still struggling with this. Can anyone tell me how to find and replace non-ascii/control characters from the string?
Thanks in advance.

-Amit

Said pretty much the same Arnd did. Investigate the Convert function, use multiple Char() functions cat'd together to build the list of characters to change.

If i remember it correctly, one of the user 'michaeld' or 'bcarlson' has written a generic 'C' function and posted here which does this.Do a search in the forum.

It can be detected with function index(strg, char(8206),1) for Unicode 0x200E, but it seems convert(strg, char(8206), '') doesn't recognise the char(8206), so doesn't work as expected.

So... are you looking for help with that or simply providing help 11 years after the fact?

Another function works: ereplace(strg, char(8206), '')