DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
esivaprasad
Participant



Joined: 09 Dec 2008
Posts: 135

Points: 1422

Post Posted: Thu Nov 30, 2017 4:34 am Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Server
OS: Unix
Hi Team ,


In our project , we are doing reconcillation on 2 sources.
in both source , one source file is in .txt format and other source is in form of .csv .

In reconcillation job before comparing 2 sources , in transformer stage , we are trimming all fields in both source files.
for reconcillation , we are using CDC stage.
after cdc stage , we have target stage .
few records are coming as not matching records, if we see those records, that are same in both sources.


we have seen those records in notepad, textpad and in excel , but records are same , still it coming as not matching one to other source record values.
Please let me know other trim and tril leading trailing functions , what functions we can use for triming.

Source|SourceSystem|Customer_Number|Account_Group|Name1|Fax_Country|Fax_Number|Sequence_Number|Standard_Fax_No
Source1|LA|0000013010|Z012|INDUSTRIA DE LICORES DEL VALLE|CO|2 68303||
Source2|LA|0000013010|Z012|INDUSTRIA DE LICORES DEL VALLE|CO|2 68303||

_________________
Siva
qt_ky



Group memberships:
Premium Members

Joined: 03 Aug 2011
Posts: 2827
Location: USA
Points: 21429

Post Posted: Thu Nov 30, 2017 8:05 am Reply with quote    Back to top    

Perhaps one record contains non-printable control characters or the ASCII NULL character 0x00 which is often introduced by DataStage due to the default setting of the project environment variable APT_STRING_PADCHAR. We always override the default setting at the project level by using 0x20 instead, which is a space. If you view your text file records in hex, maybe something will jump out.

_________________
Choose a job you love, and you will never have to work a day in your life. - Confucius
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42836
Location: Denver, CO
Points: 220819

Post Posted: Thu Nov 30, 2017 8:07 am Reply with quote    Back to top    

Was just going to suggest much the same thing - get thee to a hex editor! Or an octal dump "od" can be leveraged on the server.

_________________
-craig

Your brain is full of spiders, you've got garlic in your soul, Mr. Grinch!
I wouldn't touch you With a thirty-nine-and-a-half foot pole!


Last edited by chulett on Thu Nov 30, 2017 1:19 pm; edited 1 time in total
Rate this response:  
Not yet rated
Mike



Group memberships:
Premium Members

Joined: 03 Mar 2002
Posts: 1017
Location: Tampa, FL
Points: 6551

Post Posted: Thu Nov 30, 2017 11:18 am Reply with quote    Back to top    

If by CDC you mean the Change Capture stage, then be aware that it requires unique keys on both input links. You can see the result you describe when there are duplicate keys.

Mike
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours