DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
adityavarma



Group memberships:
Premium Members

Joined: 12 Jul 2007
Posts: 106
Location: Canada
Points: 1277

Post Posted: Thu Sep 17, 2020 2:53 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
I am writing data from oracle database to Sequential file. We dont have the NLS enabled at Project level.

Issue is: for some of the data with '(apostrophe) it is being replaced/seen as ’

when i write the same file to Peek, it looks fine.

Example
Correct value: St peter's Currently in File: St peter’s

upon IBM engineer suggestion, we have added APT_IMPEXP_CHARSET=utf8 at project level.

Scenario 1: UTF-8
When using character set utf-8, the '(Apostrophe) is being converted to ’, and the data is correctly formatted.

USERNAME FIRSTNAME LASTNAME DISPLAYNAME DEPARTMENT
Adityak Aditya Kutchar Aditya IT

=====================================================

Scenario 2: UTF-16

When using the character set utf-16, the '(Apostrophe) issue is resolved, but the data is coming in one row when we open it in Excel sheet without formatting.

USERNAME,FIRSTNAME,LASTNAME,DISPLAYNAME,DEPARTMENT
Adityak,Aditya,Kutchar,Aditya,IT

Did any of you see this issue ?

_________________
Thanks
Aditya Kutcharlapati
nani0907
Participant



Joined: 18 Apr 2007
Posts: 161

Points: 908

Post Posted: Sat Sep 19, 2020 12:43 am Reply with quote    Back to top    

Is the output file fixed width or delimited file. If it is delimited , try with datatype as NVARCHAR and use extended propery of column as Unicode.
Rate this response:  
Not yet rated
adityavarma



Group memberships:
Premium Members

Joined: 12 Jul 2007
Posts: 106
Location: Canada
Points: 1277

Post Posted: Tue Sep 22, 2020 7:11 am Reply with quote    Back to top    

Thank you for the reply, I am using Nvarchar , Property cannot be unicode if the column is Nvarchar, Unicode can only be used for varchar.


[quote="nani0907"]Is the output file fixed width or delimited file. If it is delimited , try with datatype as NVARCHAR and use extended propery of column as Unicode.[/quote]

_________________
Thanks
Aditya Kutcharlapati
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54595
Location: Sydney, Australia
Points: 296053

Post Posted: Thu Oct 08, 2020 11:23 am Reply with quote    Back to top    

VarChar + Unicode = NVarChar

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54595
Location: Sydney, Australia
Points: 296053

Post Posted: Thu Oct 08, 2020 11:25 am Reply with quote    Back to top    

VarChar + Unicode = NVarChar

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours