DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic is not resolved, but there is a WORKAROUND.
Author Message
deboots



Group memberships:
Premium Members

Joined: 23 Feb 2012
Posts: 71
Location: Portland, OR
Points: 782

Post Posted: Wed Jun 13, 2012 4:24 pm Reply with quote    Back to top    

DataStage® Release: 8x
Job Type: Server
OS: Unix
When I import a .csv file into Business Glossary - any apostrophes within the columns end up changed into a small square. I assume it doesn't like the font I'm using (Calibri) but can't find any documentation stating what font I should be using. Any ideas?
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54595
Location: Sydney, Australia
Points: 296053

Post Posted: Wed Jun 13, 2012 4:26 pm Reply with quote    Back to top    

It has nothing to do with the selected typeface. It has to do with the way that the characters are encoded, for example ASCII, UTF-8, ISO8859-1 or some other.

Pet peeve: Microsoft have foisted this improper use of "font" meaning "typeface" upon the world. Resist it.

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
deboots



Group memberships:
Premium Members

Joined: 23 Feb 2012
Posts: 71
Location: Portland, OR
Points: 782

Post Posted: Wed Jun 13, 2012 4:37 pm Reply with quote    Back to top    

Thanks Ray. So how do I prevent this from happening? Not using apostrophes doesn't seem like a sustainable option. Having to find and fix these within the Business Glossary using Edit seems cumbersome. Any ideas? (BTW - now I'm going to have to research Typeface and Font to understand your other comment. Is this an Mac vs. PC salvo?)
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54595
Location: Sydney, Australia
Points: 296053

Post Posted: Wed Jun 13, 2012 4:39 pm Reply with quote    Back to top    

No it's a salvo from someone with experience and knowledge of typography. You can only experiment. The small square is not really there; it's how your viewer tool displays the character. What y ...

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 43085
Location: Denver, CO
Points: 222463

Post Posted: Wed Jun 13, 2012 4:50 pm Reply with quote    Back to top    

Usually this kind of thing comes from Microsoft's "smart quotes", they aren't apostrophes but rather the magical inward-facing versions that they defined and which don't have an equivalent in your characterset.

_________________
-craig

"You can never have too many knives" -- Logan Nine Fingers
Rate this response:  
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54595
Location: Sydney, Australia
Points: 296053

Post Posted: Wed Jun 13, 2012 6:58 pm Reply with quote    Back to top    

But, if you can find out what they are, you can convert them.

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
vmcburney

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup

Joined: 23 Jan 2003
Posts: 3593
Location: Australia, Melbourne
Points: 28136

Post Posted: Wed Jun 13, 2012 10:06 pm Reply with quote    Back to top    

Generally when you copy and paste content into Word and Excel it leaves the inverted commas alone - so if you paste from a source without smart quotes it will remain normal ASCII characters ' and ". If you type into Word or Excel it will replace ' and " with those smart quotes - you can spot them as they are angled and sexier. Glossary does not like smart quotes as it does not support rich text. You can accidentally end up putting smart quotes into Excel just through manual edits.

I wrote a blog post once about how to run some search and replace commands in Excel to get rid of smart quotes prior to your Glossary import. It was a long time ago on an older version but it may still have some usable tips:
http://it.toolbox.com/blogs/infosphere/the-ibm-information-server-business-glossary-and-how-to-load-it-21195

_________________
Certus Solutions
Blog: Tooling Around in the InfoSphere
Twitter: @vmcburney
LinkedIn: Vincent McBurney LinkedIn
Rate this response:  
eostic

Premium Poster



Group memberships:
Premium Members

Joined: 17 Oct 2005
Posts: 3836

Points: 30974

Post Posted: Thu Jun 14, 2012 9:34 am Reply with quote    Back to top    

You might want to also look into properly escaping the characters...generally speaking, xml doesn't like odd characters, and things like apostrophe are best escaped as ' You can search the ...

_________________
Ernie Ostic

blogit!
Open IGC is Here!
Rate this response:  
frolen
Participant



Joined: 22 Feb 2020
Posts: 11

Points: 93

Post Posted: Thu Oct 01, 2020 12:39 am Reply with quote    Back to top    

Have you tried to change your fonts https://fontsprokeyboard.com/instagram-fonts-generators-change-fonts-with-top-5-apps ? It is not a big deal and you may try it to see if it works at all. If there is no effect, then you should look for a different solution. Let us know how you did it once you succeed. It may be helpful for other users who come across the similar problem.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours