IA and ODBC SQL Server TEXT data type

This forum contains ProfileStage posts and now focuses at newer versions Infosphere Information Analyzer.

Moderators: chulett, rschirm

Post Reply
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

IA and ODBC SQL Server TEXT data type

Post by qt_ky »

I am running IA on AIX with ODBC pointed at SQL Server.

Some columns have TEXT data type (like a CLOB) which are variable width up to 2 GB in size. Customer was hoping IA would do data classification on these columns and detect sensitive data if present, which is an advertised feature of the tool. Does it not work on large objects? Is there a workaround?

So far I have found that IA reports such columns as data type "STRING" with length "--" and status as "Error." The option to "Include columns with length over 512 characters" is enabled. The corresponding DataStage job log contains a fatal message about having the array size set to 1 for LOB columns.
Choose a job you love, and you will never have to work a day in your life. - Confucius
truenorth
Participant
Posts: 139
Joined: Mon Jan 18, 2010 4:59 pm
Location: San Antonio

Post by truenorth »

We are on 11.3 and have the same issue. Our IT folks have tried different drivers, JDBC, etc, to no avail. We have a PMR open and so far, IBM has not helped resolve the issue. We're hoping we would have better luck when we install 11.5 at yearend but I see you're on 11.5.

The workaround we will attempt is cast the data element in Datastage and write to another table.
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
qt_ky
Premium Member
Premium Member
Posts: 2895
Joined: Wed Aug 03, 2011 6:16 am
Location: USA

Post by qt_ky »

I am also leaning towards the same type of workaround.

I am confused about the setting to include columns with length over 512 characters. The seems to suggest that it could read a large column, or at least read the first 512 characters of it. ??
Choose a job you love, and you will never have to work a day in your life. - Confucius
truenorth
Participant
Posts: 139
Joined: Mon Jan 18, 2010 4:59 pm
Location: San Antonio

Post by truenorth »

Me, too. I made sure it is turned on, but it did not make a difference.
Todd Ramirez
Sr Consultant, Data Quality
San Antonio TX
Post Reply