Search found 20 matches

by roydanlobo
Thu Dec 09, 2010 11:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can Teradata connector handle clob data?
Replies: 0
Views: 1919

Can Teradata connector handle clob data?

I have an XML column and facing problems loading it to Teradata using Teradata Connector stage. I am using LongVarchar as datatype. Error is it cannot take more than 64,000 length, But some of my data have 10,00,000 length. can anyone please help me how to work around with this issue? Thanks in adva...
by roydanlobo
Sat Dec 04, 2010 5:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Output file full
Replies: 6
Views: 6660

My admin made ulimit size to unlimited. My file size is over 1.9 GB, so what are the other options I got to do.

Please give any suggestions.

Thanks in Advance
by roydanlobo
Thu Dec 02, 2010 1:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Output file full
Replies: 6
Views: 6660

Error message is as below, when I use sequential file Seqential_File_116,0: Export failed Seqential_File_116,0: output file full When I use dataset, Write to dataset on [fd 15] failed [error 0] on node node1 Orchestrate was unable to write to any of the following files file name Block write failure ...
by roydanlobo
Wed Dec 01, 2010 4:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Output file full
Replies: 6
Views: 6660

Output file full

I have job which is unloading the data from oracle and writing it to sequential file. Table have 5.6 million records ,my job is aborting at 5.3 million and giving me an error Export failed , output file full. I looked into the ulimit which is 2 GB, my data is around 1 GB and even I have free disk sp...
by roydanlobo
Thu Nov 11, 2010 12:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best Way to Load flat file with no delimiters
Replies: 7
Views: 5808

Hope this helps you. Once I faced the same situation, Have to load the data from sequential file(not a delimited file) to Oracle database -Server Job. I used routines, in which I defined the total length of the record and defining all the column and its length.Then used the routine in the transforme...
by roydanlobo
Tue Nov 09, 2010 3:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem while reading from teradata database
Replies: 5
Views: 4303

When unloading the data from source you can handle nulls in your transformer Or you can do this before inserting into target according to your requirement.
As craig said use the default value like '12-31-9999 23:59:59' if null else get the value from your source.


Regards,
Roydan
by roydanlobo
Mon Oct 18, 2010 8:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9602

When I only copy stage, I am getting the below errors Error:The array size must be set to 1 when reading LOBs . I changed the array size to 1 then I got lot warnings like Warning: Invalid character(s) ([x2013]) found converting Unicode string (code point(s): The following contract/Asset (07449564000...
by roydanlobo
Fri Oct 15, 2010 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9602

How fast does the ODBC stage run if you connect it to a copy (and nothing else)? Are you sure it is the transformer that is the problem? I don't think transformer is a problem. I mentioned about the LONGVARCHAR column it is taking time to unload. Say LONGVARCHAR column as TEXT If I use the user-def...
by roydanlobo
Fri Oct 15, 2010 12:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9602

Hey Criag,

Yes, I am doing it in transformer
by roydanlobo
Fri Oct 15, 2010 8:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC taking longtime to unload the data
Replies: 6
Views: 9602

ODBC taking longtime to unload the data

Hi, I have an issue unloading the data from SQL DB to sequential file. I have a sequence job in which there are 3 steps My design: 1. ODBC----->Transformer------->Sequential file(S1) 2. S1------>Transformer------->S2 3. S2------->Transformer------->Teradata In Step1, I am trying to unload data from ...
by roydanlobo
Thu Sep 23, 2010 8:38 am
Forum: IBM<sup>®</sup> DataStage TX
Topic: Creating sequence generator transformation
Replies: 5
Views: 20693

Sequence Number

Well if your question is regarding TX , i have a solution to generate a sequence number from a DB and if you are speaking about PX , Ray is the right guy but not in these forum start a topic in IBM PX forum , VALID(DBLOOKUP( "select fn_seq('xxx') from dual" ,"-MDQ xxx -DBNAME xxx -TE ...
by roydanlobo
Wed Sep 22, 2010 8:45 pm
Forum: IBM<sup>®</sup> DataStage TX
Topic: Data Validation in TX
Replies: 1
Views: 14875

Both ways

Data validation can be done in both ways , Using type trees u can restrict the data coming in like including or excluding particular data. You can even restrict the size of the data , way before it even touches the map.... see the performance point!!! when the data arrives into the map that means , ...
by roydanlobo
Wed Sep 22, 2010 8:26 pm
Forum: IBM<sup>®</sup> DataStage TX
Topic: What are Functional maps?
Replies: 5
Views: 19607

Makes your life easy

I am pretty sure , you have used a c function eg: f(x,y) Same way you use a function in Mercator or WTX with parameters like x and y , this will in-turn act as a sub map to the main map , this is called a functional map. this has a input and the output , the input is nothing but the parameters u pas...
by roydanlobo
Tue Jul 13, 2010 6:10 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML
Replies: 8
Views: 5587

I am sorry, if a order has multiple lines it is showing only one order line
by roydanlobo
Tue Jul 13, 2010 6:06 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML
Replies: 8
Views: 5587

My issue is order lines are repeating.