Search found 115 matches
- Thu Oct 23, 2008 12:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
I used the following logic with the below two stage variables svControlChars=CHAR(0):CHAR(1):CHAR(2):CHAR(3):CHAR(4):CHAR(5):CHAR(6):CHAR(7):CHAR(8):CHAR(9):CHAR(10):CHAR(11):CHAR(12):CHAR(13):CHAR(14):CHAR(15):CHAR(16):CHAR(17):CHAR(18):CHAR(19):CHAR(20):CHAR(21):CHAR(22):CHAR(23):CHAR(24):CHAR(25)...
- Wed Apr 23, 2008 1:42 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Performance
- Replies: 9
- Views: 5144
Ok, now what is the cpu utilization on the DS server? Do you have spare cpus? How about partitioning the query and running as many job instances as partitions as spare cpus? How about a bulk load o ... Thanks Ken. I do have 4 CPU's and trying to do break the select query into 4 subsets to process t...
- Wed Apr 23, 2008 8:28 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Performance
- Replies: 9
- Views: 5144
A row of data has to come out of the database, traverse the network to the DS process and then go back across the network to the database. In addition, just running a query and timing how long it takes to get the first row returned is NO indication of how long it will take to get to the LAST row. T...
- Tue Apr 22, 2008 2:47 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Performance
- Replies: 9
- Views: 5144
Job Performance
Hi, Trying to Select 28M rows from an Oracle table using DRS stage with Oracle Connectivity. The sql has joins, sub queries,sum , max.. blah blah blah. The sql runs for about 5-6 mins on DB for selecting. Same sql when run thru a DS job is processing at about 156 rps :evil: . Here is what I have tri...
- Mon May 14, 2007 9:50 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
- Sat May 12, 2007 1:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
Each record has 240 columns and this is how source data table looks like Source Data 36807951212 5 AZ 0.00 00003454 00 0 2007-01-01 -189.01 2 1 2 1 1 1 36874721212 6 NY 0.00 00003233 00 0 2006-01-01 121.01 2 1 2 1 2 1 When iam writing down to a target file the data for some records gets truncated an...
- Sat May 12, 2007 9:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
Let me make sure iam heading in right way. Since existence of control characters in source has been told by somebody else so i want to make sure what could be other reasons for data to be truncated only in few rows. Since iam doing a direct dump from a Teradata tables to flat files using Teradata en...
- Sat May 12, 2007 7:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
The source data has Decimals,Dates,Varchar and Char.I am using a Format function in the teradata Ent stage to transform all these decimals and dates to varchar. So my question is do I need to use this Convert function in the transformer for all the columns?. When I look at the data in the teradata S...
- Sat May 12, 2007 6:10 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
I did use this function for converting the ASCII characters values to ''(Empty cotes) Convert(NULSOHSTXETXEOTENQACKBELBSHTLFVTFFCRSOSIDLEDC1DC2DC3DC4,'') I used this function because my senior told me this is the root cause and use the convert function. I am not sure what the cause is. Do you know a...
- Fri May 11, 2007 6:53 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Non-printable Control Characters
- Replies: 13
- Views: 13220
Non-printable Control Characters
My Requirement is I have to extract 100 million records from a teradata table and write it in to a flat file. This data should be written in to multiple files based on a date range and generate a control report for each file which will give the Record Count and give the sum of all the records in cer...
- Mon Jun 19, 2006 3:02 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Not Null date in source being recognized as null
- Replies: 4
- Views: 2260
- Mon Jun 19, 2006 2:13 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Not Null date in source being recognized as null
- Replies: 4
- Views: 2260
Not Null date in source being recognized as null
Hi, I am selecting some data from oracle table using user defined query through DRS stage. While selecting I am masking the date column with TO_CHAR(T1.IN_DT, 'YYYY-MM-DD HH24:MI:SS'). The date in source is 5/19/1997 , for example. In the transform for that column I have If IsNull(LINK_In_Txn2.IN_DT...
- Fri Mar 03, 2006 5:42 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Erro while reading from XML File
- Replies: 3
- Views: 2150
- Fri Mar 03, 2006 3:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: CRC32 Does have limitations (severe in my opinion)
- Replies: 26
- Views: 16063
- Fri Dec 02, 2005 12:49 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Change capture-Segment violation error
- Replies: 1
- Views: 1437
Change capture-Segment violation error
Hi , I am getting the sigsev error while trying to use the change capture stage. There is no string larger than permitted size.Config file is ok. We are getting the following warnings before hitting the fatal error. Before,0: signalHandler__Fi() at 0x204ffb28 Before,0: moveeq.memmove() at 0x3079a6dc...