DSXchange

I used the following logic with the below two stage variables svControlChars=CHAR(0):CHAR(1):CHAR(2):CHAR(3):CHAR(4):CHAR(5):CHAR(6):CHAR(7):CHAR(8):CHAR(9):CHAR(10):CHAR(11):CHAR(12):CHAR(13):CHAR(14):CHAR(15):CHAR(16):CHAR(17):CHAR(18):CHAR(19):CHAR(20):CHAR(21):CHAR(22):CHAR(23):CHAR(24):CHAR(25)...

Ok, now what is the cpu utilization on the DS server? Do you have spare cpus? How about partitioning the query and running as many job instances as partitions as spare cpus? How about a bulk load o ... Thanks Ken. I do have 4 CPU's and trying to do break the select query into 4 subsets to process t...

A row of data has to come out of the database, traverse the network to the DS process and then go back across the network to the database. In addition, just running a query and timing how long it takes to get the first row returned is NO indication of how long it will take to get to the LAST row. T...

Hi, Trying to Select 28M rows from an Oracle table using DRS stage with Oracle Connectivity. The sql has joins, sub queries,sum , max.. blah blah blah. The sql runs for about 5-6 mins on DB for selecting. Same sql when run thru a DS job is processing at about 156 rps :evil: . Here is what I have tri...

I did view the data from the Operating system using the command "file name |od -acxo".I could view the control characters here.I used the convert function and got rid of this.
Thanks for all your assistance

Each record has 240 columns and this is how source data table looks like Source Data 36807951212 5 AZ 0.00 00003454 00 0 2007-01-01 -189.01 2 1 2 1 1 1 36874721212 6 NY 0.00 00003233 00 0 2006-01-01 121.01 2 1 2 1 2 1 When iam writing down to a target file the data for some records gets truncated an...

Let me make sure iam heading in right way. Since existence of control characters in source has been told by somebody else so i want to make sure what could be other reasons for data to be truncated only in few rows. Since iam doing a direct dump from a Teradata tables to flat files using Teradata en...

The source data has Decimals,Dates,Varchar and Char.I am using a Format function in the teradata Ent stage to transform all these decimals and dates to varchar. So my question is do I need to use this Convert function in the transformer for all the columns?. When I look at the data in the teradata S...

I did use this function for converting the ASCII characters values to ''(Empty cotes) Convert(NULSOHSTXETXEOTENQACKBELBSHTLFVTFFCRSOSIDLEDC1DC2DC3DC4,'') I used this function because my senior told me this is the root cause and use the convert function. I am not sure what the cause is. Do you know a...

My Requirement is I have to extract 100 million records from a teradata table and write it in to a flat file. This data should be written in to multiple files based on a date range and generate a control report for each file which will give the Record Count and give the sum of all the records in cer...

Thanks all,
Worked perfect.

Hi, I am selecting some data from oracle table using user defined query through DRS stage. While selecting I am masking the date column with TO_CHAR(T1.IN_DT, 'YYYY-MM-DD HH24:MI:SS'). The date in source is 5/19/1997 , for example. In the transform for that column I have If IsNull(LINK_In_Txn2.IN_DT...

Choudhary,
Check the incoming file format. There should be a repitition field.

Exactly what i was thinking from the start.
Do we not concatanate columns , why would we use delimeters? I mean CRC32(Col1:Col2:............).
Am I missing something here?
(BTW.Mr.Clapp are you still in Vegas?)
Thanks,

Hi , I am getting the sigsev error while trying to use the change capture stage. There is no string larger than permitted size.Config file is ok. We are getting the following warnings before hitting the fatal error. Before,0: signalHandler__Fi() at 0x204ffb28 Before,0: moveeq.memmove() at 0x3079a6dc...