DSXchange

Hi Sura,

Thanks for the reply. Problem here is I don't have any table to deal with where in I can use the power of RDMS I have to deal with sequential file unfortunately.

Hello, How can I assign a unique number to an incoming row when there are several transformers running in parallel as displayed in the below embedded image. The unique number needs to be created for the rows coming from sequential files NOT after transformers as those are performing pivoting of data...

Ahh... That's the miss. A parallel usage of different environments is tricky

Shane,

That worked like a charm, including char(13) did the trick. My source is XML file and I am implementing this logic after parsing the data.

I will try to build the RCP with this data.

Thanks for this awesome solution !!

Hello Shane, I stumbled into a situation where in the Header columns and the first row are being read as ONE row, meaning: ROW 1: ABC|DEF|GHI|JKL|MNO|XYZ 123|234|333|222|666|345 ROW 2: 789||||555| When I implement RCP from here on I am not sure if I will be able to load the table. I was expecting th...

Shane, Yes key columns are identifiable but they are not the same in each target table as per my previous example: ABC column is the key for staging table 1 and GHI column is the key for staging table 2. That's a viable solution RCP didn't struck my mind. For Inserts there will be one job to load 2 ...

Hello Info_ds,

Appreciate your insight on this. When you say rowcompare do you mean joining the data with seq num ? While performing split of the data into header & data, is it possible to be dynamic split and map to respective target columns ?

Hello Shane, Yes, the target is database so I need after I loaded the sequential file as per your solution, How can I go by using it dynamically ? Yes, that 3rd column is the DB action but I don't do anything with it as of now. I will load 2 staging tables which will have respective column names tha...

Hello Shane, Your solution was very handy, I ran into a minor pitfall by not sorting data well which lead to mismatch the Headers and data column. I was able to fix it. I have couple of questions on this design please throw some insight: 1. If I get another column from the source say "ACTION&qu...

Great !! Thanks again, I will implement this logic per my data and will get back if I stumble into an issue.

Will update this thread soon. Thanks !!!

Hello Shane, Thanks for your extensive insight into this. My data is sourced from XML and I pivot the data which is shown in my example. It is not always 3 columns at a time, there can be any number of columns as Ray pointed out it is dynamic. Yes, rows arrive as header row, data row, header row, da...

Is there a way to assign some sort of sequence number to the group of data that can make this a possibility ?

Thanks ray. I have tried giving the value at job level, at run-time but neither allowed me to do so as the "Value" box is greyed out. I just left it as TRUE and still can't find the report.

Hello, Below is the scenario: In the data that I am getting from the source Column names are embedded into rows I have to pivot these rows and derive column names from them. I have done the pivoting part which is shown in the sample below, I am left with the challenge to derive column names from row...

After adding the Dump score environment variable I have re-compiled and ran the job. I just tried to set the value of the $APT_DUMP_SCORE to '1' but I couldn't as the "Value" box is greyed out and I am only left with choosing between 'TRUE' or 'FALSE' in which I selected TRUE but couldn't ...