DSXchange

Hi, I have data like this. key, start, end 1,1,100 1,80,140 2,200,300 4,250,300 Here I am looking to reject/capture the first two records where there is an overlap. i.e for the same key, the end should not fall between the start and end of the other record(with the same key). and the start should no...

But, when I have comma in a field, then I get them in quoted fields

xxx,yyy,"last,first", "yyyy""",jjj

Here the 3rd field is "last,first". If I have the quote as none, then it is considering the third field as last and not reading properly..

Hi, I have double quotes in data and ds is not recognizing the field Data looks like this xxx,yyy,"last,first", "yyyy""",jjj This is a .csv file and I have given the quote character as double quote. This record is not being read in sequential file at all, so If I could ...

Hi I have some data like this KeyID, Data1,Data2 1,test1,test2 1,mmm,nnn 2,ttt,bbb 2,444,888 1,vvv,bbb 1,sss,fff And I want the data like this KeyID,Data1,Data2,Data3,Data4 1,test1,test2,mmm,nnn 2,ttt,bbb,444,888 1,vvv,bbb,sss,fff So, when there is a key, I would like to take all corresponding data ...

Thanks Rick and Craig!!..And looks like the array size is the one responsible for the job working good when record count is low. Since array count was set to 2000, it didnt cause any problem when it processed 1000 records or so. I tested it by increasing it to 5000 and it worked fine if the record c...

My data is like this ID value 1 abcd 1 defg 1 rtrt 1 6767 1 7887 As such there is no key in the table. I am specifiying the ID column as the key column in datastage for delete then insert option. My assumption was that When I give Delete then insert based on key(ID), it deletes all the records with ...

Hi, I am using "Delete then insert" option to load data in target Oracle table. Source is a .csv file. Every file is identified with an id and data needs to be replaced if we get the same file again even with different data. I have defined the key as the file id and load option as "De...

Hi, I have to load a oracle table from a file. There are no keys in the table. In this situation what would be the best approach to load the table with restartability in place..If the job aborts in the middle with some rows inserted, how do i make sure that the same records dont insert into the tabl...

Hi, I have a date in the file as 10/11/17 and i am trying to load it into the table. When i use this function StringToDate(Trim(DSLink2.File_Date),'%(d,s)/%(m,s)/%yy'), I tried to output in a seq file and its output is "1917-11-10"..Why is it giving the ouput as 1917 instead or 2017?. Is t...

Thanks for all your inputs. I added the "Record delimiter string" to DOS format and was able to read the file as it was.

Yes, they are all defined as Strings. And i will be converting those fields as required inside the job. But now the problem is with reading the file itself. While i view data in sequential file stage the 2nd and 3rd record get dropped if i specify the Final delimiter as "end" or "none...

Hi, I have a .csv format file and it comes in the following way For ex it has 4 fields a,345,cd,678 b,"6,878",cd,"9,870" c,"7,989",fg,"7,880" d,567,cd,989 The second and the fourth field are numeric fields and if it is more than 3 digit number the it comes wit...

Hi, I would like to output a key value(Like hash key) for the input which i send. For the same values i would need to get the same key values all the time. For example For the value "xyz, bg road" if a key is returned something like 9389494949, then everytime when i give the input the same...

Hi, I have a job which reads a file and updates a table(oracle) based on the unique key of the table. The file has 100 million records. The job has been running for more than 30 hours now and the log still shows Progress 20 percent. When i checked for some of the rows in the file in the table, the r...

I dont think we have range lookup in 7.5.1?