DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 200 matches
Author Message
 Topic: Range Lookup question
dnat

Replies: 2
Views: 414

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Apr 06, 2018 1:28 pm   Subject: Range Lookup question
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I have data like this.

key, start, end
1,1,100
1,80,140
2,200,300
4,250,300

Here I am looking to reject/capture the first two records where there is an overlap. i.e for the same key, ...
 Topic: double quotes in data
dnat

Replies: 3
Views: 366

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Mar 12, 2018 12:06 pm   Subject: double quotes in data
But, when I have comma in a field, then I get them in quoted fields

xxx,yyy,"last,first", "yyyy""",jjj

Here the 3rd field is "last,first". If I have the quote as none, then it is considering th ...
 Topic: double quotes in data
dnat

Replies: 3
Views: 366

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Mar 12, 2018 11:37 am   Subject: double quotes in data
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I have double quotes in data and ds is not recognizing the field

Data looks like this

xxx,yyy,"last,first", "yyyy""",jjj

This is a .csv file and I have given the quote character as dou ...
 Topic: Record by record comparison
dnat

Replies: 1
Views: 284

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Mar 12, 2018 10:28 am   Subject: Record by record comparison
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi

I have some data like this

KeyID, Data1,Data2
1,test1,test2
1,mmm,nnn
2,ttt,bbb
2,444,888
1,vvv,bbb
1,sss,fff

And I want the data like this

KeyID,Data1,Data2,Data3,Data4
1,test1, ...
Resolved
 Topic: Delete then insert option
dnat

Replies: 5
Views: 660

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Jan 30, 2018 12:32 pm   Subject: Delete then insert option
Thanks Rick and Craig!!..And looks like the array size is the one responsible for the job working good when record count is low. Since array count was set to 2000, it didnt cause any problem when it p ...
Resolved
 Topic: Delete then insert option
dnat

Replies: 5
Views: 660

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jan 29, 2018 6:10 pm   Subject: Delete then insert option
My data is like this

ID value
1 abcd
1 defg
1 rtrt
1 6767
1 7887

As such there is no key in the table. I am specifiying the ID column as the key column in datastage for dele ...
Resolved
 Topic: Delete then insert option
dnat

Replies: 5
Views: 660

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jan 24, 2018 11:19 am   Subject: Delete then insert option
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I am using "Delete then insert" option to load data in target Oracle table. Source is a .csv file. Every file is identified with an id and data needs to be replaced if we get the same file agai ...
 Topic: insert/update with no key
dnat

Replies: 4
Views: 806

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Nov 21, 2017 12:20 pm   Subject: insert/update with no key
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I have to load a oracle table from a file. There are no keys in the table. In this situation what would be the best approach to load the table with restartability in place..If the job aborts in ...
Resolved
 Topic: Date format issues
dnat

Replies: 2
Views: 466

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 13, 2017 12:13 pm   Subject: Date format issues
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I have a date in the file as 10/11/17 and i am trying to load it into the table.

When i use this function StringToDate(Trim(DSLink2.File_Date),'%(d,s)/%(m,s)/%yy'),

I tried to output in a ...
Resolved
 Topic: Problem in reading .csv file
dnat

Replies: 5
Views: 792

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Nov 13, 2017 12:05 pm   Subject: Problem in reading .csv file
Thanks for all your inputs. I added the "Record delimiter string" to DOS format and was able to read the file as it was.
Resolved
 Topic: Problem in reading .csv file
dnat

Replies: 5
Views: 792

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 09, 2017 5:28 pm   Subject: Problem in reading .csv file
Yes, they are all defined as Strings. And i will be converting those fields as required inside the job.

But now the problem is with reading the file itself. While i view data in sequential file sta ...
Resolved
 Topic: Problem in reading .csv file
dnat

Replies: 5
Views: 792

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 09, 2017 4:25 pm   Subject: Problem in reading .csv file
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi,

I have a .csv format file and it comes in the following way
...
 Topic: Hash value in output
dnat

Replies: 1
Views: 665

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Aug 13, 2012 5:06 am   Subject: Hash value in output
DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Hi,

I would like to output a key value(Like hash key) for the input which i send. For the same values i would need to get the same key values all the time.

For example

For the value "xyz, bg ...
 Topic: update very slow
dnat

Replies: 4
Views: 1842

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Jun 23, 2011 12:20 am   Subject: update very slow
DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Hi,

I have a job which reads a file and updates a table(oracle) based on the unique key of the table.
The file has 100 million records.
The job has been running for more than 30 hours now and th ...
 Topic: sparse lookup-join
dnat

Replies: 4
Views: 2066

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Jun 20, 2011 12:32 am   Subject: sparse lookup-join
I dont think we have range lookup in 7.5.1?
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours