Search found 38 matches
- Tue Apr 26, 2011 11:25 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing Duplicates : unique situation
- Replies: 13
- Views: 10894
- Tue Apr 26, 2011 3:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Removing Duplicates : unique situation
- Replies: 13
- Views: 10894
Re: Removing Duplicates : unique situation
Hi ABC,
This you can do it with remove duplicates stage.
One link use retain first record and in the other link use retain last record. Now you will get the 2 and 5 records.
This you can do it with remove duplicates stage.
One link use retain first record and in the other link use retain last record. Now you will get the 2 and 5 records.
- Fri Mar 11, 2011 2:54 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove Duplicate Stage - Reject Link
- Replies: 7
- Views: 11383
The design will be like below. Seq File---->Sort------>Transformers-------SeqFile --------SeqFile One target file loads the records without duplicates and the other target sequential file is for only duplicates specifically. Key change column=True returns 0 for first record and returns 1 for second ...
- Thu Jan 20, 2011 1:47 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: SetNull() Function in stage variable
- Replies: 3
- Views: 4917
Re: SetNull() Function in stage variable
SetNull() function will not work in the stage variables so you have to assign 'NULL' the in the column derivation you have to convert it into setnull().
Note: If you use SetNull() in stage variable you will get the compilation errrors.
Note: If you use SetNull() in stage variable you will get the compilation errrors.
- Thu Apr 29, 2010 6:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Insert issue with large volume of data
- Replies: 2
- Views: 1722
Insert issue with large volume of data
Hi All, I have a Insert job which has to load more than 3,00,000 records but it's loading 2,20,000 records and then the job getting aborted and giving the error message like below. In Oracle Enterprise stage selected User defined update and specified insert statement. ORA_TEReport_Insert,0: Unable t...
- Thu Dec 10, 2009 4:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: option in multi-instance for reading dynamic number of files
- Replies: 10
- Views: 5958
Thanks for the suggestions given by all. The looping process is created and it's working fine also by invoking the files simaltaniously but I need seperate instances to be created to distinguish the files and datasets. it means I have to pass the id as the invocation id. We can pass the user variabl...
- Tue Nov 24, 2009 9:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to pass name & Date as invocation Id from file name
- Replies: 6
- Views: 3855
Hi Sainath, I know how to specify invocationId in sequence as well as script but how can take this mentioned invocation id from the file name. The file name consists of name and date. I am getting 100 source files and I have to pass these names as invocation id's. I hope you understand now. Are you ...
- Tue Nov 24, 2009 4:09 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to pass name & Date as invocation Id from file name
- Replies: 6
- Views: 3855
How to pass name & Date as invocation Id from file name
Hi All, I am getting files with file names consists of fund name and date. I have to pass this fundname and date as invocationId to the application. We are getting dynamic number of source files and the application needs to be executed with DSJobInvocationId. Eg:F*****-FundTest_Euro-20071115.csv Her...
- Tue Nov 24, 2009 3:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: option in multi-instance for reading dynamic number of files
- Replies: 10
- Views: 5958
Thanks for all your inputs. I will refer the designers guide to know about Looping process.
chulett wrote:The Designer's Guide pdf manual has a discussion of Sequence jobs including the use of the Start/End Loop and User Variables Activity stages. Read it. [url=viewtopic.ph ...
- Mon Nov 23, 2009 5:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: option in multi-instance for reading dynamic number of files
- Replies: 10
- Views: 5958
- Fri Nov 20, 2009 7:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: option in multi-instance for reading dynamic number of files
- Replies: 10
- Views: 5958
option in multi-instance for reading dynamic number of files
Hi All, We are getting dynamic number of source files in the source directory per each day. The number of files are not fixed but the file format is same. Say, suppose if we are getting 100 files per day those 100 files needs to be processed to the job with Multi- Instance job. In general we will pa...
- Mon Nov 16, 2009 4:46 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to convert Rows to columns
- Replies: 2
- Views: 2030
How to convert Rows to columns
Hi All,
Can anyone suggest how to convert rows to columns.
Eg:
Input:
Rate
10
20
30
40
50
60
Output I need:
Column1 column2 column3 column4 column5 column6
10 20 30 40 50 60
How can I achieve this?
Can anyone suggest how to convert rows to columns.
Eg:
Input:
Rate
10
20
30
40
50
60
Output I need:
Column1 column2 column3 column4 column5 column6
10 20 30 40 50 60
How can I achieve this?
- Thu Nov 12, 2009 3:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Job Key Issue
- Replies: 5
- Views: 7482
- Wed Nov 11, 2009 6:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Job Key Issue
- Replies: 5
- Views: 7482
Thanks Bhaskaran for your quick reply. I have specified int he Output columns now it's thrown another issue like below. XML_Input_1,0: Error: The prefix 'bdt' is not declared. expression = '/bdt:ExportRoot' Remaining tokens are: ('/') Can someone help me on this how to declare this? You need to spec...
- Wed Nov 11, 2009 4:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Job Key Issue
- Replies: 5
- Views: 7482
XML Job Key Issue
Hi, I am trying to read the XML file but getting the below issue. XML_Input_1,0: Error: No repetition element specified for link "DSLink4". Please make sure a column that contains the repetition path is set as key in the output link table definition. Please let me know what is repetetion p...