Search found 38 matches

by VijayDS
Tue Apr 26, 2011 11:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removing Duplicates : unique situation
Replies: 13
Views: 10894

Very simple solution for this to get only 2 & 5 records. This you can do it with remove duplicates stage. In one link use remove duplicates stage to retain first record and use remove duplicates stage in the second link to retain last record option and funnel athe data from both the links. Now y...
by VijayDS
Tue Apr 26, 2011 3:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Removing Duplicates : unique situation
Replies: 13
Views: 10894

Re: Removing Duplicates : unique situation

Hi ABC,

This you can do it with remove duplicates stage.
One link use retain first record and in the other link use retain last record. Now you will get the 2 and 5 records.
by VijayDS
Fri Mar 11, 2011 2:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicate Stage - Reject Link
Replies: 7
Views: 11383

The design will be like below. Seq File---->Sort------>Transformers-------SeqFile --------SeqFile One target file loads the records without duplicates and the other target sequential file is for only duplicates specifically. Key change column=True returns 0 for first record and returns 1 for second ...
by VijayDS
Thu Jan 20, 2011 1:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SetNull() Function in stage variable
Replies: 3
Views: 4917

Re: SetNull() Function in stage variable

SetNull() function will not work in the stage variables so you have to assign 'NULL' the in the column derivation you have to convert it into setnull().

Note: If you use SetNull() in stage variable you will get the compilation errrors.
by VijayDS
Thu Apr 29, 2010 6:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Insert issue with large volume of data
Replies: 2
Views: 1722

Insert issue with large volume of data

Hi All, I have a Insert job which has to load more than 3,00,000 records but it's loading 2,20,000 records and then the job getting aborted and giving the error message like below. In Oracle Enterprise stage selected User defined update and specified insert statement. ORA_TEReport_Insert,0: Unable t...
by VijayDS
Thu Dec 10, 2009 4:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: option in multi-instance for reading dynamic number of files
Replies: 10
Views: 5958

Thanks for the suggestions given by all. The looping process is created and it's working fine also by invoking the files simaltaniously but I need seperate instances to be created to distinguish the files and datasets. it means I have to pass the id as the invocation id. We can pass the user variabl...
by VijayDS
Tue Nov 24, 2009 9:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to pass name & Date as invocation Id from file name
Replies: 6
Views: 3855

Hi Sainath, I know how to specify invocationId in sequence as well as script but how can take this mentioned invocation id from the file name. The file name consists of name and date. I am getting 100 source files and I have to pass these names as invocation id's. I hope you understand now. Are you ...
by VijayDS
Tue Nov 24, 2009 4:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to pass name & Date as invocation Id from file name
Replies: 6
Views: 3855

How to pass name & Date as invocation Id from file name

Hi All, I am getting files with file names consists of fund name and date. I have to pass this fundname and date as invocationId to the application. We are getting dynamic number of source files and the application needs to be executed with DSJobInvocationId. Eg:F*****-FundTest_Euro-20071115.csv Her...
by VijayDS
Tue Nov 24, 2009 3:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: option in multi-instance for reading dynamic number of files
Replies: 10
Views: 5958

Thanks for all your inputs. I will refer the designers guide to know about Looping process.
chulett wrote:The Designer's Guide pdf manual has a discussion of Sequence jobs including the use of the Start/End Loop and User Variables Activity stages. Read it. [url=viewtopic.ph ...
by VijayDS
Mon Nov 23, 2009 5:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: option in multi-instance for reading dynamic number of files
Replies: 10
Views: 5958

Hi Ray, Chulett and Sainath, Thanks for all your suggestions. As I said I am getting dynamic number of files as source so I have to pass the Name & Date as parameters and and same as Invocation Id(by concatinating Name & Date)for the multi instance job. Eg: Source File Name is:F*****-Name-Da...
by VijayDS
Fri Nov 20, 2009 7:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: option in multi-instance for reading dynamic number of files
Replies: 10
Views: 5958

option in multi-instance for reading dynamic number of files

Hi All, We are getting dynamic number of source files in the source directory per each day. The number of files are not fixed but the file format is same. Say, suppose if we are getting 100 files per day those 100 files needs to be processed to the job with Multi- Instance job. In general we will pa...
by VijayDS
Mon Nov 16, 2009 4:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to convert Rows to columns
Replies: 2
Views: 2030

How to convert Rows to columns

Hi All,

Can anyone suggest how to convert rows to columns.


Eg:

Input:
Rate
10
20
30
40
50
60

Output I need:

Column1 column2 column3 column4 column5 column6
10 20 30 40 50 60



How can I achieve this?
by VijayDS
Thu Nov 12, 2009 3:30 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Job Key Issue
Replies: 5
Views: 7482

Thanks for all. It's worked fine after loading namespace declaration in the stage properties and also in the Output properties also. that is a namespace prefix. How did you import your metadata...if you imported via the xml metadata importer, and you "loaded" your column names from the &qu...
by VijayDS
Wed Nov 11, 2009 6:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Job Key Issue
Replies: 5
Views: 7482

Thanks Bhaskaran for your quick reply. I have specified int he Output columns now it's thrown another issue like below. XML_Input_1,0: Error: The prefix 'bdt' is not declared. expression = '/bdt:ExportRoot' Remaining tokens are: ('/') Can someone help me on this how to declare this? You need to spec...
by VijayDS
Wed Nov 11, 2009 4:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: XML Job Key Issue
Replies: 5
Views: 7482

XML Job Key Issue

Hi, I am trying to read the XML file but getting the below issue. XML_Input_1,0: Error: No repetition element specified for link "DSLink4". Please make sure a column that contains the repetition path is set as key in the output link table definition. Please let me know what is repetetion p...