Search found 177 matches

by kamalshil
Wed Jun 30, 2010 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort and partition in Merge Stage
Replies: 4
Views: 1876

Yes I have kept the 4 Key sequence same on both the input links. All or sorted and partitioned in same sequence. And in merge stage also i have given them as the same sequence. I have also used APT_PRINT_SCHEMA to check any mismatch but there is no mismatch in metadata. Whats the reason i am not get...
by kamalshil
Wed Jun 30, 2010 3:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort and partition in Merge Stage
Replies: 4
Views: 1876

And on Single node job is running fine.
Am running my job on 4 nodes
by kamalshil
Wed Jun 30, 2010 3:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sort and partition in Merge Stage
Replies: 4
Views: 1876

Sort and partition in Merge Stage

Hi, I am using the merge stage and i am getting wrong results with each runs. My job design is: 2 oracle source and Merge stage where i am taking the rejected records to load an oracle table. My issue is when i do partition and sort on both the input link on 4 keys i am not getting the results as th...
by kamalshil
Tue Jun 29, 2010 8:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to calculate total number of input columns and rejects
Replies: 9
Views: 4221

You would use a Server job and write a BASIC routine to leverage them. ... I have never developed a server job. So i have one question in mind. Can i call the sever job in sequence where i am executing my parallel jobs. It wont be a problem and to run server job to i need to do any project level se...
by kamalshil
Tue Jun 29, 2010 7:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to calculate total number of input columns and rejects
Replies: 9
Views: 4221

chulett wrote:Either way, those same functions that exist as part of the BASIC API are part of the dsjob executable from the command line. ...
And how to implement in Job.
I checked transformer stage but was not able to find this functions
by kamalshil
Tue Jun 29, 2010 7:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to calculate total number of input columns and rejects
Replies: 9
Views: 4221

ArndW wrote:I would use the builtin functions to do this after the job completes. Using calls to DSAttachJob() to get a job handle, then DSGetLinkInfo() to get the number of rows processed through a named link, t ...
Yes
But we have to do this in job or we have to write a script for this to be done?
by kamalshil
Tue Jun 29, 2010 7:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to calculate total number of input columns and rejects
Replies: 9
Views: 4221

How to calculate total number of input columns and rejects

Hi All, I have a requirement where I need to Log in table Total number of input and total number of rows inserted/Updated and Total Number of reject. For now i have designed the job by using two aggregate stage one for counting total number of input and rejects and then join them back to get total n...
by kamalshil
Tue Jun 22, 2010 2:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

Yes ofcourse It will be done use upsert method in oracle and use parameterized sql. Update #table_name# #sql# pass complete query like set col1=orchestrate.col1, col2=orchestrate.col2 ...where col5=orchestrate.col5 in #sql# This will make me write the query for all the tables I have to implement th...
by kamalshil
Tue Jun 22, 2010 1:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

Basically if columns present in source and oracle are same then dont need to mention any schema file any where while loading.Enable RCP.It will take care otherwise use column export after sequential file stage to convert into string and column import before oracle stage to convert it into desired s...
by kamalshil
Tue Jun 22, 2010 1:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

In target also use same type of schema file but you have to change format which is first line in schema files and column names according to target database table, dont need to mention any key here also and we loaded using load method not a upsert option.Try with load option there is nothing wrong u...
by kamalshil
Tue Jun 22, 2010 1:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

Yes reading from source we don't require key.
what about target?

I need to write into oracle table with upsert mode.

how to do it through upsert should be implemented,
by kamalshil
Tue Jun 22, 2010 12:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

How can i comment it.
Because if i am not importing the meta-data form where it will pick up the internal format.

How can i specify the comments in schema file?
Because i need to do upserts?
by kamalshil
Mon Jun 21, 2010 10:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

I also tried printing the schema for each operator using $OSH_PRINT_SCHEMAS

But was not able to find any difference how key is specified.
by kamalshil
Mon Jun 21, 2010 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to specify the key in schema file
Replies: 15
Views: 9000

How to specify the key in schema file

Hi, I am reading from the sequential file and need to load into oracle table doing an upsert mode. So how can i specify the key columns. I check forum searched and found the method in below link to specify the key http://www.dsxchange.com/viewtopic.php?t=133949&highlight=schema+file But i am get...
by kamalshil
Mon Jun 21, 2010 6:29 am
Forum: General
Topic: How to enable RCP at job level
Replies: 6
Views: 6351

but how to specify the schema file for oracle stage as input ?
Is it possible?
I have RCP check box at output column property page.
But no schema specification property.