Search found 38 matches

by senthil_tcs
Mon Aug 03, 2009 5:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet Advantages
Replies: 6
Views: 4945

I have to disagree with Con #2. Both databases and dataset files are equally susceptible to data corruption. DataSets are very fast when staying within the DataStage PX framework, much faster than database operations. Database tables allow random access and updates/deletions. Datasets do not. Thank...
by senthil_tcs
Mon Aug 03, 2009 4:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet Advantages
Replies: 6
Views: 4945

DataSet Advantages

Hi, Can someone advise me the advantages of dataset over storing information in database other than the ones listed below and also the disadvantages of the same? Pros 1) Paritition information will not be lost if the data is stored in dataset rather than database 2) Reduced I/O access Cons 1) Can be...
by senthil_tcs
Wed Jul 22, 2009 4:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error logging
Replies: 9
Views: 2354

That just looks like a Pivot to me, why not perform the pivot of using the maximum number of output columns and then trim null results post pivot? Thanks it worked. But the output from pivot is not coming as NULL, so filter is not working to remove the NULL value. I tried using trim function to che...
by senthil_tcs
Wed Jul 22, 2009 3:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error logging
Replies: 9
Views: 2354

That just looks like a Pivot to me, why not perform the pivot of using the maximum number of output columns and then trim null results post pivot? Thanks it worked. But the output from pivot is not coming as NULL, so filter is not working to remove the NULL value. I tried using trim function to che...
by senthil_tcs
Fri Jul 17, 2009 3:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error logging
Replies: 9
Views: 2354

You will have multiple output links from the tx, each representing one possible error. There are other methods to do this. But this will be simplest to design and implement - in my opinion. Thanks, this should work but the problem the job design will look very complicated as we have around 100+ att...
by senthil_tcs
Fri Jul 17, 2009 3:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error logging
Replies: 9
Views: 2354

send the reject rows from tx2 through to a funnel stage and its output to ds2 Thanks for your response. I am not clear how funnel will help us in this case. In the transformer for a single record we will have multiple error codes i.e. for emp_no 3 emp_name & emp_sal is null so using stage varia...
by senthil_tcs
Thu Jul 16, 2009 10:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error logging
Replies: 9
Views: 2354

Error logging

Hi, My requirement is to reject and load the records which fail the business rule. Currently my job design is seq stage->transformer 1->transformer 2->dataset1 and dataset2 Seq file to read the data from text, transformer 1 is to split the trailer and data record, transformer 2 is to validate the re...
by senthil_tcs
Fri Oct 24, 2008 4:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Monitor and Oracle Enterprise stage
Replies: 8
Views: 3428

Hi,

We are also experiencing the same issue, please let me know if you have found any solution/received any patch from IBM.