Search found 38 matches
- Mon Aug 03, 2009 5:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataSet Advantages
- Replies: 6
- Views: 4945
I have to disagree with Con #2. Both databases and dataset files are equally susceptible to data corruption. DataSets are very fast when staying within the DataStage PX framework, much faster than database operations. Database tables allow random access and updates/deletions. Datasets do not. Thank...
- Mon Aug 03, 2009 4:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: DataSet Advantages
- Replies: 6
- Views: 4945
DataSet Advantages
Hi, Can someone advise me the advantages of dataset over storing information in database other than the ones listed below and also the disadvantages of the same? Pros 1) Paritition information will not be lost if the data is stored in dataset rather than database 2) Reduced I/O access Cons 1) Can be...
- Wed Jul 22, 2009 4:43 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error logging
- Replies: 9
- Views: 2354
That just looks like a Pivot to me, why not perform the pivot of using the maximum number of output columns and then trim null results post pivot? Thanks it worked. But the output from pivot is not coming as NULL, so filter is not working to remove the NULL value. I tried using trim function to che...
- Wed Jul 22, 2009 3:55 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error logging
- Replies: 9
- Views: 2354
That just looks like a Pivot to me, why not perform the pivot of using the maximum number of output columns and then trim null results post pivot? Thanks it worked. But the output from pivot is not coming as NULL, so filter is not working to remove the NULL value. I tried using trim function to che...
- Fri Jul 17, 2009 3:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error logging
- Replies: 9
- Views: 2354
You will have multiple output links from the tx, each representing one possible error. There are other methods to do this. But this will be simplest to design and implement - in my opinion. Thanks, this should work but the problem the job design will look very complicated as we have around 100+ att...
- Fri Jul 17, 2009 3:03 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error logging
- Replies: 9
- Views: 2354
- Thu Jul 16, 2009 10:16 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Error logging
- Replies: 9
- Views: 2354
Error logging
Hi, My requirement is to reject and load the records which fail the business rule. Currently my job design is seq stage->transformer 1->transformer 2->dataset1 and dataset2 Seq file to read the data from text, transformer 1 is to split the trailer and data record, transformer 2 is to validate the re...
- Fri Oct 24, 2008 4:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job Monitor and Oracle Enterprise stage
- Replies: 8
- Views: 3428