DataStage has problems with XML files larger than 200MBs.
A better solution is to write a simple program which will parse the file and create f.e. a comma delimited sequential file from the XML.
HTH
Search found 53 matches
- Sat May 19, 2007 7:30 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Large Xml Files
- Replies: 10
- Views: 5971
- Thu Jan 11, 2007 5:41 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Extract Alphanumeric characters and space only
- Replies: 4
- Views: 3902
Have You tried the Convert function - it should satisfy all Your requirements and You won't have to write a routine:
Code: Select all
Convert("((!@#$%^&*().", "", Link.TheSting)
- Thu Jan 11, 2007 1:11 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to append the column
- Replies: 8
- Views: 4382
- Fri Jan 05, 2007 9:25 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: launch the same job with different parameters
- Replies: 3
- Views: 2482
- Thu Jan 04, 2007 10:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Whats does this mean?
- Replies: 13
- Views: 4973
- Thu Jan 04, 2007 10:11 am
- Forum: General
- Topic: Where to download fix for a sequencer bug
- Replies: 7
- Views: 4686
- Thu Jan 04, 2007 9:55 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: converting varchar to timestamp in Oracle-ORA-01850 error
- Replies: 9
- Views: 8432
DATE datatype has nothing to do with the data format you get when you issue a SELECT statement - the format You see depends on your client settings. Oracle performs some datatype conversions automatically but it's better to do it explicity. If you have a varchar datatype in your OCI stage then you w...
- Thu Jan 04, 2007 8:54 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to capture duplicate reject row in the sequential file
- Replies: 8
- Views: 4505
- Thu Jan 04, 2007 5:50 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to capture duplicate reject row in the sequential file
- Replies: 8
- Views: 4505
- Thu Jan 04, 2007 5:46 am
- Forum: General
- Topic: dynamically passing tablename
- Replies: 8
- Views: 7100
Create a sequence - put 2 jobs inside and connect them. Job 1 - Sequential File --> Transformer --> Dummy HF. Inside the Transformer in the Derivation from the output link use SetJobUserStatus(link.PARAMETER) where link.PARAMETER is the column from the input. This will set the job's status to the ta...
- Thu Jan 04, 2007 4:24 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Scheduling a job with input file frequency unknown
- Replies: 3
- Views: 2564
- Thu Jan 04, 2007 3:51 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to capture duplicate reject row in the sequential file
- Replies: 8
- Views: 4505
- Thu Jan 04, 2007 3:00 am
- Forum: General
- Topic: dynamically passing tablename
- Replies: 8
- Views: 7100
- Thu Jan 04, 2007 12:49 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Running Multiple Instances-Partition By Date
- Replies: 7
- Views: 4523
- Wed Jan 03, 2007 1:09 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Running Multiple Instances-Partition By Date
- Replies: 7
- Views: 4523
Do You want to extract the data in parallel jobs ? IMHO it will be better to extract the data in one job, split it using Transformer and Constraints (f.e. link1 loadyear=2006, link2 loadyear=2005 etc.) and land the data into sequential files which will be transformed in parallel. When all needed tra...