Hi,
Good thing about using parallel job is Performance!! even with sequential mode.
I have tested a job with the above routinue and it really gives good performance.
Source : Oracle
Volume : 150,000 records
Time Taken : 2 min
Search found 22 matches
- Tue Apr 17, 2012 11:56 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Creating number of Files
- Replies: 13
- Views: 15585
- Tue Apr 17, 2012 8:23 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Creating number of Files
- Replies: 13
- Views: 15585
- Mon Apr 16, 2012 12:38 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Creating number of Files
- Replies: 13
- Views: 15585
Routine for creating dynamic files
Hi, I have created a C++ routinue for creating dynamic flat files, Insert each record into the file. logic: Chk for the file name; If exists then append the row Else create new file. This routine works only ehn the transformer is set to sequential process. attachString -- > set of delimited column v...
- Thu Mar 15, 2012 8:09 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Batch process using Oracle connector
- Replies: 2
- Views: 1582
Batch process using Oracle connector
Hi, Currently we are trying to fetch 10 million records from oracle (it may grow) and to creating a flat file. In between, and need to get the description from the master using lookup. The jobs is running fine without any problem. But the problem is, the scratch disk is getting full (20 gb) for just...
- Tue Oct 18, 2011 8:26 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: header and trailer validation
- Replies: 10
- Views: 5560
Seq File --> Xfm1 --> Sort1 stg --> xfm2 --> output Xfm1 --> using stage variable count all the records and pass it to new column ( Count1) Sort1 stg --> Sort all the records based on Count1 column in decending order xfm2 --> put constraint to pass only first and last record ( constraint ==> INROWNU...
- Tue May 17, 2011 9:26 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Parsing & validation against the schema .XSD
- Replies: 4
- Views: 6026
- Tue May 17, 2011 2:42 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: XML Parsing & validation against the schema .XSD
- Replies: 4
- Views: 6026
XML Parsing & validation against the schema .XSD
Hi All, My requriment is to validate the XML based on the XSD schema. Is it possible to impelement in our datastage job. Sample XSD schema below; The reference element "Activity" is a user defined element "ActivityDataType" and it has list of restricted values as highlighed below...
- Tue Oct 06, 2009 3:27 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: All Oracle versions compatible with Data stage 7.1
- Replies: 2
- Views: 2490
Re: All Oracle versions compatible with Data stage 7.1
Hello, We will have to migrate from DB2 to Oracle.The current data stage version is 7.1.Could you please let me know which version(s) of oracle is compatible with DS 7.1?are 10g and 11g compatible with DS 7.1? Thanks in advance Datstage 7.1 can support any version of oracle, if the plugin for that ...
- Tue May 12, 2009 7:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: concatenating the target file with the system date
- Replies: 4
- Views: 2813
- Fri May 01, 2009 8:21 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Add minutes to a date/timestamp
- Replies: 3
- Views: 2881
Hi, Create 2 stage variable for contactinating date and time rather than writing routine. In this below rule the time can have more than 2 digit as Hour (ex: 150:00:60). Lets us assume the input variable as below vDate = Date format vTime = time format **svDays stage variable calculates the no of da...
- Thu Apr 30, 2009 7:30 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Scheduling In Server Edition
- Replies: 7
- Views: 3590
- Thu Apr 30, 2009 7:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to restore the datastage projects
- Replies: 7
- Views: 2945
- Mon Apr 06, 2009 8:35 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicated entries although using RemoveDuplicates stage
- Replies: 10
- Views: 5413
Sort the row before removing duplicates
Hi,
When ever you use "Remove Duplicate" stage, the incoming data should be sorted. As per your design, i don't think your imcoming are not properly sorted. Please try to sort the row before the "Remove Duplicate" stage.
When ever you use "Remove Duplicate" stage, the incoming data should be sorted. As per your design, i don't think your imcoming are not properly sorted. Please try to sort the row before the "Remove Duplicate" stage.
- Tue Mar 31, 2009 7:40 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Help to identify the datastage process in the Task Manager
- Replies: 4
- Views: 2594
Sorry Man
Hi Ray,
I am really sorry. I really didn't mean to say that.
I am really sorry. I really didn't mean to say that.
- Thu Mar 26, 2009 8:37 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job Performance
- Replies: 9
- Views: 5144
Increase the array size in OCI Oracle stage
Hi,
Try to increase array size in hte OCI stage to 10,000. This will help to increase the performance.
Try to increase array size in hte OCI stage to 10,000. This will help to increase the performance.