Search found 51 matches

by sri1dhar
Fri Oct 26, 2007 9:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: final delimiter for header record.
Replies: 3
Views: 2473

Re: final delimiter for header record.

Hi, I have a requirement to generate a | delimited file. The final delimter of the record also should be |. I specified the First line is column header to true. I set the record level final delimiter to |. I set the Field level delimiter to |. I am getting everything properly except the final delim...
by sri1dhar
Thu Oct 25, 2007 9:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running Jobs in parallel from Job Sequence - Job waiting
Replies: 2
Views: 2213

Re: Running Jobs in parallel from Job Sequence - Job waiting

Hi, I designed a job sequence (call it Mainseq1) to run two other job sequences (call them Subseq1, Subseq2) in parallel. MainSeq1: ------------ UserVarAct1--->Subseq1JobAct UserVarAct2--->Subseq2JobAct Although Mainseq1 is starting Subseq1, Subseq2 in parallel, actually Subseq2 is waiting for Subs...
by sri1dhar
Thu Oct 25, 2007 7:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: User status in parallel
Replies: 8
Views: 7627

Re: User status in parallel

Hi, I'm converting a server job into parallel. In server user status will be given like outputroutine(value) in one job, and that value will be ued in another job. i.e., I need a user value from the previous job. how should i get it in parallel job sequence . should i create a output routine There ...
by sri1dhar
Thu Oct 25, 2007 7:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Can any one look into this??
Replies: 2
Views: 1646

Refer to Page 2-27 of "Parallel Job Developer's Guide". DataStage is flexible about meta data. You can define part of your schema and specify that, if your job encounters extra columns that are not defined in the meta data when it actually runs, it will adopt these extra columns and propag...
by sri1dhar
Wed Oct 24, 2007 1:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Initializing Job parameter with current month and date
Replies: 3
Views: 4464

How is this job called, from a controlling prospective? The controlling job, whether it be a shell script or a job sequence, you can do this while passing the parameter to this job. In a shell you can use the commands like date and pass month mask for one and year mask for another. In a sequence jo...
by sri1dhar
Wed Oct 24, 2007 1:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Stage
Replies: 3
Views: 2217

Re: Lookup Stage

Hi All, Is there any point in keeping Lookup Failure to Continue if Lookup Condition has been set to Fail. The latter condition will always abort the job if the lookup fails.Please enlighten me. Thanks in advance. How can you set the Lookup Stage to Fail and Continue at the same time? So fail and c...
by sri1dhar
Wed Oct 24, 2007 10:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running Jobs in parallel from Job Sequence - Job waiting
Replies: 2
Views: 2213

Running Jobs in parallel from Job Sequence - Job waiting

Hi, I designed a job sequence (call it Mainseq1) to run two other job sequences (call them Subseq1, Subseq2) in parallel. MainSeq1: ------------ UserVarAct1--->Subseq1JobAct UserVarAct2--->Subseq2JobAct Although Mainseq1 is starting Subseq1, Subseq2 in parallel, actually Subseq2 is waiting for Subse...
by sri1dhar
Thu Feb 15, 2007 8:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Real-time file processing - Design question
Replies: 3
Views: 3225

Ernie, Kenneth, Thanks for the response. One thing I didn't make clear is that the record format of each of these files could be different which rules out the concatenation otpion. We already have 17 types of files and expecting to add more. Based on the file name, the job sequence determines which ...
by sri1dhar
Wed Feb 14, 2007 4:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Real-time file processing - Design question
Replies: 3
Views: 3225

Real-time file processing - Design question

Hi, We have a requirement where we need to process data files received from external vendors real-time as soon as they arrive. Till now we are batch loading these files at pre-scheduled times using AutoSys scheduling tool. Couple of options we are considering are: Option 1: ---------- Use Autosys fi...
by sri1dhar
Mon Feb 05, 2007 2:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rejecting records with invalid data type
Replies: 9
Views: 6496

I am the OP. Sorry for the delayed reply as I was away. My input is a sequential file. As "Vincent" mentioned I am importing the data as string type and implicitly converting in the Transformer. I had to do this for other reasons. Vincent you mentioned "you can import it as string fie...
by sri1dhar
Fri Feb 02, 2007 4:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rejecting records with invalid data type
Replies: 9
Views: 6496

[quote="I_Server_Whale"]You can use [i]Num, Alpha, AlNum,[/i]etc functions in your constraint.[/quote]

Thanks for the response. You mean check the data type of each column? What if I have 100 columns in the input link.
by sri1dhar
Fri Feb 02, 2007 4:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Rejecting records with invalid data type
Replies: 9
Views: 6496

Rejecting records with invalid data type

Hi, I am designing a parallel job. In parallel jobs typically if the incoming column data type is invalid (for example string data for a numeric type column) the job warns "Numeric string expected of the appropriate decimal precision for input column 'xxx'. Use default value" and substitue...
by sri1dhar
Mon Oct 23, 2006 1:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Float To Numeric (25,7)
Replies: 8
Views: 11369

Re: Float To Numeric (25,7)

I had similar issue with floats when using Sybase Enterprise stage. I tried several things that didn't help. Finally it worked when I used Basic Transormer and Sybase OC stage instead of PX Transformer, Sybase Enterprise stage with float defined as decimal in the column metadata. Eventually we ended...
by sri1dhar
Wed Sep 13, 2006 1:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Missing record delimiter "\n", saw EOF instead
Replies: 22
Views: 44781

is this a dos file that you are ftping over to the unix and then trying to load it? At the unix level, try the command dos2unix filename and then see if it fixes the file Thease are files ftped from a Unix server. The job worked with the same files before. We installed a patch for Oracle Enterprise...
by sri1dhar
Wed Sep 13, 2006 12:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Missing record delimiter "\n", saw EOF instead
Replies: 22
Views: 44781

After multiple tests this is what I noticed: The sequential file stage reads the first file successfully. From second file onwards the warning below repeats after every 830 rows. Please note that I am using "File Pattern" read method so I can load multipl files: Warning: SeqReutersPricingF...