Search found 94 matches

by DSDexter
Wed Sep 15, 2010 3:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Compliation Error in lookup
Replies: 6
Views: 5390

Compliation Error in lookup

Hi Gurus, I am getting the following error when i am looking up data from a oracle table. Output from transformer compilation follows: ##I TFCN 000001 05:50:42(000) <main_program> Ascential DataStage(tm) Enterprise Edition 7.5.2 Copyright (c) 2004, 1997-2004 Ascential Software Corporation. All Right...
by DSDexter
Fri Aug 20, 2010 6:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Invalid Filenames using File Name Column property
Replies: 3
Views: 2083

Re: Invalid Filenames using File Name Column property

Any help would realyy be appreicated.

Never seen this issue in v8.
by DSDexter
Fri Aug 20, 2010 3:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Invalid Filenames using File Name Column property
Replies: 3
Views: 2083

Invalid Filenames using File Name Column property

Hi Gurus, I am reading multiple files using the file pattern property in a sequential file stage. I am fetching the filenames using the File Name column property. I am also setting the Environment variable $APT_IMPORT_PATTERN_USES_FILESET=TRUE. I am able to fetch the filenames for each record read. ...
by DSDexter
Wed Jan 13, 2010 12:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue in Handling Special Character Data in Enterprise Stage
Replies: 1
Views: 3473

Aqulis,

So your job is loading Data fine with DRS stage and not with Oracle stage, Is that correct?

Try keeping the target datatype as unbounded varchar and try with Unicode set and unset as well.

Also is the target written in LOAD mode or Upsert?
by DSDexter
Thu Sep 24, 2009 1:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Commit interval in oracle enterprise stage
Replies: 25
Views: 9485

Chulet, It's only for Oracle Enetrprise stage since enetrprise stage don't have any Transaction level settings, either it will take 5000 or 5 Sec as the default Commit interval for commit. Then what about 'DRS Stage',which has got Transaction level & array size settings as well. If we are using ...
by DSDexter
Fri Sep 04, 2009 2:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Validating XML against dynamic xsd
Replies: 2
Views: 1798

Re: Validating XML against dynamic xsd

Just to add...

When the Child records are missing in the XML file....The associated tags are also missing. But whereas my xsd will have these tags defined.
by DSDexter
Fri Sep 04, 2009 2:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Validating XML against dynamic xsd
Replies: 2
Views: 1798

Validating XML against dynamic xsd

Hello, I have a XML file as one of the source to my job. I am validating the XML against a xsd file. In the xml file i have child-subchild on so on upto 4 levels. Any given day I may or may not receive all the subchilds. Even the tags for these sub-childs will not be present in the xml file. In that...
by DSDexter
Thu Jul 16, 2009 12:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: score file error
Replies: 3
Views: 6401

Re: score file error

Hi All, Please let me know what is this error? "node_node2: broadcastStepIR: score file write for 4096 bytes to file /tmp/APTps901232091bcdf0 on node node2 returned -1; errno = 28 (file system full) Consider setting TMPDIR or APT_PM_SCORE_DIR to a directory with more space. " main_program...
by DSDexter
Tue Jul 14, 2009 12:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Control M characters in Sequential File
Replies: 9
Views: 8869

Re: Control M characters in Sequential File

There are various ways of removing the ^M characters. Simplest one is to use the dos2unix utility. This will work...Just in case if it doesnt, use the tr utility of unix. Use the following command to remove the ^M characters. You can use this commands in a before job routine and strip the unwanted c...
by DSDexter
Wed Jun 10, 2009 4:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading Multiple Files from a source Directory
Replies: 6
Views: 3208

The variable $APT_IMPORT_PATTERN_USES_FILESET_MOUNTED is not supported in version I am using. I tried a workaound and its working. In the sequential file stage, I used Read Method = Specific Files and used 15 different File properties. Each property specifiying name of one of 15 files. Also the opt...
by DSDexter
Mon Apr 20, 2009 4:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Limiting rows in parallel job
Replies: 5
Views: 2964

Re: Limiting rows in parllel job

Please re-check. The row limit tab is present for PX jobs also.
by DSDexter
Thu Mar 19, 2009 3:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job failure due to space
Replies: 9
Views: 3317

What is your source? what is the type of partitioning you are doing in the job?

What is the OS flavaour?
by DSDexter
Wed Nov 05, 2008 1:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Tuning a Ds job involving Oracle stages
Replies: 5
Views: 2362

Please give us more information about the queries. Are you trying to create a Cross-Product looking at the queries that you posted that will surely fetch a lot of data, Since it will be a cartesian product. Give us clear requirements than we can help you.
by DSDexter
Sun Oct 05, 2008 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need performace improvement - Help plz
Replies: 10
Views: 5735

Without the 4 MOD() functions the CPU utilization is still close to 90% for the entire time the job runs. Andrw, when I monitor the statistics for transformer, The %CPU usage is very high (168). I think the transformer is too loaded so I added another transformer which carried few data validations. ...
by DSDexter
Sat Oct 04, 2008 11:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need performace improvement - Help plz
Replies: 10
Views: 5735

Andrw, As you suspected the the cpu utilization is more than 90% most of the time. I am pasting the scrren shot of vmstat procs memory page disk faults cpu r b w swap free re mf pi po fr de sr s0 s1 s1 s3 in sy cs us sy id 1 0 0 49556856 3932552 205 857 543 116 117 0 1 0 18 18 0 5660 7855 2598 25 14...