Search found 520 matches

by mhester
Wed Nov 03, 2010 3:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataSet rejecting null records
Replies: 7
Views: 7404

First, rerun the job with APT_DISABLE_COMBINATION set to True and then let us know the exact operator/stage producing the error.
by mhester
Wed Nov 03, 2010 3:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 load error
Replies: 2
Views: 1942

What stage are you receiving this error from? Cannot remember what was available at 7.x, but I think DB2 partitioning was not available as a partitioning method unless it was the DB2 EE stage.
by mhester
Wed Nov 03, 2010 1:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: This is about CDC stage
Replies: 3
Views: 3338

Change your "same" partitioning to partition by the key you are using. Also, change the setting for "Log Statistics" to True so you can see in the director what the stage sees as inserts or edits. Could be that the files are truly not the same. From Unix do an md5sum on both just...
by mhester
Wed Nov 03, 2010 1:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How would you "over-partition" your data?
Replies: 7
Views: 3190

It is not uncommon to have more nodes defined than CPU's.
by mhester
Wed Nov 03, 2010 11:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Create Unicode file for SAP Bapi RFM
Replies: 6
Views: 5990

BOM or Byte Order Mark will be added by default when using Notepad and writing UTF-8. No such behavior is present with Unix since files in Unix can be multi purpose and the BOM may interfere with processing correctness. The BOM is usually at the beginning of the stream to let the receiving appliatio...
by mhester
Wed Nov 03, 2010 9:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataBase loading
Replies: 20
Views: 6707

You are welcome

A copy with no output is not writing anything
by mhester
Wed Nov 03, 2010 9:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataBase loading
Replies: 20
Views: 6707

Correct - have no output out of the copy and you will have no issues.
by mhester
Wed Nov 03, 2010 6:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DataBase loading
Replies: 20
Views: 6707

Lookup requires a stream output, but does not require a reject link. If you only have a reject link and no stream output the compiler will complain. Send the lookup success rows to a copy with no output or a seq file stage and write to /dev/null or some such thing.
by mhester
Tue Nov 02, 2010 3:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: job status information for multi instance Jobs
Replies: 2
Views: 2603

I am not a huge fan of folks going after the UV repository in such a manner, but you can retrieve a list of invoation id's and that is what you want.
by mhester
Wed Oct 27, 2010 2:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pad leading zeroes to a smallint field
Replies: 9
Views: 5642

I might suggest that whomever set the resolution status of this thread to "WORKAROUND" change it to "RESOLVED" since workaraound implies that there is a problem with small int and integers in that they cannot be zero padded. Converting it to a character and padding that STRING wi...
by mhester
Wed Oct 27, 2010 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector - enable partitioning
Replies: 3
Views: 2955

thanks where in the sql do we put this? NODENUMBER(partition_key)=CURRENT NODE Also want to mention we have a dpf environment, didn't know if that makes a difference. SELECT COL1, COL2 FROM TABLE WHERE NODENUMBER(COL1)=CURRENT_NODE Choose Uncommitted Read in the stage and yes this is syntax specifi...
by mhester
Tue Oct 26, 2010 3:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DB2 Connector - enable partitioning
Replies: 3
Views: 2955

in your sql statement (if user defined) do you have the NODENUMBER(partition_key)=CURRENT NODE dbpartitionnum will work too The stage is running parallel in the sense of ETL - one db2 connector pid for each node in the configuration. The sql statement gets handed off to an instane on the dpf server ...
by mhester
Tue Oct 26, 2010 2:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Protected Project
Replies: 14
Views: 5111

That is in a header so I would think you might wrap it with a C/C++ program? but then you would have to understand the API and create an object reference and a bunch of other things - is there some reason you need to know this outside of looking in the administrator client?
by mhester
Tue Oct 26, 2010 2:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: VarChar Memory Usage
Replies: 14
Views: 9327

Hi folks, looks like everyone is getting on board with the unbounded varchar idea for reducing memory and disk consumption. Thanks, Doug I would not go so far as to say this. That is certainly not IBM's take on character string handling. The framework of DataStage moves fixed width data regardless ...
by mhester
Mon Oct 25, 2010 1:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pad leading zeroes to a smallint field
Replies: 9
Views: 5642

If nothing else this thread is good for a laugh :shock: