Search found 511 matches

by clarcombe
Fri Dec 09, 2016 4:44 am
Forum: General
Topic: Automatic exporting of the environment variables
Replies: 1
Views: 1534

Automatic exporting of the environment variables

As part of our delivery process, we need to compare our development environment with our acceptance environment when we perform a delivery We need to check 1) changed jobs 2) changed files (i.e. .sql files, .sch files, .cfg files) 3) changed environment variables in administrator (.env files) Whilst...
by clarcombe
Mon Nov 28, 2016 4:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bulk load in db2
Replies: 6
Views: 5851

We had this error and it took me a week to discover the solution.

ftp was not installed. Check your ftp configuration before continuing to search
by clarcombe
Wed Sep 28, 2016 10:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Modify:conversion of Integer to LongVarBinary
Replies: 0
Views: 1470

Modify:conversion of Integer to LongVarBinary

I am using a shared container which requires a longvarbinary as a parameter. The underlying value is an int64 or int32 How can I convert this to longvarbinary as there seems to be now raw_from_decimal or int32. Do I have to go via a string first ie. raw_from_string (string,raw) My job is generic so ...
by clarcombe
Fri Sep 16, 2016 12:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Job : Join Key failure
Replies: 5
Views: 2445

The transformer cannot be used as the field names are passed in as parameters.

As soon as you use meta data as parameters, the transformer is useless.
by clarcombe
Thu Sep 15, 2016 9:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Job : Join Key failure
Replies: 5
Views: 2445

I discovered that I couldn't put a parameter list in Column Export In the Column to Export field I put #PM_FIELD_LIST#. Apparently you can't put more than one field. I thought I had used this elsewhere in another company, but clearly not!! What I have done now is exported the join columns to a Peek ...
by clarcombe
Thu Sep 15, 2016 2:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generic Job : Join Key failure
Replies: 5
Views: 2445

Generic Job : Join Key failure

I have created a job below https://s11.postimg.org/4p0r2qtz7/image.png Whats the functionality This job is a generic job which joins via a key (KEY1) which is a varchar unicode (no length specified) KEY1 is a column export of X number of keys passed in as parameters. e.g. the parameter #KEY_LIST# is...
by clarcombe
Wed Aug 03, 2016 8:18 am
Forum: General
Topic: Fallen Premium Poster: Kim Duke
Replies: 32
Views: 27139

Kim was always very generous in his assistance. I have used his wisdom and code frequently.

He has gone to the great missing function in the sky. Lets hope he can use Datastage to help process all the new souls arriving in heaven!
by clarcombe
Tue Jun 28, 2016 12:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Restrict rows processed in a job
Replies: 6
Views: 3860

Hi Ray,

I was unaware of the Compile in Trace option. This is exactly what I was after. I don't want to have to modify the jobs to limit the number of rows and Compile in Trace works perfectly

Thanks
by clarcombe
Mon Jun 27, 2016 10:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Restrict rows processed in a job
Replies: 6
Views: 3860

I am running data out from a dataset and I want to be able to limit the number of rows at runtime. Bar adding a filter stage (which defeats the object) , I wanted something that restricted the read of the dataset initially.
by clarcombe
Mon Jun 27, 2016 8:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Restrict rows processed in a job
Replies: 6
Views: 3860

Restrict rows processed in a job

One of the biggest bugbears with Datastage PX is that you cannot limit the number of rows running through the job. This is a basic function in Server jobs.

Has anyone got a (simple) solution to limit rows when running jobs ?

Thanks
by clarcombe
Tue Jun 14, 2016 7:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical stage - 0 lines processed
Replies: 2
Views: 2886

I looked at the XSD and compared it manually to the XML. There were quite a few extra tags in the XML. I therefore have to assume that it couldn't map the XML to the XSD. Of course, it would have been better if the HS had told me about the missing elements. Are there any plans to extend the debuggin...
by clarcombe
Mon Jun 13, 2016 8:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical stage - 0 lines processed
Replies: 2
Views: 2886

Hierarchical stage - 0 lines processed

I have created a small XML parser job. 1) Read in (valid) xml file 2) Validated against XSD file 3) Auto Mapped Until this point all went well. But then a zero line file was created with no further explanation Questions 1)Is there any way to get debug information ? I have tried in vain to get the de...
by clarcombe
Wed May 11, 2016 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical stage - cannot create 3rd level
Replies: 1
Views: 2078

I created another dummy file to create another level. The xsd file needed a 4th level not a 3rd level. So level 1 file hjoin to level 2 file, level 2 hjoin dummy level 3 file and level 3 file hjoin to final level. This allows me to create the level I need in the xsd file. Might not be the best way b...
by clarcombe
Tue May 10, 2016 9:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hierarchical stage - cannot create 3rd level
Replies: 1
Views: 2078

Hierarchical stage - cannot create 3rd level

Using the hierarchical stage, I am trying to create xml based on this xsd <?xml version="1.0" encoding="ISO-8859-1"?> <!-- edited with XMLSpy v2008 rel. 2 (http://www.altova.com) by mazuki (darksiderg) --> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" elementFo...
by clarcombe
Tue Mar 29, 2016 2:07 am
Forum: General
Topic: Sequencer 'SQY' was entered, but never exited
Replies: 11
Views: 6050

All sorted. Created a large loop with exits on file existence and no more data available.

Thanks Craig for opening me up!