Search found 1015 matches

by Mike
Fri Aug 19, 2016 7:43 am
Forum: General
Topic: Re-order metadata in column definition
Replies: 6
Views: 3454

Workaround: You can reorder the input columns of a transformer stage. 1) Add a temporary transformer stage. 2) Move the output link of your sequential file to the transformer. 3) Use the transformer to reorder its input columns. 4) Move the link back to its original position. 5) Delete the temporary...
by Mike
Fri Aug 19, 2016 7:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove DataSets
Replies: 17
Views: 9751

If they do not have a dataset descriptor file, then one of your inexperienced developers probably deleted the descriptor file improperly with a rm command. You can do the same for the orphaned dataset segment files. It sounds like you've done your due diligence in attempting to find the descriptor f...
by Mike
Fri Aug 19, 2016 7:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension stage update issue
Replies: 3
Views: 3750

I've had no problems with ODBC Connector/Sql Server/SCD stage in version 11.3. Have you used the SCD stage before? I think the first thing to check would be to make sure you don't have the output links backwards. That would probably cause the issue you're seeing. Then carefully review the purpose co...
by Mike
Tue Aug 16, 2016 7:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage and Reference Data Manager (RDM)
Replies: 4
Views: 3656

My current client has created database views that we use to read RDM data using a database connector stage in our DataStage jobs.

As far as maintaining RDM data, that is all done within the RDM tooling.

Mike
by Mike
Mon Aug 15, 2016 8:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove DataSets
Replies: 17
Views: 9751

It looks like you've assumed that the dataset descriptor file is in the same location as the dataset segment files. That could be a bad assumption.

Code: Select all

find / -name "ABC_FailedData.ds" -print 2>/dev/null
Find the location of the descriptor file (ending in dot ds).

Mike
by Mike
Wed Aug 03, 2016 7:39 am
Forum: General
Topic: Datastage 11.5 questions
Replies: 2
Views: 1807

It sounds like you've got the Data Quality version of Information Server (if that still applies at version 11.5). I last worked on a Data Quality version at a 9.1 installation and you only got the DataStage core components, which didn't include server jobs, debugging stages, and a whole lot more of ...
by Mike
Wed Jul 27, 2016 1:14 pm
Forum: General
Topic: Tier Level for Datastage
Replies: 6
Views: 3586

There is a Version.xml file on each of the tier computers. Since a client install doesn't need to know anything about the other tiers, it's Version.xml won't have that information. If you have access to your engine tier computer, its Version.xml should at least have something in it about the service...
by Mike
Wed Jul 20, 2016 11:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Long running Oracle SQL ..Implement stats in DataStage job
Replies: 4
Views: 3853

On your approach, doing it before a read operation makes little sense.

Best would be to do it immediately after an operation that significantly alters data content (load/insert/update/delete).

Next best would be to have a scheduled DBA task.

Mike
by Mike
Wed Jul 20, 2016 9:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Returning NULL from parallel routines
Replies: 4
Views: 4032

Do a search of the IBM Knowledge Center for the difference between out-of-band and in-band null representation.

Mike
by Mike
Tue Jul 19, 2016 3:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle read and write rates
Replies: 3
Views: 3660

To summarize, you need 1 input record to go through the entire pipeline before you allow the next input record to enter the pipeline in order to prevent your stored procedure from generating the same user id for similar inputs. I don't know if DataStage's wave concept can be applicable here, but it ...
by Mike
Tue Jul 19, 2016 7:32 am
Forum: IBM QualityStage
Topic: AVI Setup or Installation Process
Replies: 16
Views: 47277

It's been a while since I last used AVI, but I seem to recall the AVI stage itself having a property to point to a reference data location.

I'd check the stage properties in your developer's test job.

Mike
by Mike
Sun Jul 03, 2016 8:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: lookup stage partition method issue
Replies: 5
Views: 3879

and sort&partitioned main input link by all the foreign key columns. It seems your understanding of how partitioning works is flawed. Besides $TMPDIR, please check for the settings of $TMP and $TEMP in your job log. If present, they will be listed in the second log entry. You can use 1 lookup s...
by Mike
Fri Jul 01, 2016 2:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate file in UTF-8 format
Replies: 7
Views: 7898

Seems like a UTF-8 file could come with an optional 3-byte BOM. But that is no guarantee that it is a UTF-8 file. I think if you're expecting a UTF-8 file, getting a us-ascii file should be no problem. If you're expecting a us-ascii file, getting a UTF-8 file with a BOM is going to be a problem even...
by Mike
Fri Jul 01, 2016 12:59 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to generate file in UTF-8 format
Replies: 7
Views: 7898

UTF-8 is a Unicode character set where characters are encoded from 1 to 4 bytes. ASCII characters are encoded in UTF-8 the same as they are in ASCII.

So us-ascii is essentially a subset of UTF-8.

Your us-ascii file is also a UTF-8 file.

Mike
by Mike
Wed Jun 29, 2016 5:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: EBCIDIC to ASCII Conversion
Replies: 5
Views: 5155

IBM037 would have been my first guess too, but since it apparently didn't work out for you, I'd go with ibm-37-s390 (EBCDIC United States) as my second guess.

Mike