DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 1443 matches
Author Message
Workaround Reported
 Topic: Generic Stage in FastTrack generated job
asorrell

Replies: 5
Views: 1192

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Feb 16, 2020 5:40 pm   Subject: Generic Stage in FastTrack generated job
You can retain the metadata on the input and output links, and temporarily keep a copy of the generic stage for a reference in case it has additional details.

1) Right click on the Generic Stage a ...
 Topic: Hierarchical stage - XML parsing
asorrell

Replies: 3
Views: 1024

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Feb 11, 2020 1:55 pm   Subject: Hierarchical stage - XML parsing
Only other way to isolate the problem is to gradually remove sections from the Hierarchical stage to see when the error message goes away. That would tell you at least what section caused the error. ...
Workaround Reported
 Topic: Generic Stage in FastTrack generated job
asorrell

Replies: 5
Views: 1192

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Feb 11, 2020 1:41 pm   Subject: Generic Stage in FastTrack generated job
You can replace the Generic stage with the Copy stage or any other stage required for job completion. The Generic is just a placeholder.

FastTrack provides a starting point, but you are expected t ...
 Topic: Datastage Client Install issues
asorrell

Replies: 3
Views: 536

PostForum: General   Posted: Tue Feb 11, 2020 1:37 pm   Subject: Datastage Client Install issues
1) You must specifically have admin rights for your PC assigned to you.
2) This does not include being in an admin "group" - that doesn't work. Your id must be in the admin list.
3) User Account Co ...
Resolved
 Topic: Datastage V8 certification - training material ?
asorrell

Replies: 6
Views: 1850

PostForum: General   Posted: Tue Feb 11, 2020 1:34 pm   Subject: Datastage V8 certification - training material ?
I would recommend going for the most recent certifications - which are all version 11. Rev 8 is no longer supported.

https://www-01.ibm.com/software/support/lifecycleapp/PLCDetail.wss?q45=A648267 ...
 Topic: Multi-instance job with Oracle source and DB2 target
asorrell

Replies: 7
Views: 1147

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Feb 11, 2020 1:20 pm   Subject: Multi-instance job with Oracle source and DB2 target
I concur with Craig.

You need to use the correct stage for the correct source / target.

1) If your source is an Oracle table, then use an Oracle Connector
2) If your source is a file, use a Seq ...
 Topic: How to handle huge historical record loads in Azure DataLake
asorrell

Replies: 2
Views: 936

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jan 15, 2020 10:28 am   Subject: How to handle huge historical record loads in Azure DataLake
My first thought is to request they add a timestamp column to the source.

Is your problem that you are trying to identify and update changed records?

I have the same problem with another client ...
Resolved
 Topic: Sorting and sending to Entire Partition
asorrell

Replies: 5
Views: 1083

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Jan 15, 2020 9:34 am   Subject: Sorting and sending to Entire Partition
Couldn't you just do a join with it being set to sequential rather than parallel?

Nope - its processing in excess of a billion rows, sometimes up to double digit billions!

Found a solution by th ...
Resolved
 Topic: Sorting and sending to Entire Partition
asorrell

Replies: 5
Views: 1083

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Jan 05, 2020 10:22 am   Subject: Sorting and sending to Entire Partition
And the answer seems to be "no". We ran a test and it looks like it dropped about 5 million records, so I'm assuming that DataStage doesn't keep the records in sorted order as it goes from many (Ha ...
Resolved
 Topic: Sorting and sending to Entire Partition
asorrell

Replies: 5
Views: 1083

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Sun Jan 05, 2020 6:49 am   Subject: Sorting and sending to Entire Partition
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
We have a situation where we are sorting a moderately large dataset on about 100 nodes. However, we want to send the resulting sorted results to a join with "Entire" for the left leg of a right out ...
 Topic: Reading SAS code through datastage
asorrell

Replies: 5
Views: 1311

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Dec 03, 2018 9:00 pm   Subject: Reading SAS code through datastage
So, just to insure I understand... You have been tasked to replace a SAS process that reads a COBOL binary file with a DataStage process? If so, feeding DataStage from a SAS application won't accomp ...
Resolved
 Topic: DB2 vs SQL Server for repositories?
asorrell

Replies: 5
Views: 1220

PostForum: General   Posted: Mon Dec 03, 2018 8:41 pm   Subject: DB2 vs SQL Server for repositories?
Craig! Stop talking about Ray like that! Smile
 Topic: Stuck DataStage Parallel Job
asorrell

Replies: 1
Views: 755

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Nov 27, 2018 7:56 am   Subject: Stuck DataStage Parallel Job
The VOCabulary hashed file is a very critical part of the "uniVerse" database that supports every DataStage project. It tracks a lot of critical pieces required in a working DataStage project.

The ...
 Topic: Hierarchical stage: Error 500 using Recursive to List
asorrell

Replies: 4
Views: 1298

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 21, 2018 12:10 pm   Subject: Hierarchical stage: Error 500 using Recursive to List
You didn't answer one of my questions - have you used this option before in another job?

I'd recommend proceed to step 4...

The "Caused by: java.lang.NullPointerException" message seems to indic ...
 Topic: COBOL file without copybook
asorrell

Replies: 99
Views: 10708

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Nov 21, 2018 10:04 am   Subject: COBOL file without copybook
When Franklin said "Map it to the copybook" I believe he meant FIX the copybook to make it reflect reality. Then use the Complex Flat File stage to read the data using the new copybook.

You will ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours