DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 508 matches
Author Message
 Topic: Stored procedure stage with DB2/ZOS 11 array functionality
clarcombe

Replies: 0
Views: 111

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Dec 06, 2017 7:00 am   Subject: Stored procedure stage with DB2/ZOS 11 array functionality
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
I am trying to test using the DB2 v11 array functionality to put values into a table which have been read in array format from DB2

e.g.
PERSON_ID|PERSON_ID_2
COL1,COL2|A1,A2

Would write two re ...
 Topic: Retry on JDBC connector
clarcombe

Replies: 3
Views: 635

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 16, 2017 3:12 am   Subject: Retry on JDBC connector
Andy,

Thanks for this.

Can you elaborate on this technique please ?

Our read/write jobs are already being run in Job Sequences and are called from a main Job Sequence.

Are you suggesting ...
 Topic: Detect Datastage Server is healthy
clarcombe

Replies: 4
Views: 534

PostForum: General   Posted: Thu Nov 16, 2017 2:49 am   Subject: Detect Datastage Server is healthy
I have opened a call with IBM to check this.
 Topic: Retry after failure - JDBC connector
clarcombe

Replies: 2
Views: 397

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 16, 2017 2:47 am   Subject: Re: Retry after failure - JDBC connector
We have not been able to get to the bottom of why this is failing. Even though we have installed the latest JDBC connector we still get intermittent failures.

I have asked the production team who r ...
 Topic: Unstructured Stage - Array index out of range
clarcombe

Replies: 6
Views: 581

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 16, 2017 2:43 am   Subject: Unstructured Stage - Array index out of range
For an update, I have had a remote session with IBM Support and they were unable to find out why this fails to work.

Even running the OSH manually under debug failed to shed any light.

Next stop ...
Resolved
 Topic: Create SQL statements instead of using database stages
clarcombe

Replies: 11
Views: 1432

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Nov 16, 2017 2:40 am   Subject: Create SQL statements instead of using database stages
For reference and completeness, I am adding what we have decided to do after many weeks of discussion.

We have two modes for our inserts - full and delta. Full is for an initial run when the busine ...
 Topic: Unstructured Stage - Array index out of range
clarcombe

Replies: 6
Views: 581

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Nov 03, 2017 2:00 pm   Subject: Unstructured Stage - Array index out of range
Still waiting for a response from our favorite support provider Sad
 Topic: Unstructured Stage - Array index out of range
clarcombe

Replies: 6
Views: 581

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Oct 24, 2017 1:08 am   Subject: Unstructured Stage - Array index out of range
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Additional info: 11.5.0.2
I am trying to use the Unstructured stage and I get the following error

Message: Unstructured_Data_1,0: com.ascential.e2.common.CC_Exception: java.lang.ArrayIndexOutOfBoundsException ...
 Topic: Retry after failure - JDBC connector
clarcombe

Replies: 2
Views: 397

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Sep 25, 2017 12:47 pm   Subject: Retry after failure - JDBC connector
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Following on from another topic I have posted when we have a failure on our JDBC connector, I was wondering what process I could place to retry or automatically restart a job if there is a failure.
...
 Topic: JDBC Connector Transaction Record Count error
clarcombe

Replies: 0
Views: 204

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Sep 25, 2017 12:43 pm   Subject: JDBC Connector Transaction Record Count error
DataStage® Release: 11x
Job Type: Parallel
OS: Unix
For a job in production we are executing deletes followed by inserts. However, recently every run has started producing this error on the delete cycle

Invalid property value /Usage/Transaction/Reco ...
Resolved
 Topic: Create SQL statements instead of using database stages
clarcombe

Replies: 11
Views: 1432

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Aug 28, 2017 2:22 am   Subject: Create SQL statements instead of using database stages
Thankyou for your comments.

From what I have seen here, I could possibly do the following

1) Test the connection to the mainframe using a Datastage FTP
2) Test the ODBC connector and "play" wi ...
Resolved
 Topic: Create SQL statements instead of using database stages
clarcombe

Replies: 11
Views: 1432

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 25, 2017 7:17 am   Subject: Create SQL statements instead of using database stages
I think this was tried before we went the JDBC route. ODBC is notoriously slow anyway as it can't take advantage of the native drivers.

But both of you have raised good points, perhaps I should inv ...
Resolved
 Topic: Create SQL statements instead of using database stages
clarcombe

Replies: 11
Views: 1432

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 25, 2017 7:02 am   Subject: Create SQL statements instead of using database stages
Many of the points you have mentioned are valid and we have indeed engaged the support of IBM on several occasions, for this and other cases.

We have also checked the speed of connection using ping ...
Resolved
 Topic: Create SQL statements instead of using database stages
clarcombe

Replies: 11
Views: 1432

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 25, 2017 6:19 am   Subject: Create SQL statements instead of using database stages
I am afraid you are going down a dangerous (expensive) path of workarounds. Why is the performance so bad to begin with, and can you just find a solution to that problem?

Our extract rates are betw ...
 Topic: JDBC Connector for DB2 Z/OS optimization
clarcombe

Replies: 7
Views: 1097

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 25, 2017 5:13 am   Subject: JDBC Connector for DB2 Z/OS optimization
From the original developer.

JDBC : chosen because not all the records were processed with the DB2 connector and it gave no message or failure.

We couldn't wait for a patch so we went with JDBC ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours