DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 1142 matches
Author Message
Resolved
 Topic: Regarding istool command in Datastage 11.3 version
PaulVL

Replies: 3
Views: 57

PostForum: General   Posted: Wed Oct 18, 2017 1:18 pm   Subject: Regarding istool command in Datastage 11.3 version
you could make a symbolic link istool ->istool.sh and your stuff should work, and you would survive tool patches as well.
 Topic: Datastage Loading in Oracle table Speed
PaulVL

Replies: 8
Views: 117

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 18, 2017 11:43 am   Subject: Datastage Loading in Oracle table Speed
So you are saying that you chopped the job into two pieces by doing a dataset drop, then job number two had two stages... dataset->Oracle and the job #1 ran in 45 mins and Job #2 ran in 6 mins?

...
 Topic: Datastage Loading in Oracle table Speed
PaulVL

Replies: 8
Views: 117

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 18, 2017 11:28 am   Subject: Datastage Loading in Oracle table Speed
How did you determine that it was 2:15 for the oracle load aspect?

Take your original job, remove oracle target and replace with peek. That should give you the pure transform duration.
Workaround Reported
 Topic: Throttle a DS Parallel job which invokes a Rest Service
PaulVL

Replies: 3
Views: 167

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Oct 11, 2017 12:56 pm   Subject: Throttle a DS Parallel job which invokes a Rest Service
I think you also need to come to an understanding with your java source folks. It's not 100 per minute, it's X amount of concurrent requests.

100 requests spread across 60 seconds is different tha ...
 Topic: Increase IGC Term Short Description limit
PaulVL

Replies: 3
Views: 122

PostForum: MetaData and IBM MetaData Workbench   Posted: Tue Oct 10, 2017 2:11 pm   Subject: Increase IGC Term Short Description limit
Have your teenager rewrite the description in their proprietary text message language.
 Topic: glibc detected
PaulVL

Replies: 17
Views: 582

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Fri Oct 06, 2017 7:52 am   Subject: glibc detected
Your compiler options are not at fault. The job crashed and the glibc message was as a result of the crash, not the cause of it. You probably have some data issues with NULLs. Go to your project an ...
 Topic: LDAP connection through datastage
PaulVL

Replies: 9
Views: 1007

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 2:40 pm   Subject: LDAP connection through datastage
well... you could use an external source stage to obtain the data and then process it via a datastage job, but that would be gosh darn silly.

You still haven't explained WHAT you are trying to do o ...
 Topic: LDAP connection through datastage
PaulVL

Replies: 9
Views: 1007

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Oct 02, 2017 12:46 pm   Subject: LDAP connection through datastage
What are you basically trying to do?

I've used LDAPSEARCH before and found it quite useful.

you have to remember that the LDAP host is not a database to query.

Like Ray said... it's a PROTOCO ...
Resolved
 Topic: XML Error Handling on incomplete file
PaulVL

Replies: 11
Views: 387

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Sep 29, 2017 8:02 am   Subject: XML Error Handling on incomplete file
My advice: Craft a better handshaking strategy. Your XML parsing job should never have been kicked off if the file transfer was incomplete.

bad/incomplete data is worse than no data.
 Topic: XML generation Issue
PaulVL

Replies: 12
Views: 452

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Sep 28, 2017 10:22 am   Subject: XML generation Issue
replace xml stage with a peek to see if you are getting data.

Look to see if you have write permissions to that path with the user id that is running the job (in case credential mapping is being us ...
 Topic: glibc detected
PaulVL

Replies: 17
Views: 582

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Thu Sep 28, 2017 9:36 am   Subject: glibc detected
or open a PMR with IBM and have them research it.

Your IA setup should not be causing a fault like that.

Most crashes I've seen in the past were do to bad NULL value handling.
 Topic: XML or JSON Data as input
PaulVL

Replies: 4
Views: 234

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Sep 26, 2017 7:38 am   Subject: XML or JSON Data as input
Read the PDF on the Hierchial stage. You can connect to their host and REST API acquire their data and parse it out.

But do read the manual first.

Nested arrays can be tricky.
 Topic: Datastage error
PaulVL

Replies: 1
Views: 148

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Sep 25, 2017 2:46 pm   Subject: Datastage error
No.


jk


The Signal 31 is a byproduct of the failure, not the cause.

Look to your other fatal errors.
Look to your warning messages.

Look at when the last time the job ran fine, what ch ...
Resolved
 Topic: Grasping at straws: Unix-mainframe FTP performance
PaulVL

Replies: 9
Views: 298

PostForum: General   Posted: Fri Sep 15, 2017 3:07 pm   Subject: Grasping at straws: Unix-mainframe FTP performance
I dislike posting about my limited MF knowledge... makes me feel dirty. I wanted to depart that life and never look back...

(I used to be a MF support person as a contractor at IBM in Rochester MN ...
Resolved
 Topic: Grasping at straws: Unix-mainframe FTP performance
PaulVL

Replies: 9
Views: 298

PostForum: General   Posted: Fri Sep 15, 2017 3:05 pm   Subject: Grasping at straws: Unix-mainframe FTP performance
Were the datasets that you tried to retrieve migrated? I know the MF sometimes does that and you have to wait for the file to be retrieved before it can be used. That would account for a speed issue ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours