DSXchange: DataStage and IBM Websphere Data Integration Forum
Search found 1101 matches
Author Message
 Topic: right tool(s) for data classification request
PaulVL

Replies: 2
Views: 17

PostForum: Information Analyzer (formerly ProfileStage)   Posted: Thu Aug 17, 2017 3:51 pm   Subject: right tool(s) for data classification request
That is not so much a datastage question but a Unix Security Scan question.

Not sure which forum that would be.

IA is not the tool to crawl your network since it cannot dynamically created conne ...
 Topic: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
PaulVL

Replies: 26
Views: 871

PostForum: General   Posted: Thu Aug 17, 2017 3:42 pm   Subject: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
I still don't think that is the issue. You said your slowness happens over time.

Are you sure that at the time of slowness you don't have multiple jobs running?

Meaning... once you go slow.. .i ...
 Topic: Oracle Connector from sequential to partition read fails
PaulVL

Replies: 6
Views: 185

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Wed Aug 16, 2017 8:54 am   Subject: Oracle Connector from sequential to partition read fails
Tell/Ask your DBA to partition your dev table since prod is partitioned. I dislike the fact that dev and prod are not mirrors in terms of setup. Unless of course you are testing a new aspect in dev ...
 Topic: Oracle Connector from sequential to partition read fails
PaulVL

Replies: 6
Views: 185

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Aug 15, 2017 11:42 am   Subject: Oracle Connector from sequential to partition read fails
what is the column type on that Number_key?

Did you ask your DBA if the table is already partitioned based upon a given column?
 Topic: DataStage MD5 Implementation
PaulVL

Replies: 6
Views: 184

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Tue Aug 15, 2017 9:33 am   Subject: DataStage MD5 Implementation
(I'm not a developer...)

So if he forks his data into the checksum stage, then how could he join it back to his main data and concatenate the checksum value to the correct data column?
 Topic: Environment Isolation
PaulVL

Replies: 4
Views: 106

PostForum: General   Posted: Tue Aug 15, 2017 9:31 am   Subject: Environment Isolation
As an admin, I would say put each env on a separate host. I look at it from a patching point of view.

If you simply have 3 projects, then you have 1 engine. And a patch should never be applied to ...
 Topic: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
PaulVL

Replies: 26
Views: 871

PostForum: General   Posted: Mon Aug 14, 2017 2:27 pm   Subject: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
Well, based upon your described symptoms, you slow down over time. You did not indicate that there were a lot of concurrently running jobs running at the time. That implies that your CPU should not ...
 Topic: DataStage MD5 Implementation
PaulVL

Replies: 6
Views: 184

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Mon Aug 14, 2017 8:42 am   Subject: DataStage MD5 Implementation
Well, given that MD5 is an industry standard, any certified MD5 calculator should spit out the same result.

Introducing perl to the mix just to calculate that might be overkill.... depends how you ...
 Topic: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
PaulVL

Replies: 26
Views: 871

PostForum: General   Posted: Mon Aug 14, 2017 7:52 am   Subject: Lengthy start up time for 90% of datastage jobs in 11.5.0.2
Adding more CPU is nuts and the IBM guy who is recommending that is a newb. Not to mention you've just signed up for 50% more licensing cost because of a product shortcoming. This is not LOAD based ...
 Topic: DataStage MD5 Implementation
PaulVL

Replies: 6
Views: 184

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Fri Aug 11, 2017 2:59 pm   Subject: DataStage MD5 Implementation
why don't you make a build op calling your perl md5 stuff and use that?
 Topic: How to capture job start time, end time, name etc
PaulVL

Replies: 5
Views: 77

PostForum: General   Posted: Fri Aug 11, 2017 2:57 pm   Subject: How to capture job start time, end time, name etc
UCDI if the brute force way is acceptable...

$DSHOME/bin/dsjob -jobdetails <project> <job.invocation> > /path/joblog_<project>_<job>.log would be the way to script it, th ...
 Topic: Performance Issue in DataStage 11.5
PaulVL

Replies: 8
Views: 141

PostForum: General   Posted: Fri Aug 11, 2017 9:29 am   Subject: Performance Issue in DataStage 11.5
I read it the same way Craig.
 Topic: How to capture job start time, end time, name etc
PaulVL

Replies: 5
Views: 77

PostForum: General   Posted: Thu Aug 10, 2017 2:13 pm   Subject: How to capture job start time, end time, name etc
Use the DSODB database for those stats.
 Topic: Want to fix a particular warning with Funnel stage
PaulVL

Replies: 3
Views: 101

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Aug 10, 2017 10:57 am   Subject: Want to fix a particular warning with Funnel stage
I think the important thing you need to research is why does the job abort if run via Control-M scheduler and work fine if run manually.

I think you will find that control-M submits a script to exe ...
Resolved
 Topic: Job datasets
PaulVL

Replies: 7
Views: 201

PostForum: IBM® DataStage Enterprise Edition (Formerly Parallel Extender/PX)   Posted: Thu Aug 10, 2017 10:43 am   Subject: Job datasets
You can have a multi instance job run. Each job must write to a UNIQUE dataset name.

Apply a parameter into the path or filename to make it UNIQUE.

Same job can be loaded into DEV, TEST or PROD ...
 

 Jump to:   



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours