Search found 1315 matches

by PaulVL
Mon Jul 12, 2021 7:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join Stage slowness in parallel job
Replies: 6
Views: 16823

Re: Join Stage slowness in parallel job

Don't go boosting that array size without taking into account what it is doing to your memory buffers. Here's my rule of thumb. Each stage has (by default) about 3MB of buffer space. I always recommend calculating your row length, then taking a third of that buffer space and see how many rows fit in...
by PaulVL
Fri Jul 09, 2021 7:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to set the path for the heap dump files via DS project environment variables
Replies: 3
Views: 13286

Re: How to set the path for the heap dump files via DS project environment variables

I would experiment with changing these two environment variables. $HOME and/or CWD. Set those at a job level. Force your job to fail and see where the dump goes.
by PaulVL
Mon Jun 14, 2021 8:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using sql file to insert data in the table.
Replies: 2
Views: 12350

Re: Using sql file to insert data in the table.

Perhaps you can post how you resolved it so that future generations digging into the archives can also find the solution. :lol:
by PaulVL
Thu Jun 10, 2021 6:09 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Exporting executables - best practice
Replies: 2
Views: 12113

Re: Exporting executables - best practice

Best is like saying Chocolate is way better than Vanilla. It's a matter of taste. But... Standard Practice... Yes. I would say migrating objects with executables is Standard Practice. This allows for a full Unix side automated migration without any manual intervention or super fancy call to a window...
by PaulVL
Mon May 03, 2021 5:50 pm
Forum: General
Topic: Hierarchy stage not working with flash gone now
Replies: 3
Views: 13746

Re: Hierarchy stage not working with flash gone now

Reach out to IBM to see what they can work out with your company. They have worked with others.
Depends how big you are of course.
by PaulVL
Mon Aug 24, 2020 6:01 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage on Azure
Replies: 2
Views: 13309

Those are all questions that you need to be asking IBM via a Case ticket (formerly PMR ticket).
by PaulVL
Tue Jul 21, 2020 11:19 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: IBM Datastage / db2 connection Issue
Replies: 3
Views: 14439

Welcome to DSXchange Jinaanoo, just to be clear, nobody here is your official support team. We HELP however we can. You should reach out to your local DataStage admin team. You should reach out to your local DB2 DBA team. You should reach out to your IBM support if the first two do not work out. Typ...
by PaulVL
Sun Jul 19, 2020 3:17 pm
Forum: General
Topic: DS created database connections
Replies: 1
Views: 11031

are you doing a read or a write action? Partitioned Read? Anything in your SQL statement to pump up the connections? Nodes in the config file will not matter. You can drop the Oracle Connector stage to sequential mode vs parallel, but, you have to look at those settings. Is this a Multi Instance job...
by PaulVL
Sun Jul 19, 2020 3:11 pm
Forum: General
Topic: DataStage Cloud Pak
Replies: 0
Views: 11139

DataStage Cloud Pak

Is anyone using Information Server (DataStage) Cloud Pak module?

Would like to get your opinion on it. Please msg me privately.

Thanks
by PaulVL
Mon Jul 13, 2020 8:07 am
Forum: General
Topic: Export/Import environment variables from the command line
Replies: 2
Views: 12863

I would NOT recommend copying the dsparms file from one project to another. You do not know if the difference in release level of datastage also constitutes new or removed entries in the dsparms file. You could script it, but then again, you will have trouble separating the user parms vs the default...
by PaulVL
Tue Jun 02, 2020 9:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Server Jobs Deprecated
Replies: 6
Views: 19601

Is there an official link to an IBM statement on this? Need to forward to some internal customers.
by PaulVL
Thu Apr 16, 2020 4:31 pm
Forum: General
Topic: View Data from a DB2 Connector
Replies: 1
Views: 10916

Well, that does not give us a lot to go on. Here is what happens (roughly) under the covers. The datastage engine submits a dummy job to connect to that data repository. it also dumps a temp file or two to a path defined by APT_VIEWDATA_TEMP_DIR or if that is not set, then it defaults to your projec...
by PaulVL
Wed Feb 26, 2020 8:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: job is throwing error: Unexpected exit status -1
Replies: 2
Views: 6377

It's also not the error itself, it's just reporting that you took an exit.

paste more of the log.
by PaulVL
Wed Feb 26, 2020 8:19 am
Forum: General
Topic: DS generating 25+GB of log files
Replies: 1
Views: 10892

Have you checked what is in your log file?

Warning messages perhaps?

if the gui is to slow because of the size of the log, look via command line.

$DSHOME/bin/dsjob -logdetail <project> <job.invocation>
by PaulVL
Wed Jan 08, 2020 12:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorting and sending to Entire Partition
Replies: 5
Views: 6182

Couldn't you just do a join with it being set to sequential rather than parallel?