Search found 124 matches

by daignault
Thu Jul 21, 2011 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Hash partitioning
Replies: 8
Views: 7142

Of course, since the UniVerse source code is full of tried and true hashing algorithm, it would make sense that one of those were deployed.

The Dynamic file structure would be the logical choice as it supports keys of any type and length.

Cheers,

Ray D
by daignault
Sat Jun 04, 2011 3:19 pm
Forum: General
Topic: Infosphere Datastage 8.5 Scheduler service.
Replies: 3
Views: 2347

Craig is correct. 8.5 windows is still using "at" for scheduling.

Ray D
by daignault
Sun May 01, 2011 12:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage log
Replies: 6
Views: 2604

How much CPU time is being used by your stage. User time is computation time, System time is either time spent doing I/O or Semaphore (System) activity, etc.

Ray D
by daignault
Thu Apr 28, 2011 2:26 pm
Forum: General
Topic: Largest Datastage site by data volume and
Replies: 2
Views: 1885

Mostly the Grid sites. I know of 4-5 sites. It would be nice to know if there are any other users of GRID on DSXchange

Ray D
by daignault
Fri Apr 08, 2011 9:58 am
Forum: General
Topic: Rgarding 39125 Issue in datastage
Replies: 8
Views: 4044

Go into the Datastage (UniVerse) environment within your project. You can do this by cd $DSHOME ; ./dsenv; ./bin/uvsh From there, execute a LOGTO PROJ_NAME Once there, there is a DS.TOOLS Menu (just enter DS.TOOLS at the prompt). One of the options in the menus is Rebuild Indexes. I have found this ...
by daignault
Fri Apr 08, 2011 9:22 am
Forum: General
Topic: Largest Datastage site by data volume and
Replies: 2
Views: 1885

Largest Datastage site by data volume and

Hi All, I'm looking for the larger Datastage sites. Don't need the name of the company (although would be nice), but System Config, and number of jobs executed on a daily basis would be great. Data volume would be fantastic but that may The site I'm working with is on a grid with 10 compute nodes an...
by daignault
Fri Apr 01, 2011 9:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multiple HeadNodes in a Datastage environment
Replies: 0
Views: 1402

Multiple HeadNodes in a Datastage environment

Has anyone setup multiple headnodes in a Datastage environment. We are executing on a grid and looking at upgrading from 1 headnode to 2 headnodes. Do we need 2 XMETA and Websphere environments or is it leveraging off of existing infrastructure? I'm not asking for the answer, but just a hint. I'm re...
by daignault
Fri Feb 11, 2011 3:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job giving correct output in development but not giving in p
Replies: 4
Views: 2936

As a rule of thumb, never EVER develop a Datastage job in enterprise with 1 node. Even if you have a small single core CPU, you are still able to develop jobs using 2 nodes. It may not run fast but performance is not the issue. When developing with 2 nodes, you exercise the parallel aspects of data ...
by daignault
Fri Feb 11, 2011 2:46 pm
Forum: General
Topic: DataStage 8.1 installation on Windows
Replies: 6
Views: 3673

Are you going to have the two products co-exist or will you be replacing the 7.x release with an 8.x release? If you are replacing the 7.x with 8.x I would make sure you clean up the registry between the deinstall of 7.x and the install of 8.x. The Microsoft registry can get cluttered and may preven...
by daignault
Fri Feb 11, 2011 2:41 pm
Forum: General
Topic: DSEngine restart and ASBnode
Replies: 2
Views: 2866

Thanks Ray. That what I thought. The IBM documentation says to shut down everything but I was pretty sure ASBnode was outside the realm.

Had to document it for my offsider however :)

Ray D
by daignault
Tue Feb 08, 2011 3:04 pm
Forum: General
Topic: DSEngine restart and ASBnode
Replies: 2
Views: 2866

DSEngine restart and ASBnode

I'm making a mod to the uvconfig file within the Datastage engine and performing performing a "uvregen" and restart of the engine with a uv -admin -start

Do I need to shut down and restart the ASBnode as well?

Thanks in advance,

Ray D
by daignault
Thu Jan 27, 2011 3:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: [osh.exe] <defunct> process
Replies: 9
Views: 8949

There is a kernel patch for Linux for PDFLUSH. This is a known LINUX issue with EE.

My site has patched SUSE kernel for this, but it may be called something else in Redhat.

Regards,

Ray Daignault
by daignault
Mon Jan 24, 2011 3:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: 6 Transformers Or 60 Stage Variables
Replies: 9
Views: 6393

Every time you use a transformer stage, the data is exported, processed by the C++ code in the transformer and re-imported with data validation into the Datastage run machine.

This is a very expensive operation to perform 6 times. Instead use a Switch stage to segment the data.

Ray D
by daignault
Mon Jan 24, 2011 2:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Parsing XML and loading Database
Replies: 4
Views: 2782

I worked with a customer in Denver and they have scheduled a Datastage job in cron to run every 5 mins. It's not real-time but close. You could also write a unix script to check for the existance of a file within the directory in question, and if there are any files, submit the datastage job to proc...
by daignault
Mon Jan 24, 2011 2:12 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Warehouse & ETL Developer opportunity in TX
Replies: 1
Views: 2874

And is there a technical question that can be answered in this forum :)

There is a forum for this type of post outside of the technical questions/answers forum.

Regards,

The OTHER Ray