Search found 175 matches

by datastage
Tue Apr 01, 2003 9:58 am
Forum: General
Topic: Why ETL is hard
Replies: 13
Views: 10372

Why ETL is hard

According to TDWI white paper 'Evaluating ETL and Data Integration Platforms' by Wayne Eckerson and Colin White: "According to most practicioners, ETL design and development work consumes 60 to 80 % of an entire BI project. With such an inordinate amount of resources tied up in ETL work, it beh...
by datastage
Tue Apr 01, 2003 9:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: AxcelPack vs PE
Replies: 6
Views: 5413

AxcelPack vs PE

What advantages does AxcelPack bring in a multi-processor enviroment, and how does Parallel Extender go above and beyond those advantages?

Also, will AxcelPack continue to be available or is PE its replacement?
by datastage
Mon Mar 31, 2003 6:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Synchronization error ; CurWave ; LastWave
Replies: 2
Views: 2089

Synchronization error ; CurWave ; LastWave

Upon writing to a sequential file I get the following error:

MTXDsourceWkly..T1: Synchronization error Resource = MTXDsourceWkly..CSeqFileStage6.MTXD_USR, CurWave = 1, LastWave = 1, Expected 0


Any idea as to the meaning of 'synchronization error' and the values for CurWave & LastWave?

Thanks
by datastage
Mon Mar 31, 2003 3:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: High Quantity of Jobs In One Project
Replies: 9
Views: 5235

project cleanup

Is the project cleanup / rebuilding indexes safe? For some reason I've always been afraid of running it in fear of causing more trouble than help.
by datastage
Mon Mar 24, 2003 3:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: High Quantity of Jobs In One Project
Replies: 9
Views: 5235

Director refresh

I'm currently using DS 5.1 and have similar problems. I had it anytime with a large number of jobs in a project. I don't think the Server's OS and configuration has any effect, I believe it is purely client machine, so more CPU or RAM on your client might help, but I still think as a developer you a...
by datastage
Tue Mar 11, 2003 11:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hats off to Ray Wurlod
Replies: 16
Views: 4517

True. And a there are a few others besides Ray that deserve a hand for their efforts in building a strong DataStage user community. Let's all strive to follow in their footsteps and improve our livelihood by improving our own user community

Thanks!
by datastage
Tue Mar 11, 2003 11:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: aggregator stage & nulls
Replies: 4
Views: 2181

aggregator stage & nulls

I'm using the average function on a column in an aggregator stage, and the input data contains nulls. In a true mathematical sense the returned average should be null, but the tool does what is more logical & useful and still computes an average. But the question is does it ignore nulls or does ...
by datastage
Tue Feb 18, 2003 3:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Shared Containers
Replies: 6
Views: 3424

throbinson wrote:Ascential has developed a patch. Any shared object will not be exclusively held unless explicitly opened.
Could you update us as to what version of DataStage you ran into this issue with? Thanks.
by datastage
Tue Feb 18, 2003 3:04 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Access Documentation Tool question
Replies: 6
Views: 1477

Thanks Ray.

If you happen to the macro code available could you copy/paste it to the forum?
by datastage
Tue Feb 18, 2003 11:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Access Documentation Tool question
Replies: 6
Views: 1477

Access Documentation Tool question

Is it just me or is Access built for such a simple mind that anyone used to a real database is throughly confused on how to do anything? I'd like to start with a clean mdb to run the auto-doc from Manager. I don't see anywhere through DataStage's interface to delete all from this database. It appear...
by datastage
Fri Jan 24, 2003 2:36 pm
Forum:
Topic: importing vs saving metadata
Replies: 8
Views: 6193

graphical flow

Also, are there any graphical process flows between DataStage and MetaStage that have been created to demonstrate the interaction between these two products? If so, could you post an url to them or get them included as downloads here.

Thanks
by datastage
Fri Jan 24, 2003 1:37 pm
Forum:
Topic: importing vs saving metadata
Replies: 8
Views: 6193

Datastage metadata links

thanks for the reply. It sounds like the cyclical approach to maintaining metadata you mention starts out smoothly but then user interaction is needed to manually reload the definitions in the jobs because no automated process exists in DS or MS to do this. That would be very useful to have. Also, I...
by datastage
Thu Jan 23, 2003 5:35 pm
Forum:
Topic: importing vs saving metadata
Replies: 8
Views: 6193

importing vs saving metadata

If I'm remembering correctly, importing metadata from DS Manager often destroys the links to where the definition is used within jobs that can be used for usage analysis withing Manager. Doesn't this method also have an adverse effect on MetaStage? I think importing hashed file definitions and overw...
by datastage
Thu Jan 23, 2003 4:58 pm
Forum: Data Quality Best Practices
Topic: What is your company doing about data quality?
Replies: 9
Views: 9245

Re: What is your company doing about data quality?

I'm not surprised at all that the survey yeilded a small number of businesses with formal data quality programs. And I think the most common scenario is cleasing after the fact or cleasing only in one island and not fixing the root causes. If an ODS has dirty data and it sources a data mart, I feel ...
by datastage
Mon Dec 30, 2002 1:31 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: dscmdexport error
Replies: 1
Views: 1226

dscmdexport error

when trying to use dscmdexport.exe I get the following error: "dscmdexport aborted: Failed to load resource dll" I have no issues using the Manager export on the same client machine. There are so many DS dlls, does anyone know about this error or which of the dlls is the resource library? ...