DSXchange

I have found a good reference, attached here for sharing. ---------------- DataStage server v enterprise: some performance stats -- by Vincent McBurney(Solution Architect) I ran some performance tests comparing DataStage server jobs against parallel jobs running on the same machine and processing th...

Let me make a simple case then ... Loading a large flat file (CSV format), roughly 2K each row, totally 10M rows to a staging table (Oracle 9i - 8 CPU, 32GB memory AIX) non-partitioned. Dedicated ETL server: DS EE 7.5.2 running on 8 CPU, 32 GB memory IBM P5 AIX (550Q, 5.3) Box night time (low traffi...

Thinking about changing to DataStage EE, does anyone have performance benchmarking figures? Planning to run EE on a new AIX server with 8CPUs and 32 GB internal memory.

Thanks for your help in advance.

Chun

Unix file permissions may cause this kind of problem if you run the job under different userIDs, expecially when the userIDs are in different groups and have different rights. chunsli Hi All, I have encountered the following error in one of my datastage jobs using one Link Collector SOMETIMES which ...

You can write a ruouting, or do conversion in SQL. By the way, what database do you use? chunsli Hi All, I need to convert a CHAR field to a decimal field in my routine. For example, If I have the CHAR data as '000000500' then i need to convert it to '5.00'. Similarly if I have '000001467' then i ne...

Nothing funcy. Use conformed dimensions as he suggested in his book. Did anyone catch Ralph Kimball's presentation on June 3 on conforming your dimensions? It was hosted by some company called Informatica, I wonder who they are? :lol: Anyways, just curious if anyone else participated in the webinar....

For database records, null value is a valid value. Please do not pad with space, etc. Otherwise, you may have problems later on. And preferably write a VB macro for it or extract the data via a perl script, at least something that can be executed automatically. Excell is notorious for it's manual CS...

It is not a bad idea to export your spreadsheet to CSV files, one for each tab. Then use DataStage to process CSV (same as sequencial) files. An excel file to be processed has information in several tabs. The need is to read data from two of the tabs. Is it possible to do that using datastage? If no...

Agree with you that job sequencer is not powerful enough to stop other jobs (sequences) running if a single one failed. However, the subroutine UtilityAbortToLog can be used to halt all jobs (sequences) running if a job (or sequence) failed.

Try to use DS generated SQL query as a template to customize your (user-defined) SQL statement. I agree with you that it is frustrating, as I have a weird case too. Use defined can only accept "DELETE FROM TABLE_1", not "TRUNCATE TABLE TABLE_1" which makes more sense when purging...

If you are looking for Visual SourceSafe kind of stuff to branch or merge scripts and jobs in DS, the answer is that current DS doesn't have such a function. Hope future releases of DS will improve versioning.

It is possible to do that using Web Services technologies, but significant efforts are required for configurations on both NT and Unix boxes. All these (EAI - enterprise application integrations) seem to go far beyond DataStage ... ETL, DW related work.

However, there is a board 'Looking for Talent'

http://www.tools4datastage.com/forum/fo ... ORUM_ID=11

you should post your job ad there, not here.

There are some posts helpful for your case, see

http://www.tools4datastage.com/forum/to ... C_ID=84657

for details.

I have sent you DS314Svr student exercises for your home work.

Have fun.