Urgent....Please Help Me!!!

devaraj4u · Post by **devaraj4u** » Tue Feb 11, 2003 2:46 pm

Hi All,

I have 2 Oracle Schemas.I need to do ETL from one oracle(Relational Schema) to another Oracle(Star Schema).In Source Database I have 3 Base tables from which 16 Views are derived and I need to Move the Data from these sources(So 16 Objects) to target of 19 Tables.

So Do i need to design 19 Jobs to move data between Source and Target (one table by one table) or is there any other better way is there do the same.The mapping is taking more time in ETL.

Please help me in this issue.

Thanks & Regards,
K.S.Rajan.

devaraj4u · Post by **devaraj4u** » Tue Feb 11, 2003 3:49 pm

Could U Please help me in the above issue.It is very urgent Ray....

Thanks & Regards,
K.S.Rajan.

vmcburney · Post by **vmcburney** » Tue Feb 11, 2003 5:32 pm

You need to import your table definitions for source and destination tables into the DataStage repositry using the Manager. This will speed up the process of creating the DataStage jobs. It is best to do one job per table as it makes the management and debugging easier. You mention 16 sources and 19 destinations, some of your jobs could have one input loading to more than one destination.

The mapping should be fast, don't forget there is an automap button in the transformer stage that will map columns with identical names.
The creation of a job should take just a few minutes. You load the table definitions into the source and destination stages, you auto map the columns and drag and drop the rest.

You then need a Sequence job that runs the 19 jobs using a combination of parallel and sequencial jobs, the number of parallel streams depends on data dependency and the number of processors on your server.

You need to consider whether you will bulk load the data into Oracle or use the OCI insert.

Vincent McBurney
Data Integration Services
www.intramatix.com

ray.wurlod · Post by **ray.wurlod** » Tue Feb 11, 2003 5:33 pm

It is probably - almost certainly - possible to do it with a single job, accessing data from the source tables and views and loading the 19 targets.
May I ask where you are in India? I will be travelling to Mumbai in the near future.

Ray Wurlod
Education and Consulting Services
ABN 57 092 448 518

vmcburney · Post by **vmcburney** » Tue Feb 11, 2003 5:50 pm

devaraj4u, strongly recommend you get some training from Ray. If you are not in Mumbai then get in your car and start driving! Your process of loading a star schema will benefit greatly from DataStage Best Practices which Ray knows a thing or two about.

Vincent McBurney
Data Integration Services
www.intramatix.com

devaraj4u · Post by **devaraj4u** » Wed Feb 12, 2003 8:21 am

Dear Ray,

Right now I am in New Jersey,USA for a short term assignment.i will be back in India on March 11th/March 13th 2003.Ray I am in Southern Part of India.It is called Chennai(MADRAS).Bombay is 1100 KMs from my Place.

Thanks & Regards,
K.S.Rajan.

devaraj4u · Post by **devaraj4u** » Wed Feb 12, 2003 8:24 am

Dear Vincent McBurney,

I proceeded(STEPS) as you said in your mail and It was successful to load Data thru DS.Thanks a lot for your valuable mail at the right time.
Thanks a lot Vincent.

Thanks & Regards,
K.S.Rajan.