Page 1 of 1

Missing maps in datawarehouse

Posted: Mon Mar 21, 2005 5:10 pm
by kiran_418
HI
This is a real time problem. I have datawarehouse built. I dont have mapping from source to target. The documentation is lost. I want to know how to relate a source column to target column.

Posted: Mon Mar 21, 2005 5:29 pm
by vmcburney
You are in a row boat that is leaking badly, you are miles from land and you have been given a tea spoon to bail with.

Have your ETL jobs already been built (and you are trying to reverse engineer the mapping documentation) or are you about to start building them? Are there any functional documents such as business requirements? Are any of the people who did the original documentation still available (either technical staff or business analysts). How much time do you have?

Assuming you have no time and no resources there is an express mode or a slow mode. Express mode is to bring ProfileStage in, profile your sources, profile your target and let ProfileStage build the mapping jobs for you. Slow mode is to rewrite the source to target maps following the normal DW processes with input from the people who know the business requirements and business rules.

Either way you really need some input from people who know the business requirements otherwise you will make a lot of mistakes.

Posted: Mon Mar 21, 2005 6:45 pm
by kiran_418
hi
i got it
but how to do in profile stage.
Thanks

Posted: Mon Mar 21, 2005 7:35 pm
by kduke
This is exactly why I wrote DwNav. I use it to help me understand the ETL created by previous consultants. That was the main reason for writing it. Most of the time you do not have access to these people. What I found was most of the time you need just source and target tables. DwNav can browse these in the tool or generate html documentation to do it.

Very inexpensive tool. Pay for itself first time you need it for something like this but do it the hard way like most developers. Make a man out of you.

Posted: Mon Mar 21, 2005 10:18 pm
by vmcburney
Let me repeat the question. Do you already have ETL jobs built and you are trying to document them or are in you in the process of building the ETL jobs?

Posted: Tue Mar 22, 2005 8:27 am
by Baldmartyr
I've moved this thread as it is more suitably discussed in the "Data Integration" forum.

Posted: Thu May 05, 2005 6:17 pm
by kiran_418
Well i have the target tables deaigned and i do not have even a clue of what the transformation mappings are

Posted: Thu May 05, 2005 9:04 pm
by ray.wurlod
This is actually a good task for MetaStage, particularly if good and wise practices have been used in DataStage design.

Posted: Fri May 06, 2005 11:20 am
by kiran_418
how will metastage help in this project. Isnt metastage used for metadata management.

Posted: Sat May 07, 2005 5:23 am
by ray.wurlod
You bet. And what are job designs and TX maps if not metadata?

Posted: Mon May 09, 2005 12:10 pm
by PilotBaha
Metastage will help with this great deal. You can actually see where the fields are coming from, how fields are geting built through its analyzers. I don't have the system available to me , but I was very impressed with this functionality during the training class.