Missing maps in datawarehouse

Moderators: chulett, rschirm

Post Reply
kiran_418
Participant
Posts: 40
Joined: Tue Feb 22, 2005 11:12 am

Missing maps in datawarehouse

Post by kiran_418 »

HI
This is a real time problem. I have datawarehouse built. I dont have mapping from source to target. The documentation is lost. I want to know how to relate a source column to target column.
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

You are in a row boat that is leaking badly, you are miles from land and you have been given a tea spoon to bail with.

Have your ETL jobs already been built (and you are trying to reverse engineer the mapping documentation) or are you about to start building them? Are there any functional documents such as business requirements? Are any of the people who did the original documentation still available (either technical staff or business analysts). How much time do you have?

Assuming you have no time and no resources there is an express mode or a slow mode. Express mode is to bring ProfileStage in, profile your sources, profile your target and let ProfileStage build the mapping jobs for you. Slow mode is to rewrite the source to target maps following the normal DW processes with input from the people who know the business requirements and business rules.

Either way you really need some input from people who know the business requirements otherwise you will make a lot of mistakes.
kiran_418
Participant
Posts: 40
Joined: Tue Feb 22, 2005 11:12 am

Post by kiran_418 »

hi
i got it
but how to do in profile stage.
Thanks
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

This is exactly why I wrote DwNav. I use it to help me understand the ETL created by previous consultants. That was the main reason for writing it. Most of the time you do not have access to these people. What I found was most of the time you need just source and target tables. DwNav can browse these in the tool or generate html documentation to do it.

Very inexpensive tool. Pay for itself first time you need it for something like this but do it the hard way like most developers. Make a man out of you.
Mamu Kim
vmcburney
Participant
Posts: 3593
Joined: Thu Jan 23, 2003 5:25 pm
Location: Australia, Melbourne
Contact:

Post by vmcburney »

Let me repeat the question. Do you already have ETL jobs built and you are trying to document them or are in you in the process of building the ETL jobs?
Baldmartyr
Participant
Posts: 108
Joined: Mon Oct 21, 2002 8:30 am

Post by Baldmartyr »

I've moved this thread as it is more suitably discussed in the "Data Integration" forum.
David Baldwin
Former DSXchange Webmaster
kiran_418
Participant
Posts: 40
Joined: Tue Feb 22, 2005 11:12 am

Post by kiran_418 »

Well i have the target tables deaigned and i do not have even a clue of what the transformation mappings are
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

This is actually a good task for MetaStage, particularly if good and wise practices have been used in DataStage design.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kiran_418
Participant
Posts: 40
Joined: Tue Feb 22, 2005 11:12 am

Post by kiran_418 »

how will metastage help in this project. Isnt metastage used for metadata management.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

You bet. And what are job designs and TX maps if not metadata?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
PilotBaha
Premium Member
Premium Member
Posts: 202
Joined: Mon Jan 12, 2004 8:05 pm

Post by PilotBaha »

Metastage will help with this great deal. You can actually see where the fields are coming from, how fields are geting built through its analyzers. I don't have the system available to me , but I was very impressed with this functionality during the training class.
Post Reply