DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
PhantomSquawk
Participant



Joined: 05 Feb 2003
Posts: 6
Location: Nicaragua
Points: 35

Post Posted: Sat May 01, 2004 3:59 pm Reply with quote    Back to top    

What is typical in terms of refresh frequency of the hierarchies in the dimension server? Are there often automated daily ETL loads? If much of the enterprises's BI required daily refreshes then can we assume the dimension server needs a daily refresh?

Also, how do automated ETL loads created by techies keep from interfering with manual maintenance that may be done by business users through the Razza GUI? and vice versa
datastage
Participant

Group memberships:
Premium Members, DSXchange Team, Heartland Usergroup

Joined: 23 Oct 2002
Posts: 229
Location: Omaha
Points: 1566

Post Posted: Tue May 04, 2004 10:03 am Reply with quote    Back to top    

Your question about refresh frequency also makes me wonder about implementing slowly changing dimensions in the dimension server.

Thoughts on the best practices approach to the good old friend of data warehouse developers?

_________________
Byron Paul
WARNING: DO NOT OPERATE DATASTAGE WITHOUT ADULT SUPERVISION.

"Strange things are afoot in the reject links" - from Bill & Ted's DataStage Adventure
Rate this response:  
Not yet rated
falsehate
Participant



Joined: 16 Mar 2004
Posts: 9

Points: 150

Post Posted: Thu May 27, 2004 1:06 pm Reply with quote    Back to top    

Typically the dimension server controls the reporting hierarchies for the enterprise as a whole, so BI processes get approved organization, account and other hierarchies from the dimension server. The hierarchies, or reporting structures, are managed independently from application data by the data stewards for each dimension, who control how frequently those dimensions change.

This is a business process issue more so than a technology issue.
Rate this response:  
Not yet rated
falsehate
Participant



Joined: 16 Mar 2004
Posts: 9

Points: 150

Post Posted: Thu May 27, 2004 1:09 pm Reply with quote    Back to top    

After rereading your question, often if the dimension server is not the source for new nodes in a particular dimension, like accounts, then ETL feeds may occur daily.

There are multiple ways to get data into the dimension server, all of which are subject to the same rules and validations that user maintenance are subject to, so integrity is preserved. It is very often the case that ETL loads into the dimension server occur much more frequently that data is extracted.
Rate this response:  
Not yet rated
falsehate
Participant



Joined: 16 Mar 2004
Posts: 9

Points: 150

Post Posted: Thu Aug 26, 2004 10:14 pm Reply with quote    Back to top    

datastage wrote:
Your question about refresh frequency also makes me wonder about implementing slowly changing dimensions in the dimension server.

Thoughts on the best practices approach to the good old friend of data warehouse developers?



The dimension server does an excellent job of supporting slowly changing dimensions because it can provide hierarchies from any point in time and can provide surrogate keys in many cases.

It should be noted that many clients archive the feeds they receive from RazzaDS rather than pulling historical hierarchies each time period. Either method will work, though.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours