DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
abc123



Group memberships:
Premium Members

Joined: 25 Aug 2006
Posts: 596

Points: 5327

Post Posted: Thu Nov 08, 2018 5:40 pm Reply with quote    Back to top    

DataStage® Release: 9x
Job Type: Parallel
OS: Unix
I have a dimension table (Dim1) being updated using Type 2. The existing data of Dim1 (based on certain criteria) is being used as the Reference set (Ref1).

Between runs of the DataStage job to load Dim1, some of the rows got updated in Ref1 (Dim1 based on certain criteria). Now, in the next run of the DataStage job to load the dimension, rows which are not in the Source set (Src1) are being inserted into Dim1 and existing rows are being expired.

For example:

Reference set (Ref1): (Select * from Dim1 where DataCol2=X): BK1=1,2,3,4,5,6,7
Source set (Src1): BK1=2,3,4

After the run of the DataStage job, BK1=5 record is being inserted into Dim1 (even though it doesn't exist in Src1) and the previous record is being expired.

Any idea why?
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours