DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
tj_user



Group memberships:
Premium Members

Joined: 20 Jan 2015
Posts: 22

Points: 218

Post Posted: Fri Jul 07, 2017 6:55 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,

I have strange situation in my project. In the DB2 Connector I enable: Enable partition reads. Then I choose Modulo and specify column.
I have examples where the DB2 connector after such settings multiplies my data by 2. But I also have DB2 connectors where it doesn't multiply the data.

What can be reason?

Job is running on 2 nodes. Version 11.5

Kind regards,
TJ
MT



Group memberships:
Premium Members

Joined: 09 Mar 2007
Posts: 198

Points: 1697

Post Posted: Wed Aug 23, 2017 1:30 pm Reply with quote    Back to top    

Hi

"Enable partition reads" will work with partitioned databases in DB2 - if you have a single partition database you will not see a performance effect

regards
MT

_________________
regards

Michael
Rate this response:  
Not yet rated
R.K.Glover
Participant



Joined: 11 Mar 2013
Posts: 7
Location: RTP, North Carolina
Points: 45

Post Posted: Thu Aug 31, 2017 1:16 pm Reply with quote    Back to top    

If it runs on four nodes, I bet it'll quadruple the data.

I'm guessing that your modulo and your partitioning in DB2 aren't the same. So, effectively, your SQL statement, that runs on each partition, is not constraining its results to the records that are on that partition.
Rate this response:  
Not yet rated
PaulVL



Group memberships:
Premium Members

Joined: 17 Dec 2010
Posts: 1166

Points: 7706

Post Posted: Thu Aug 31, 2017 1:48 pm Reply with quote    Back to top    

Did you select a numeric column type like integer?
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours