DB2 connector - doubling records

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
tj_user
Premium Member
Premium Member
Posts: 22
Joined: Tue Jan 20, 2015 2:22 am

DB2 connector - doubling records

Post by tj_user »

Hi All,

I have strange situation in my project. In the DB2 Connector I enable: Enable partition reads. Then I choose Modulo and specify column.
I have examples where the DB2 connector after such settings multiplies my data by 2. But I also have DB2 connectors where it doesn't multiply the data.

What can be reason?

Job is running on 2 nodes. Version 11.5

Kind regards,
TJ
MT
Premium Member
Premium Member
Posts: 198
Joined: Fri Mar 09, 2007 3:51 am

Re: DB2 connector - strange behaviour

Post by MT »

Hi

"Enable partition reads" will work with partitioned databases in DB2 - if you have a single partition database you will not see a performance effect

regards
MT
regards

Michael
R.K.Glover
Participant
Posts: 8
Joined: Mon Mar 11, 2013 2:51 pm
Location: RTP, North Carolina

Re: DB2 connector - doubling records

Post by R.K.Glover »

If it runs on four nodes, I bet it'll quadruple the data.

I'm guessing that your modulo and your partitioning in DB2 aren't the same. So, effectively, your SQL statement, that runs on each partition, is not constraining its results to the records that are on that partition.
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

Did you select a numeric column type like integer?
Post Reply