hi,
We are getting the following error while trying to extract data in parallel using a user-defined query (in a DB2 Enterprise Stage)
main_program: Fatal Error: Multiple calls to setNodeMap() must specify the same numberOfPartitions.
Help!
Error in parallel data extraction using a user-defined query
Moderators: chulett, rschirm, roy
-
ray.wurlod
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Welcome aboard! :D
What this message appears to be telling you is that you have specified X partitions in your query but Y partitions in your PX configuration file for the job. And that the rule is that X must equal Y.
The only remedy is to make sure that the rule is obeyed. You can change either or both the query or the configuration file. (It's not necessary to use the same configuration file for every job; indeed, it's probably unwise: small jobs can probably be managed better on one node.)
What this message appears to be telling you is that you have specified X partitions in your query but Y partitions in your PX configuration file for the job. And that the rule is that X must equal Y.
The only remedy is to make sure that the rule is obeyed. You can change either or both the query or the configuration file. (It's not necessary to use the same configuration file for every job; indeed, it's probably unwise: small jobs can probably be managed better on one node.)
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
-
gh_amitava
- Participant
- Posts: 75
- Joined: Tue May 13, 2003 4:14 am
- Location: California
- Contact:
Hi,
If you use a user defined query in DB2 enterprise stage, Datastage works in sequential mode. Instead of using user defined query use the "Read Method = Table" and use the "Table", "Select" and "Where" clauses under this. Then it will work in parallel. In large volumn testing, you will find a huge performance difference in these two methods.
Regards
~Amitava
If you use a user defined query in DB2 enterprise stage, Datastage works in sequential mode. Instead of using user defined query use the "Read Method = Table" and use the "Table", "Select" and "Where" clauses under this. Then it will work in parallel. In large volumn testing, you will find a huge performance difference in these two methods.
Regards
~Amitava