I need to do around 200 lookup to get descriptions for every code for every rows. Doing 200 Lookup is ugly design. same is needed for multiple tables.
Input rows are around 10Mill Records. Tried Parallel routine, but its slowing down.
Can some one suggest me what need to be done.
Mutiple Lookup
Moderators: chulett, rschirm, roy
-
- Premium Member
- Posts: 28
- Joined: Mon Apr 20, 2009 11:27 pm
- Location: san antonio
Mutiple Lookup
Krishna Shukla
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact:
Re: Mutiple Lookup
I disagree. You do what you need to do.shukla_krishna wrote:Doing 200 Lookup is ugly design.
Tip: spread things out. The design canvas is infinitely wide and deep. Add documentation (annotations) to indicate which lookup is being done where, and supplement that with meaningful stage and link names.
Spend some time monitoring this large job; it is an example where operator combination will be too aggressive; use selective stage-based denial of combinability to manage the processing load better.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.