Solution to the large look-up

This forum contains ProfileStage posts and now focuses at newer versions Infosphere Information Analyzer.

Moderators: chulett, rschirm

Post Reply
nsm
Premium Member
Premium Member
Posts: 139
Joined: Mon Feb 09, 2004 8:58 am

Solution to the large look-up

Post by nsm »

Hi All,

I have a file coming in with 70,000 rows and has duplicates.For the unique combination of keys in the file I have to look up againest a DB2 table which has 70,000,000(70 million) rows.

I am thinking best way to do this is create a temorary table in DB2 with keys from the file and then do the join to the bigger table then do the rest of the processing.

Please let me know if there is any other best way to do this other than creating a DB2 Temporary table(for which I have to goto DBA)..

Thanks
nsm.
nsm
Premium Member
Premium Member
Posts: 139
Joined: Mon Feb 09, 2004 8:58 am

Post by nsm »

Please let me know.

Thanks
nsm.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The temporary table with keys is probably the best suggestion. Despite the large number of rows, being a key-only table means that it won't consume a lot of space, and the DBA won't mind you're having it. For example if you had a single integer key, the table would require less than 0.3MB.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply