Hash file Look up

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
rexsmith
Participant
Posts: 64
Joined: Sun May 14, 2006 8:57 pm

Hash file Look up

Post by rexsmith »

I've a job where iam populating the hash file and doing the look up against file with another input.My question is does it have any impact in performance if i had to look up against huge data?
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Welcome aboard! :D

Define 'huge' for us, please.
-craig

"You can never have too many knives" -- Logan Nine Fingers
rexsmith
Participant
Posts: 64
Joined: Sun May 14, 2006 8:57 pm

Post by rexsmith »

Its half a million records
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Easily handled by the hashed file stage. Performance would be best if you've 'pre-sized' it for that volume by bumping up the minimum modulus. Have you done that or is it still at the default of 1?

Have you used the HFC / Hashed File Calculator before? It can be found as an 'unsupported utility' on the client cdrom and will give you an idea, based on volume and record length, what your sizing information should be.
-craig

"You can never have too many knives" -- Logan Nine Fingers
rexsmith
Participant
Posts: 64
Joined: Sun May 14, 2006 8:57 pm

Post by rexsmith »

Thanks Craig ! I'll try the options
Post Reply