warning : lookup stage

lory · Post by **lory** » Mon Dec 13, 2004 9:45 am

what does mean the following error in lookup stage:
"...When checking operator: Input Dataset 1 has partitioning other than Entire specified; disabling memory sharing"

Thanks in advance!

T42 · Post by **T42** » Mon Dec 13, 2004 6:01 pm

It means that they are partitioning your data other than the default preference (Entire).

If they use Entire partitioning, they would share the memory between all the nodes, instead of making copies of the same thing for each node (and eating up more memory).

However, you are setting it as something else, so... no memory sharing.