I am having a lookup problem in my job. The reference lookup file contains about 30,000 records.This jobs works fine for few thousands.When the file size is increased the job is getting aborted.I tried to put the data from file to a table and did sparse looup.That didn't work too.
This is the error
LKP_SAP_No,0: Could not map table file "D:/IBM_DQS_Config/Dataset/lookuptable.20090626.rknphzd (size 1261666600 bytes)": Not enough space.
LKP_SAP_No,0: Error finalizing / saving table /D=/ISDS/dynLUT405668aa2ae1
Please advice.
Last edited by Hope on Fri Jun 26, 2009 7:39 am, edited 1 time in total.
You sem to have run out of disk space in your Dataset directory at runtime. Increase the space or use an additional mount point with space for your datasets.
I mean to say that we have 70GB of space in D:/ .70GB of space includes all parent and child folders. Do we need to have space in the "Dataset" folder?. Please advice.
Hope wrote:I mean to say that we have 70GB of space in D:/ .70GB of space includes all parent and child folders. Do we need to have space in the "Dataset" folder?. Please advice.
Monitor space while the job is running.
Priyadarshi Kunal
Genius may have its limitations, but stupidity is not thus handicapped.
And just to address the last question, there is no such thing as space "in a folder", for Windows the space is managed at the drive letter level and is available to any folder on that drive letter.
-craig
"You can never have too many knives" -- Logan Nine Fingers
OK thanks Leonie, I was looking at the angle of this being related to the temp directory instead of related to dataset or scratch. Could you check what you have this (TMPDIR) set to and verify space there during run time?
Mark
Mark Winter
<i>Nothing appeases a troubled mind more than <b>good</b> music</i>
Here is a tip to reduce the size of your lookup, perhaps then it will fit into the 512Mb block limit = remove the length specifications for VarChar fields.
Here is a tip to reduce the size of your lookup, perhaps then it will fit into the 512Mb block limit = remove the length specifications for VarChar fields.
That limit is set in the executable and can be modified (with ldedit on AIX) but I am sure that there are drawbacks to doing so, otherwise the limit would be set higher in all jobs.