Column Analysis failing due to java heap space
Posted: Sun Oct 07, 2018 5:12 am
Hi experts,
Running on Windows system with 32 GB RAM, 8 CPUs and 4 node file.
We have a flat file with 96 columns needing to be analyzed.
When running on a sample of 20 records it runs incredibly slow, with only a few columns analyzed before eventually failing with "java.lang.OutOfMemoryError: Java heap space" error message.
What we have noticed also, is that in Director's log there is 10 jobs for 1 column analysis being run. Guessing that is what is making the process heavy.
Does anyone know how can we fix this?
Regards,
Novak
Running on Windows system with 32 GB RAM, 8 CPUs and 4 node file.
We have a flat file with 96 columns needing to be analyzed.
When running on a sample of 20 records it runs incredibly slow, with only a few columns analyzed before eventually failing with "java.lang.OutOfMemoryError: Java heap space" error message.
What we have noticed also, is that in Director's log there is 10 jobs for 1 column analysis being run. Guessing that is what is making the process heavy.
Does anyone know how can we fix this?
Regards,
Novak