Configuration File - Scratchdisk allocation

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
PeteM
Premium Member
Premium Member
Posts: 19
Joined: Thu Dec 15, 2011 8:50 am
Location: uk

Configuration File - Scratchdisk allocation

Post by PeteM »

Below is the current configuration file that has the RAM disk as the first entry in the scratch disk resource pool.

For some reason data stage is using the hard disk entries (/opt/scratch1, /opt/dataset2/scratch, etc.) first and then once they are fully utilised, the RAM disk is being used.

Can anyone state how to amend the configuration entries to ensure that the RAM disk is used first?

Code: Select all

        node "node1"
        {
                fastname "baspc234u1"
                pools ""
                resource disk "/opt/dataset1" {pools ""}
                resource disk "/opt/dataset2" {pools ""}
                resource disk "/opt/dataset3" {pools ""}
                resource disk "/opt/dataset4" {pools ""}
                resource disk "/opt/dataset5" {pools ""}
                resource scratchdisk "/ramdisks/ramdisk0" {pools ""}
                resource scratchdisk "/opt/scratch1" {pools ""}
                resource scratchdisk "/opt/dataset1/scratch" {pools ""}
                resource scratchdisk "/opt/dataset2/scratch" {pools ""}
                resource scratchdisk "/opt/dataset3/scratch" {pools ""}
                resource scratchdisk "/opt/dataset4/scratch" {pools ""}
                resource scratchdisk "/opt/dataset5/scratch" {pools ""}
        }
        node "node2"
        {
                fastname "baspc234u1"
                pools ""
                resource disk "/opt/dataset2" {pools ""}
                resource disk "/opt/dataset3" {pools ""}
                resource disk "/opt/dataset4" {pools ""}
                resource disk "/opt/dataset5" {pools ""}
                resource disk "/opt/dataset1" {pools ""}
                resource scratchdisk "/ramdisks/ramdisk0" {pools ""}
                resource scratchdisk "/opt/scratch1" {pools ""}
                resource scratchdisk "/opt/dataset2/scratch" {pools ""}
                resource scratchdisk "/opt/dataset3/scratch" {pools ""}
                resource scratchdisk "/opt/dataset4/scratch" {pools ""}
                resource scratchdisk "/opt/dataset5/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset1/scratch" {pools ""}
        }
        node "node3"
        {
                fastname "baspc234u1"
                pools ""
                resource disk "/opt/dataset3" {pools ""}
                resource disk "/opt/dataset4" {pools ""}
                resource disk "/opt/dataset5" {pools ""}
                resource disk "/opt/dataset1" {pools ""}
                resource disk "/opt/dataset2" {pools ""}
                resource scratchdisk "/ramdisks/ramdisk0" {pools ""}
                resource scratchdisk "/opt/scratch1" {pools ""}
                resource scratchdisk "/opt/dataset3/scratch" {pools ""}
                resource scratchdisk "/opt/dataset4/scratch" {pools ""}
                resource scratchdisk "/opt/dataset5/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset1/scratch" {pools ""}
                resource scratchdisk "/opt/dataset2/scratch" {pools ""}
        }
        node "node4"
        {
                fastname "baspc234u1"
                pools ""
                resource disk "/opt/dataset4" {pools ""}
                resource disk "/opt/dataset5" {pools ""}
                resource disk "/opt/dataset1" {pools ""}
                resource disk "/opt/dataset2" {pools ""}
                resource disk "/opt/dataset3" {pools ""}
                resource scratchdisk "/ramdisks/ramdisk0" {pools ""}
                resource scratchdisk "/opt/scratch1" {pools ""}
                resource scratchdisk "/opt/dataset4/scratch" {pools ""}
                resource scratchdisk "/opt/dataset5/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset1/scratch" {pools ""}
                resource scratchdisk "/opt/dataset2/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset3/scratch" {pools ""}
        }
        node "node5"
        {
                fastname "baspc234u1"
                pools ""
                resource disk "/opt/dataset5" {pools ""}
                resource disk "/opt/dataset1" {pools ""}
                resource disk "/opt/dataset2" {pools ""}
                resource disk "/opt/dataset3" {pools ""}
                resource disk "/opt/dataset4" {pools ""}
                resource scratchdisk "/ramdisks/ramdisk0" {pools ""}
                resource scratchdisk "/opt/scratch1" {pools ""}
                resource scratchdisk "/opt/dataset5/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset1/scratch" {pools ""}
                resource scratchdisk "/opt/dataset2/scratch" {pools ""}                
                resource scratchdisk "/opt/dataset3/scratch" {pools ""}
                resource scratchdisk "/opt/dataset4/scratch" {pools ""}
        }
Thanks
PeteM
Mike
Premium Member
Premium Member
Posts: 1021
Joined: Sun Mar 03, 2002 6:01 pm
Location: Tampa, FL

Post by Mike »

Try putting your ramdisk into its own non-default pool.

Mike
PaulVL
Premium Member
Premium Member
Posts: 1315
Joined: Fri Dec 17, 2010 4:36 pm

Post by PaulVL »

According to IBM, I would have expected your ram disk to be targeted first, then it would spill over to the other scratch disk entries.



http://www-01.ibm.com/support/docview.w ... wg21651831


Does your job execution user id have rwx access to that ram disk path?
PeteM
Premium Member
Premium Member
Posts: 19
Joined: Thu Dec 15, 2011 8:50 am
Location: uk

Post by PeteM »

thanks for the reply
Thanks
PeteM
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

So... what was the resolution?
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply