What is scratchdisk?

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
adityaram
Participant
Posts: 14
Joined: Mon Oct 11, 2004 10:01 am

What is scratchdisk?

Post by adityaram »

Hi,
Im a newbie to the scratchdisk concept. Can someone pl. tell me how it functions.
Thanks in advance.
AR
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

"Scratch disk" is a term that means disk space used temporarily for whatever function might be required, for example to capture the output of a command or query, temporary storage of heaps for sorting, and so on.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Sometimes called temp space or swap space. In Universe it is defined by UVTEMP.
Mamu Kim
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Swap space is actually something different. Swap space is disk used for memory pages that are not presently in use.

Temp space pointed to be UVTEMP is only relevant for server jobs. In parallel jobs separate scratch space is allocated for each processing node in the configuration file under which the job runs.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Ray

I know swap space is not the same as UVTEMP but it is sometimes called scatch space. It functions in a similar manor as UVTEMP for the OS. UNIX also uses /tmp for scatch or temp space.
Mamu Kim
kaziz
Participant
Posts: 1
Joined: Sat Oct 25, 2003 12:30 am
Location: Northern Virginia

Re: What is scratchdisk?

Post by kaziz »

adityaram wrote:Hi,
Im a newbie to the scratchdisk concept. Can someone pl. tell me how it functions.
Thanks in advance.
AR
kaziz wrote: scratchdisk is a term came from Torrent's Orchestrate now Datastage's Parallel Extender. It is the disk space set aside for operation such as sorting or hashing data while processing.
It is defined in configuration file for PX. Orchdisk is permanent disk space such as for datasets. Whereas scratch is not persistent, it is temporary.
Usually on MPP systems these are not NFS mounted, so each node has its own Scratchdisk space.
See APT_CONFIG_FILE env variable pointing to configuration file. Look for scratchdisk defined in node stanza.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The term "scratch disk" has been around since at least 1968. Well before Torrent was even imagined. We had some on an IBM 360/20 at that time.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
T42
Participant
Posts: 499
Joined: Thu Nov 11, 2004 6:45 pm

Post by T42 »

Is that the sound of your fingers creaking, Ray? :lol:

Bear in mind -- "scratchdisk" (as seen in your configuration file) is totally separate from "disk" -- Datasets disks, which are used exclusively for... Datasets!
Post Reply