A common misconception about PX is that it has some control over an operating system's scheduler. However, PX only invokes parallel instances of processes; it allows the OS scheduler to schedule the processes on the CPUs.
For example, if a 4-way PX configuration file is set, in general, PX will schedule 4 parallel instances of each parallel stage in a job. You may notice several processes prefixed with "APT" when you are monitoring a PX job on a UNIX system. Some of these processes are the parallel instances of the job's stages.
Some PX stages, such as 'generator', are set to run sequentially by default. PX does not invoke parallel instances of these stages, and all of the data that needs to be processed by a sequential stage must be collected before that stage can process any data.
did you know? PX does not manipulate the OS scheduler
Moderators: chulett, rschirm, roy
-
- Participant
- Posts: 54607
- Joined: Wed Oct 23, 2002 10:52 pm
- Location: Sydney, Australia
- Contact: