How to overcome SAS Parallel Data Set Stage Constraints

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
dhwankim
Premium Member
Premium Member
Posts: 45
Joined: Mon Apr 07, 2003 2:18 am
Location: Korea
Contact:

How to overcome SAS Parallel Data Set Stage Constraints

Post by dhwankim »

Hi Gurus.
Yesterdata, We has installed DataStage SAS relative Stoage (SAS Paralle Data Set Stage / SAS Stage).

After the installation. I made Sample Job with SAS Parallel Data Set Stage).

But The Problems is using file xxxx.psds and

Actual File Name and location is written in xxxx.psds Automatically.

PLS See Below.
Orchestrate SAS Dataset
LFile:
crmdm:/SAS/DATA/01/dwtft/dfibiz/sampesas.psds.212416.811013736.1076922129/sampesas.sas7bdat

But Your Need is defined sas file name and location manually (xxxxxx.sas7bdat)
Because of End User'll access xxxxx.sas7bdat in special directory.

So I want to how to define exact location and written sas file.


for additional information.

Actually I do not want use paralle processing for write this file.


Thanks In Advance.


Daehwan Kim
Last edited by dhwankim on Tue Feb 17, 2004 5:52 pm, edited 1 time in total.
Teej
Participant
Posts: 677
Joined: Fri Aug 08, 2003 9:26 am
Location: USA

Re: How to overcome SAS Parallel Data Set Stage Constraints

Post by Teej »

Uh...

DataStage Server jobs (which you indicated your job type to be) are not compatible with PX stages (which Orchestrate is).

Dataset is a PX concept, not Server. They partition over multiple nodes as defined by your job's $APT_CONFIG_FILE. Maybe there's an option within the stage to override $APT_CONFIG_FILE, but I do not recall of any stages capable of doing that. But basically, you have a header file, and a whole set of data files.

Please let us know whether you are using PX jobs, or Server jobs.

-T.J.
Developer of DataStage Parallel Engine (Orchestrate).
bigpoppa
Participant
Posts: 190
Joined: Fri Feb 28, 2003 11:39 am

How to overcome SAS Parallel Data Set Stage Constraints

Post by bigpoppa »

.psds files are parallelized SAS datasets that have been "PX"d. You can't use them with native SAS, only with PX. If you do not want a parallel dataset, write the output of the stage to the Sequential File stage and create the dataset as a regular UNIX file.

-BP
Post Reply