Paralell Extender Configuration

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
datastagedummy
Participant
Posts: 56
Joined: Thu Feb 13, 2003 6:08 pm
Location: USA

Paralell Extender Configuration

Post by datastagedummy »

I am trying to code my first Paralell job what I am trying to do is simply read from a flat file and write out to a flat file.

The job is simply 2 Sequential File Stages and one transformer stage.

When I try to view data I get the following warning message from the DataStage Repository Interface

"No rows were returned from the View Data server commnad.
Would you like to view the command's output?"

When I press Yes below is the message that shows up

Any configuration help is welcome - Thanks everybody.

##I TFCN 000000 21:57:49(000) <main_program>
DataStage XE Parallel Extender V6.0.1
Copyright (C) 1997 - 2002 Ascential Software, Inc.
All Rights Reserved


##I TUTL 001002 21:57:49(001) <main_program> The open files limit is 100; raising to 2048.
##I TOSH 000010 21:57:49(002) <main_program> orchgeneral: loaded
##I TOSH 000010 21:57:49(003) <main_program> orchsort: loaded
##I TOSH 000010 21:57:49(004) <main_program> orchstats: loaded
##I TFSC 000000 21:57:49(005) <main_program> APT configuration file: /opt/Ascential/DataStage/Configurations/default.apt
##W TFPA 000002 21:57:49(006) <main_program> Warning: the value of the PWD environment variable (/) does not appear to be a synonym for the current working directory (/export/interface/etldata/CMIS/project). The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system.
##W TFIG 000514 21:57:50(000) <Sequential_File_0.DSLink2,0> Input buffer overrun at field "SOURCE_FILE_NAME", at offset: 149
##W TOIX 000059 21:57:50(001) <Sequential_File_0.DSLink2,0> Import warning at record 0:
##W TOIX 000060 21:57:50(002) <Sequential_File_0.DSLink2,0> Import unsuccessful at record 0:
##W TFIG 000514 21:57:50(003) <Sequential_File_0.DSLink2,0> Input buffer overrun at field "SOURCE_FILE_NAME", at offset: 143
##W TOIX 000059 21:57:50(004) <Sequential_File_0.DSLink2,0> Import warning at record 1:
##W TOIX 000060 21:57:50(005) <Sequential_File_0.DSLink2,0> Import unsuccessful at record 1:
##W TFIG 000514 21:57:50(006) <Sequential_File_0.DSLink2,0> Input buffer overrun at field "SOURCE_FILE_NAME", at offset: 143
##W TOIX 000059 21:57:50(007) <Sequential_File_0.DSLink2,0> Import warning at record 2:
##W TOIX 000060 21:57:50(008) <Sequential_File_0.DSLink2,0> Import unsuccessful at record 2:
##I TOIX 000032 21:57:50(009) <Sequential_File_0.DSLink2,0> Import complete. 0 records imported successfully, 3 rejected.
**VIEWDATA ROW LIMITER HIT**
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

Where did you get the definitions? Do they match the file? PX is very picky about definitions. Are you absolutely positive that the file definitions are correct, you have the right delimiter, quote character, number of columns defined, data types correct, widths and scaling, etc.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
datastagedummy
Participant
Posts: 56
Joined: Thu Feb 13, 2003 6:08 pm
Location: USA

Post by datastagedummy »

I am using the same file with the same table definition on a server job and it works fine.

Is there any special precaution to take while importing a Server Job Table Defn into a Paralell Job ?

Thanks
kcbland
Participant
Posts: 5208
Joined: Wed Jan 15, 2003 8:56 am
Location: Lutz, FL
Contact:

Post by kcbland »

The PX definition is more rigidly enforced. Server jobs don't attempt to data type verify or check widths, etc. So, PX jobs will have issues with non-conforming data.

Start small, take the first row from the sequential file and create a new one-row file. Try viewing that file and see if it works. If not, massage the row until you can view it. Then, you'll find what the problem is.
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
datastagedummy
Participant
Posts: 56
Joined: Thu Feb 13, 2003 6:08 pm
Location: USA

Re: Paralell Extender Configuration

Post by datastagedummy »

Thanks KC will try that.

Would you know what this message means ?

##W TFPA 000002 21:57:49(006) <main_program> Warning: the value of the PWD environment variable (/) does not appear to be a synonym for the current working directory (/export/interface/etldata/CMIS/project). The current working directory will be used, but if your ORCHESTRATE job does not start up correctly, you should set your PWD environment variable to a value that will work on all nodes of your system.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Do a search for PWD. This has come up before.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply