Is there a limit for sequential file size ??

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
weiven
Participant
Posts: 5
Joined: Wed Oct 13, 2004 1:55 am

Is there a limit for sequential file size ??

Post by weiven »

Im trying to load a 23,222KB of sequential source file to the Oracle9i.
While running, it prompt me an error:

oraS_AGNTPF_VEN3,0: Export failed
oraS_AGNTPF_VEN3,0: write() failed: Broken pipe APT_CombinedOperatorController(1),0: Operator's runLocally() failed
APT_CombinedOperatorController(1),0: Operator terminated abnormally: runLocally did not return APT_StatusOk

**(which is not the connection problem)

so for tat, i try to minimize the file size 10 KB and it can load but i wanted to load a bigger file size.

Can anyone tell me about this?
weiven
tonystark622
Premium Member
Premium Member
Posts: 483
Joined: Thu Jun 12, 2003 4:47 pm
Location: St. Louis, Missouri USA

Post by tonystark622 »

The only limit for file sizes with DataStage the operating system file size limit.

Tony
ogmios
Participant
Posts: 659
Joined: Tue Mar 11, 2003 3:40 pm

Post by ogmios »

And it's usually 2Gb, 4Gb or even larger on the newer systems.

Maybe you're passing data that is larger than the defined lengths in DataStage?

Ogmios
In theory there's no difference between theory and practice. In practice there is.
sushanth
Participant
Posts: 18
Joined: Sat Oct 09, 2004 10:13 am
Location: Malaysia
Contact:

Re: Is there a limit for sequential file size ??

Post by sushanth »

Check the datatype size at source and target file
Sushanth
mandyli
Premium Member
Premium Member
Posts: 898
Joined: Wed May 26, 2004 10:45 pm
Location: Chicago

Post by mandyli »

HI

what is OS unix or NT. b'cus file size some time differ based on OS.

or if use Dataset for large no of Data.

please try it.


Thanks
Man
Post Reply