CLOB issues

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
asaf_arbely
Premium Member
Premium Member
Posts: 87
Joined: Sat Jul 14, 2007 2:24 pm

CLOB issues

Post by asaf_arbely »

Hi
I need to move 2.5 million records per day from one oracle DB to another oracle DB.
The source and target table are the same
The tables have 3 CLOB fields all of them must move to the targent
After reading the forum and IBM docs I defined a parallel job with 2 oracle connectors. The only way I can make the job to run is by keeping only one CLOB column
But still the job runs in an outrageous rate (20 rps)
So I have 2 questions:
1. How can I load more than one CLOB in the same process?
2. How can I increase the processing rate?

Thanks
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Bottom line is CLOBs are not supported. What happens when there is more than one CLOB in your job? Have you try setting your Array Size to 1? I'd suggest looking into other tools... pl/sql perhaps? Have a chat with your DBA and see what ideas they have.
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

As far as I know, DataStage doesn't do anything magical with CLOBs so not really sure what "moves in a different section" might mean. Regardless, you've been asked for a solution using a tool that doesn't support CLOBs. Have you checked with your official support provider, passed along that error, seen if they have any suggestions? I think you are out of luck but you never know...
-craig

"You can never have too many knives" -- Logan Nine Fingers
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You might want to google for "ORA-03127", looks like it is an Oracle client / sqlnet issue where *it* rather than DataSTage may be doing something multi-threaded (which may line up with your "different section" thought) and failing in that attempt. From what I saw, upgrading your Oracle client may help.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply