Performance issue

Post questions here relative to DataStage Server Edition for such areas as Server job design, DS Basic, Routines, Job Sequences, etc.

Moderators: chulett, rschirm, roy

Post Reply
reddy
Premium Member
Premium Member
Posts: 168
Joined: Tue Dec 07, 2004 12:54 pm

Performance issue

Post by reddy »

Hello sir,

I am loading 12 million records of a mainframe COBOL file having 800 record length into a Oracle 9i table.
In that file we have lot of comp3 fields and comp fields.In the transformer i used data type convertions to split into columns.
Every thing looks good.
But i am getting performance issues.
I tested with Oracle normal and bulk loads.It is taking around 81/2 hours.
Can you please help me out on this performance issue.

Thanks in advance.

Reddy
ArndW
Participant
Posts: 16318
Joined: Tue Nov 16, 2004 9:08 am
Location: Germany
Contact:

Post by ArndW »

What is the bottleneck? Is your CPU for the transform stage at 90% or higher? Is Oracle on the same machine? If not, what is the network throughput capacity at?
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Try using a Complex Flat File stage to read the file. It will decode the COMP and COMP-3 fields for you, faster than the Transformer stage can do it.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply