Parallel Extender - User Defined SQL in Parallel Job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
seell
Participant
Posts: 22
Joined: Fri Nov 07, 2003 9:46 pm

Parallel Extender - User Defined SQL in Parallel Job

Post by seell »

hi
I was used to DataStage V6 but now introduced to DataStage V7.0 - parallel extender as we require speed during data loading.

Noticed that there are 2 types of jobs : Server and Parallel; while the server job seems to operate in the same manner as in V6, the parallel version seems different.

The manual recommends to use Write method = load' when loading data to Oracle. What if I need to use 'user defined SQL' ?? In my case, one of the target fields is an oracle sequence.

Thank you
battaliou
Participant
Posts: 155
Joined: Mon Feb 24, 2003 7:28 am
Location: London
Contact:

User Defined SQL

Post by battaliou »

We had a similar issue loading data to Oracle in parallel. This is best done outside of datastage. If you are planning to use a sequence, you will have to collect your data into a single sequential text file else the sequence number generator can get quite tricky.

Remember you will need to generate a feeder id. This is the fastest method of loading data into Oracle.
Someswar Barkataki
Participant
Posts: 6
Joined: Tue Jul 13, 2004 7:40 am

Post by Someswar Barkataki »

Instead of "Load", select Write Method as "Upsert" and choose User-defined Update & Insert as the upsert mode. Now edit the Insert query as per your requirement.

Hope this helps,
Thanks,
Somesh
Post Reply