DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
This topic has been marked "Resolved."
Author Message
syedmuhammedmehdi
Participant



Joined: 12 Feb 2014
Posts: 42
Location: Hyderabad, India
Points: 395

Post Posted: Mon Sep 25, 2017 9:00 am Reply with quote    Back to top    

DataStage® Release: 9x
Job Type: Parallel
OS: Unix
Hi, I'm loading 21 million records in a Oracle table and it is taking around 1 hr 30 Minutes to load using Oracle Connector. I used Bulk Load as well as Insert Mode in Oracle. Surprisingly, in both modes Bulk as well as Insert Mode job is taking same time to load. More surprisingly Bulk mode is taking more time. Could you please advise what might be wrong in bulk mode?

_________________
SyedMuhammadMehdi
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42269
Location: Denver, CO
Points: 217036

Post Posted: Mon Sep 25, 2017 9:45 am Reply with quote    Back to top    

Are you certain it's actually performing a direct path bulk load? Without that specified and without meeting all requirements, sqlldr does conventional inserts.

_________________
-craig

Watch out where the huskies go and don't you eat that yellow snow
Rate this response:  
Not yet rated
syedmuhammedmehdi
Participant



Joined: 12 Feb 2014
Posts: 42
Location: Hyderabad, India
Points: 395

Post Posted: Mon Oct 09, 2017 9:33 am Reply with quote    Back to top    

Thanks Chulett for reply.Actually, after some debugging I came to know that there was no slowness caused by bulk load but before Oracle Connector I was using transformer in which I was calling Oracle Sequencer for surrogate key generator which was actually causing slowness. So, I removed surrogate key generation from transformer and used simple insert statement (without bulk load) in oracle connector with surrogate key next val.

_________________
SyedMuhammadMehdi
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours