DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
Developer9



Group memberships:
Premium Members, Heartland Usergroup

Joined: 14 Apr 2011
Posts: 172

Points: 2409

Post Posted: Tue May 29, 2018 9:50 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Hi Everyone,

We are currently using Data loader script for loading into Salesforce (Upsert)and script takes an average of 5 minutes to finish the upsert operation of 10 objects .
We are replacing the Data loader scripts with SF pack load job for each object loading ,each job taking an average elapsed time of 1:20 (min:sec)..so overall for object it taking around 25 minutes

Here our job schedule runs are daily deltas with upsert operation (below log shows it has only 1 record with 6 fields for the operation)and rest of the objects also have about few hundred records only.

Code:
5/29/2018 11:13:35 AM job_sf,0: Data batch size is set to: 10,000
--WHY THERE IS A DELAY HERE----
5/29/2018 11:14:11 AM job_sf,0: Information: Found a parent field Agency__r_ExternalID__c
Information: Found a parent field Principal_Number__r_ExternalID__c
Information: Wait for: 30 seconds
5/29/2018 11:14:11 AM bond_allocation_sf,0: Loading finished. 1 rows are loaded into Salesforce.com
5/29/2018 11:14:11 AM bond_allocation_sf,0: Loading finished. 0 rows are rejected
5/29/2018 11:14:12 AM main_program: Step execution finished with status = OK.

5/29/2018 11:14:20 AM main_program: Startup time, 0:22; production run time, 0:46.

After observing the startup time and production run time are there any environment variables to reduce the job elapsed time less than minute or 30 sec?or this is the usual elapsed time for sfpack jobs for this record count?

Let me know any suggestions to reduce the job run time from current 25 minutes to lesser ?

Thanks.
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 42762
Location: Denver, CO
Points: 220350

Post Posted: Tue May 29, 2018 5:34 pm Reply with quote    Back to top    

Exclamation New question = new post. FYI - I split this to its own discussion topic rather than leave it at the end of your previous SFDC post.

_________________
-craig

Research shows that 6 out of 7 dwarves aren't happy
Rate this response:  
Not yet rated
Developer9



Group memberships:
Premium Members, Heartland Usergroup

Joined: 14 Apr 2011
Posts: 172

Points: 2409

Post Posted: Wed May 30, 2018 8:07 am Reply with quote    Back to top    

Thank you craig Smile
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours