We are currently using Data loader script for loading into Salesforce (Upsert)and script takes an average of 5 minutes to finish the upsert operation of 10 objects .
We are replacing the Data loader scripts with SF pack load job for each object loading ,each job taking an average elapsed time of 1:20 (min:sec)..so overall for object it taking around 25 minutes
Here our job schedule runs are daily deltas with upsert operation (below log shows it has only 1 record with 6 fields for the operation)and rest of the objects also have about few hundred records only.
Code: Select all
5/29/2018 11:13:35 AM job_sf,0: Data batch size is set to: 10,000
--WHY THERE IS A DELAY HERE----
5/29/2018 11:14:11 AM job_sf,0: Information: Found a parent field Agency__r_ExternalID__c
Information: Found a parent field Principal_Number__r_ExternalID__c
Information: Wait for: 30 seconds
5/29/2018 11:14:11 AM bond_allocation_sf,0: Loading finished. 1 rows are loaded into Salesforce.com
5/29/2018 11:14:11 AM bond_allocation_sf,0: Loading finished. 0 rows are rejected
5/29/2018 11:14:12 AM main_program: Step execution finished with status = OK.
5/29/2018 11:14:20 AM main_program: Startup time, 0:22; production run time, 0:46.
Let me know any suggestions to reduce the job run time from current 25 minutes to lesser ?
Thanks.