Long delay between 2 jobs being executed in a Sequence job

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
AGStafford
Premium Member
Premium Member
Posts: 30
Joined: Thu Jan 16, 2003 2:51 pm

Long delay between 2 jobs being executed in a Sequence job

Post by AGStafford »

I have a simple 3 job Sequencer that runs 3 Parallel jobs in order.
Between the second and third job running there has been a delay that goes from a minute, to up to 40 minutes.
During this time the AIX box is fairly free, but still there is a long delay between one job ending and the next job starting.
I can see the Sequencer process running, not using any significant CPU and nothing else going on.

Does anyone have any idea what might be going on, or what I am doing wrong?
I am not sure Checkpointing a run should take 40 minutes.

Here are the 3 log messages found in the Sequencer Job log:
2/4/2014 8:34:55 AM - cCidDW031_400_ILS_Source_To_Dim_Processing..JobControl (DSWaitForJob): Waiting for job jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups.Andrew_Run to finish
2/4/2014 8:38:11 AM - cCidDW031_400_ILS_Source_To_Dim_Processing..JobControl (DSWaitForJob): Job jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups.Andrew_Run has finished, status = 2 (Finished with warnings)
2/4/2014 9:21:15 AM - cCidDW031_400_ILS_Source_To_Dim_Processing..JobControl (@jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups): Checkpointed run of job 'jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups.Andrew_Run'
2/4/2014 9:21:15 AM - cCidDW031_400_ILS_Source_To_Dim_Processing..JobControl (@jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups): Report on job: jCidDW031_402_FACT_ILS_ILCB101C_CIS_A65528D_X65530D_Ref_Lookups.Andrew_Run
2/4/2014 9:21:15 AM - cCidDW031_400_ILS_Source_To_Dim_Processing..JobControl (@jCidDW031_410_FACT_ILS_PostLookup_to_Dim_DimIls_FactIls): jCidDW031_410_FACT_ILS_PostLookup_to_Dim_DimIls_FactIls
asorrell
Posts: 1707
Joined: Fri Apr 04, 2003 2:00 pm
Location: Colleyville, Texas

Post by asorrell »

Usually this means that the second job has some sort of after-job or after-sql running. The job will show "complete" (green) but it is still running the "after" procedure. Once that completes, it proceeds.
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
Post Reply