Multi Instances not able to view in director

manojbh31 · Post by **manojbh31** » Thu Jun 11, 2015 1:22 pm

Hi All,

I have a multi instance job which creates around 67 Instances, after sequence is completed, all the instances are vanished? what setting i need to do at Admin level. Can anybody help on this please.

chulett · Post by **chulett** » Thu Jun 11, 2015 2:42 pm

What are your auto purge settings for the job?

kduke · Post by **kduke** » Thu Jun 11, 2015 7:33 pm

Craig is right. Only auto purge clears them out or compiling a job. So change your settings.

manojbh31 · Post by **manojbh31** » Mon Jun 15, 2015 12:32 pm

Hi Craig,

Sorry for late reply, Admin level setting for auto purge logs is previuos 2 runs. How to handle this scenario without changing this setting.

PaulVL · Post by **PaulVL** » Mon Jun 15, 2015 1:22 pm

You don't.

You need to change the setting to 2 days or 3 days to be safe.

Having a 2 instance setting on a multi instance job is very bad. It often leads to job failures. You basically can only have 2 itterations running at the same time. If you spun up #3 while #1 & 2 are running... #1 job will fail upon it's next attempt to write to the log. (guessing a BLINK error).

manojbh31 · Post by **manojbh31** » Mon Jun 15, 2015 1:43 pm

Hi Paul,

But i see issue when i running this in production, If i have monthly or weekly jobs then i cannot see logs for other jobs if this is set to 2 or 3 days.

PaulVL · Post by **PaulVL** » Mon Jun 15, 2015 2:03 pm

Job log auto purging only happens when the job executes (or write activity to the log).

You can have a 2 day purge setting and have a log sit there for months. Upon it's next execution, it will kick off the log purge process.

But yes, I do see your point. You want the ability to have a 2 itteration retention, yet for multi instance jobs you want X amount of days.

Pick one.

I do not believe you can override the setting at a job level.

I would pick the 3 day retention method.

manojbh31 · Post by **manojbh31** » Mon Jun 15, 2015 2:15 pm

Hi Paul,

I found below info from IBM website, Does below fix will resolve my issue.

Problem summary
****************************************************************
USERS AFFECTED:
Customers using Auto-Purging that require failed jobs to not be
purged so that the status can be investigated.
****************************************************************
PROBLEM DESCRIPTION:
When Auto-pugring is in use, all instances of a job will be
purged, without checking for the success or fail status.
****************************************************************
RECOMMENDATION:
This change is included in 8.0.1 Fix Pack 2.
****************************************************************

Problem conclusion
The Auto-Purge functionality has been enhanced so that jobs
which have failed do not have their Status or Log records
removed, so that subsequent evaluation of the failure can
occur. This is enabled by adding an environment variable for the
relevant project in the DataStage Administrator.
DS_LOG_AUTOPURGE_IGNORE_STATUS should contain a comma-separated
list of the status codes to ignore. A failed job has a status of
3, so the default value of this environment should be 3. By
default this environment variable will not exist and will have
no impact on existing Auto-Purge logic. The variable should be
added in the User-defined section and is likely to slow the
operation of the Auto-purge code when a job completes. Job Logs
& Status can still be completely cleared from the DataStage
Director.

chulett · Post by **chulett** » Mon Jun 15, 2015 3:22 pm

I don't think it's related at all but why don't you give it a shot and let us know?

ray.wurlod · Post by **ray.wurlod** » Mon Jun 15, 2015 6:23 pm

Just to clarify, by default job log auto purge only occurs when the job finishes WITHOUT FAILURE.

If the job aborts, crashes or is stopped, no entries are purged from the job log.

manojbh31 · Post by **manojbh31** » Tue Jun 16, 2015 7:39 am

Hi Ray,

I found one more option, in clear log in director where i can set to Auto Purge to older than a day or 2, I tested this and it worked fine. I have couple of questions on this

1) Does this option will be retained if i compile this job
2) If i migrate this job into other env, will this option retained or i need to set to auto purge in director when the code goes to other env.
3) Will this option helpful to work on or will i face any issues if this code is moved into production.
4) Is there any parameter to suppress the project level setting at the job level.

ArndW · Post by **ArndW** » Tue Jun 16, 2015 7:52 am

The purge settings set specifically for a job remain even when editing and compiling a job. The purge settings are not exported with a job and thus won't be imported into another project.
Not setting purge value defaults at a project level has very often caused incredibly slow performance.
If you specifically set the purge settings on a job the project level attributes are overwritten. so if turn off auto-purge on a job then any project-level purging is disabled.