How to collect job status

sjordery · Post by **sjordery** » Thu May 10, 2007 7:40 am

Hi all,

I have a job which is sending data from a file to target.
After the job run I need to maintain a stastics table which should contain the following information.

1-file name
2-job name
3-start date
4-no of records processed
5-no of records rejected

can anybody suggest how to acheive this.

mctny · Post by **mctny** » Thu May 10, 2007 8:05 am

Yes, searh in this forum and Ray answered this questions many times

sjordery · Post by **sjordery** » Thu May 10, 2007 9:17 am

Hi Cetin,

Thanks.
How ever I tried to search the forum,but nt able to get the exact solution.
Can you please send me the exact search keyword for this.

mctny · Post by **mctny** » Thu May 10, 2007 9:26 am

use keywords "job stats" or ETLstats

sjordery · Post by **sjordery** » Fri May 11, 2007 7:16 am

Hi I tried to collect the job stastics using a script.

This is the script which I have used to run the job and collect one stastics no of rows passing through a link.

#! /usr/bin/sh
dshome=`cat /.dshome`;
export dshome
PATH=$PATH:$dshome/lib;
export PATH
. $dshome/dsenv
dsjob -run Phase1 test_job
link = DSGetLinkInfo(test_job, "Transformer_2","DSLink4",DSJ.LINKROWCOUNT)

echo $link

while running the script I am geting the error mentioning invalid command.

can anybody suggest?

DSguru2B · Post by **DSguru2B** » Fri May 11, 2007 7:24 am

sjordery wrote: link = DSGetLinkInfo(test_job, "Transformer_2","DSLink4",DSJ.LINKROWCOUNT)

Thats a DataStage API function. It will not work at the OS level. Read about DSGetLinkInfo in DataStage help.
Search the archives on how to use it in a basic batch job or routine.

sjordery · Post by **sjordery** » Fri May 11, 2007 7:41 am

Ok is there any other option to collect the job statistics in the unix script.
Please suggest.

DSguru2B · Post by **DSguru2B** » Fri May 11, 2007 8:12 am

Ofcourse there is. You will have to spit out the entire log file to a text file and then use your unix scripting skills to parse through the log file to get all the information you need.

ray.wurlod · Post by **ray.wurlod** » Fri May 11, 2007 3:23 pm

Use dsjob with the -report option.

sjordery · Post by **sjordery** » Sun May 13, 2007 10:28 pm

As I have mentioned I also have to collect the no of rows passing through a particular link plus some other statistics like start date,end date of the job.
So will this -report option in dsjob help me to collect the above stastics about the job please suggest?

ray.wurlod · Post by **ray.wurlod** » Sun May 13, 2007 10:59 pm

It will help, as will the -stageinfo and -linkinfo options. To use these effectively in a script you probably also need the -lstages and -llinks options also.

sjordery · Post by **sjordery** » Sun May 13, 2007 11:46 pm

thanks ray.Can you please send me the exact syntax I have to specify in the script .

ray.wurlod · Post by **ray.wurlod** » Mon May 14, 2007 1:06 am

No. Because I would have to guess, even what scripting language you are using.

Type dsjob alone to get the overall syntax. Then type dsjob with any of the options to get more information, for example dsjob -linkinfo to learn the remainder of the syntax to be used with this particular option.

You need to build a loop based on the output of -lstages to iterate through the stages, then an inner loop based on the output of -llinks to get the values you need from the -linkinfo option. Within the loop you need to parse out the values returned by that option.

It would be so much easier to use ETLstats.