ETLstats

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

ETLstats

Post by ray.wurlod »

Kim Duke's utility ETLstats is now also hosted on OneDrive and can be accessed from here - you should not use right click initially (as it will try to save a redir HTML).

Download both ETLstats.zip and Scripts.zip from the OneDrive folder.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Mamu Kim
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I think there is too much stuff in EtlStats. I am working on a EtlStatsLite version. Hopefully my new boss will let me post the bare minimum to get row counts in tables. If not then I can walk you thru it. Hopefully Ray will add it to the downloads. Let you know when I am done.

If interested then post a reply. I think all I need is 2 jobs and 3 routines. Just create tables, import jobs, compile and run.
Mamu Kim
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Won't be a problem to host.

Now if only I could find the time to put the rest of my website together!
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

I think that's a great idea, Kim. A 'lite' version could be an awesome framework for others to expand on as needed.
-craig

"You can never have too many knives" -- Logan Nine Fingers
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I will not be able to post my solution. So it is very simple. All you need is the DsJobReport job and the Driver job that goes with it. Rename the jobs EtlGetRowCounts and EtlGetRowCountsDriver. Next get rid of KimD\ all the paths. Get rid of the hashed files. Get rid of the lookup for job status description. There is a routine to give the job status description. So now all you need 3 routines. 2 routines to fix elapsed time and elapsed seconds. You don't need these if you trust what is in the XML file. The other routine is the job status description one already described.

EtlStatsLite, someone do this and zip it up and give to Ray.

Thanks Kim.
Mamu Kim
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

I noticed that where you get link name and row counts is different in PX jobs. You need to import the XML. Load the new Xpaths to get to instanceLinkName and instanceRowCount. You need to change the repeating element to the new link name above. Now you need to add stage name. You have to sort by stage name and the new link name. Then you need to aggregate all the instance row counts. You need to add stage name to the ETL_ROW_HIST table.

Post if you get it working.
Mamu Kim
abdullah159
Participant
Posts: 1
Joined: Tue Jul 22, 2014 6:53 am

Post by abdullah159 »

Good day,
i wanted to get the files of ETLStats but the website is down for now.
can anybody share the file if possible :D
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Just worked fine for me. Note that "Under Construction" is not the same as "down". :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
johnboy3
Premium Member
Premium Member
Posts: 52
Joined: Fri Jun 19, 2015 2:48 pm
Location: Jackson, MS, USA

Not working; seems to be problem on page?

Post by johnboy3 »

I tried. Got msg saying try to turn on TLS this, TLS that, etc.

I guess our security just will not let me access it.

What a shame. It looks useful!
john3
john3
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

You can't get to his site or you can't get to his OneDrive file area?
-craig

"You can never have too many knives" -- Logan Nine Fingers
johnboy3
Premium Member
Premium Member
Posts: 52
Joined: Fri Jun 19, 2015 2:48 pm
Location: Jackson, MS, USA

Post by johnboy3 »

Got to his site fine. Tried IE and FF browsers. Both refuse link to zip file.
Error seems to indicate TLS trouble?
john3
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
johnboy3
Premium Member
Premium Member
Posts: 52
Joined: Fri Jun 19, 2015 2:48 pm
Location: Jackson, MS, USA

Post by johnboy3 »

MESSAGE IN FF:
Secure Connection Failed

An error occurred during a connection to onedrive.live.com. SSL received a record that exceeded the maximum permissible length. Error code: SSL_ERROR_RX_RECORD_TOO_LONG

The page you are trying to view cannot be shown because the authenticity of the received data could not be verified.
Please contact the website owners to inform them of this problem.
john3
----------------------------------------------------
InfoSphere 8.5.0.2; DataStage 8.5.0.0; OS-RHEL 6.6; DB-Oracle Enterprise Edition 11g (11.2.0.4)
asorrell
Posts: 1707
Joined: Fri Apr 04, 2003 2:00 pm
Location: Colleyville, Texas

Post by asorrell »

Kim's website is dead. Only way to get the routines is from Ray Wurlod's site...

http://www.raywurlod.com/
Andy Sorrell
Certified DataStage Consultant
IBM Analytics Champion 2009 - 2020
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

A lot of those jobs are so old they do not import any more. I need to build a 8.5 or even 11.5 version so they still work. The OPSDB obsoleted most of it. So I have not updated them.
Mamu Kim
Post Reply