Datastage jobs running extremely slow

A forum for discussing DataStage<sup>®</sup> basics. If you're not sure where your question goes, start here.

Moderators: chulett, rschirm, roy

Post Reply
rumu
Participant
Posts: 286
Joined: Mon Jun 06, 2005 4:07 am

Datastage jobs running extremely slow

Post by rumu »

Hi All,

I have been observing for last 2 days that, our daily batch jobs have started taking longer than usual time. Normally as job that runs for 30 mins, now running for more than 2 hours. Our DB is Netezza, jobs that extracts from DB, are working normal but the other jobs where other datastage stages have been used, are running extremely slow. operation console shows that number of rows/sec has dropped to 1/10 th of the usual processing time.
Could you please shed any light on this?I checked tmp folders and space was no issue. Is server restart required?
Rumu
IT Consultant
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

I'd first ask what has changed. Note that this could be something in the environment, not necessarily within DataStage.

Performance changes such as this do not happen for no reason.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
rumu
Participant
Posts: 286
Joined: Mon Jun 06, 2005 4:07 am

Post by rumu »

Hi Ray,

Nothing has changed wrt Code. Till Friday, the execution was fine, slowness has been observed first on Saturday then on Sunday.
Only diff I saw that number of rows/sec decreased significantly.
What could be possible environmental issue that might cause this?

Any weekend maintenance application or network could be the issue?
Rumu
IT Consultant
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

Of course and there's no way for us to know, that's all on you and your organization to determine. We have routine "maintenance weekends" from our hosting company and of course there are backups and other resource intensive things going on as well. Be curious if things go back to "normal" today.
-craig

"You can never have too many knives" -- Logan Nine Fingers
rumu
Participant
Posts: 286
Joined: Mon Jun 06, 2005 4:07 am

Post by rumu »

No luck today. The same issue persists. Suddenly some of the jobs are running extremely slow. Looks like environmental issue. Can we check if any phantom processes are stuck and that consumes resources? How can we check that?
Rumu
IT Consultant
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

In your shoes I would not concentrate on just DataStage but look at the environment as a whole. Work with your infrastructure folks and system admins to determine what changed recently, see what if any work coincided with the start of your issue.

If you're worried about "stuck" processes and don't know if they exist or how to track them down, shutdown and restart DataStage. Heck, worst case shut it down and then have the sever rebooted. :wink:
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply