DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
Ramkrish2801
Participant



Joined: 05 Jun 2019
Posts: 4

Points: 66

Post Posted: Wed Jun 26, 2019 9:45 am Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Windows
Additional info: Required DS job level solution(how is it happening)
Hi All,
I am facing the same issue as seen here.

I am using Windows OS and AIX server ,I have also added below user-defined properties:
DSForceTerminate=1
DSWaitShutdown=60 .

But still the defunct process are being created more than 300 daily and got removed after 2 hours.

kindly help me out how to stop that and any other ways to solve this issue...?

Any help can be appreciated...

Thanks,
Ram
UCDI



Group memberships:
Premium Members

Joined: 21 Mar 2016
Posts: 382

Points: 3946

Post Posted: Wed Jun 26, 2019 1:16 pm Reply with quote    Back to top    

we only ever get them when a job crashes hard and leaves a thread outstanding. I would advise focus on finding out why you have such a high number of them -- see if its one or three or whatever small # of specific jobs doing most of it, maybe -- and work it from that angle. I don't know if this can be a symptom of an overloaded server, or something like that...?
Rate this response:  
Not yet rated
Ramkrish2801
Participant



Joined: 05 Jun 2019
Posts: 4

Points: 66

Post Posted: Mon Jul 01, 2019 3:47 am Reply with quote    Back to top    

Hi bro,

Thanks for your great help.I started finding how it s created that much count from job level as you advised....But i cannot able to find how the defunct process or parent/child process defined or works based on job level..

Kindly can you advise me on this how can I debug from job level...

Thanks,
Ram
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 43072
Location: Denver, CO
Points: 222401

Post Posted: Mon Jul 01, 2019 8:33 am Reply with quote    Back to top    

Ramkrish2801 wrote:
Note: I have also posted this issue freshly under the topic "Orphan and defunct processes are left by InfoSphere DataStage but i didnt got any response yet.

I let this play out for a little but that's not a reason to go jump on an old post, so I've moved you back into your own conversation. Also deleted the one with no replies. Best advice would be to simply reply to your own post to bump it back up to the top and, if you find a relevant old post, link to it like I did above.

If you are having problems associating the zombie/defunct processes with the jobs causing them (are jobs crashing or just leaving these behind?) involve your official support provider while you work on it here.

_________________
-craig

"You can never have too many knives" -- Logan Nine Fingers
Rate this response:  
Not yet rated
chulett

Premium Poster


since January 2006

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 12 Nov 2002
Posts: 43072
Location: Denver, CO
Points: 222401

Post Posted: Mon Jul 01, 2019 8:44 am Reply with quote    Back to top    

Ramkrish2801 wrote:
I am using Windows OS and AIX server

Sorry, just noticed this. Everyone is using Windows for their clients so there's no need to mention that if that's what you meant. The OS tag when you start a post is meant for the operating system of your server(s). Keep that in mind when searching as the post you found was for Windows servers, hence the conversation around the MKS Toolkit and the issues that it brought to the table. FYI. So AIX tuning / kernel parameters or capacity could be part of your problem here.

Other thoughts... how long has this problem been going on? Meaning, have you been running jobs just fine for some time and then suddenly this started happening, or this is a new server and you've been fighting this since it was stood up? That answer can help narrow down where you go to start looking for the why behind all this... this rather than at the "job level", although that could certainly be a factor.

_________________
-craig

"You can never have too many knives" -- Logan Nine Fingers
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours