DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
ariear
Participant



Joined: 26 Dec 2002
Posts: 237

Points: 834

Post Posted: Fri Nov 28, 2003 5:53 pm Reply with quote    Back to top    

DataStage® Release: 5x
Job Type: Server
OS: Windows
Additional info: can be any version/os
Hi ALL,
It appears that in some situations DataStage server processes becomes zoombies. It's quite difficult to reproduce this problem (Even with Ascential support) but maybe there's an answear somewhere ???!!!
It can happen on any platform but mostly on W2K.
If a job that has a large write cache enabled is stopped (VIA director) in the middle of fulshing its buffers (It can be seen VIA monitor that the pumping of records is stopped and rate is decreasing) - the job status is set to aborted instead of stopped - probably the UVSH becames a zoombie ! Evil or Very Mad
Or if a lookup is using a large cache enabled and it's stopped (VIA director) in the middle of building its RAM structure - Evil or Very Mad
An ODBC that runs a heavy query and is stopped before a result set has been recieved Evil or Very Mad

Or another variation is that the job has got a stopped status but it's UVSH is still running (Sometimes you can get log messages after the stopped entry) and evetually terminating but after a long delay. What happens is that one can think that the job has really stopped and for some good reason he issues a re-compilation (Even if there's a UVSH on air) and you can get very complicated situations like Syncronization errors and some times even successful jobs that doesn't really run etc. Evil or Very Mad

Any help on this one Question


Last edited by ariear on Mon Dec 01, 2003 2:44 pm; edited 1 time in total
kcbland

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 15 Jan 2003
Posts: 5209
Location: Lutz, FL
Points: 39192

Post Posted: Fri Nov 28, 2003 7:47 pm Reply with quote    Back to top    

Anytime you stop jobs via Director, or jobs abort, you should always make sure that the failed jobs don't leave threads out there. Code: $ ps -ef |grep phantom   radnet 11779 11776&nb ...

_________________
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle

Last edited by kcbland on Fri Nov 28, 2003 9:19 pm; edited 1 time in total
Rate this response:  
Not yet rated
PhantomSquawk
Participant



Joined: 05 Feb 2003
Posts: 6
Location: Nicaragua
Points: 35

Post Posted: Fri Nov 28, 2003 8:58 pm Reply with quote    Back to top    

remember this, it is the phrase to get in to the special meetings. Say it to the doorman: "The phantom squawks at midnight"

_________________
--
DataStage Phantom Squawk
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54582
Location: Sydney, Australia
Points: 295988

Post Posted: Sun Nov 30, 2003 9:01 am Reply with quote    Back to top    

The password is "swordfish".

The password is ALWAYS "swordfish".

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
ariear
Participant



Joined: 26 Dec 2002
Posts: 237

Points: 834

Post Posted: Sun Nov 30, 2003 3:27 pm Reply with quote    Back to top    

Thanks for the confimation Ken, (And for the anigmatic passwords).
Any good practices except NOT STOPPING JOBS USING DIRECTOR Question OR CAREFULLY CHECK AFTER INEVITABLE STOPS Exclamation
Rate this response:  
Not yet rated
kcbland

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 15 Jan 2003
Posts: 5209
Location: Lutz, FL
Points: 39192

Post Posted: Sun Nov 30, 2003 9:45 pm Reply with quote    Back to top    

You're on Windoze, so if don't have a unix command interpreter like MKS toolkit you won't have a process status command like "ps". If you have NT Resource Kit, the closest equivalent will be pview.ex ...

_________________
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54582
Location: Sydney, Australia
Points: 295988

Post Posted: Mon Dec 01, 2003 6:22 am Reply with quote    Back to top    

kcbland wrote: As for the swordfish reference, I had to do a google search. That reference is a little before my time. I always liked the Stooges better. Still don't know the phantom ref ...

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54582
Location: Sydney, Australia
Points: 295988

Post Posted: Mon Dec 01, 2003 6:24 am Reply with quote    Back to top    

kcbland wrote: Still don't know the phantom reference, though. DSD.RUN invokes DSD.StageRun with Code: PHANTOM SQUAWK DSD.StageRun { command_line_options } SQUAWK ...

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
ariear
Participant



Joined: 26 Dec 2002
Posts: 237

Points: 834

Post Posted: Mon Dec 01, 2003 2:36 pm Reply with quote    Back to top    

O.K.
Is there any sense in writing a deamon that checks the universe process table for orphans DSD.StageRun ? A check after each job that terminates under Batch/Sequencer control ? If I understand correctly this architecture a batch job will appear only as DSD.RUN.
Is the dslictool clean_lic -a command applicable to PHANTOM processes also ?

Thanks Guys !
Rate this response:  
Not yet rated
kcbland

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Server to Parallel Transition Group

Joined: 15 Jan 2003
Posts: 5209
Location: Lutz, FL
Points: 39192

Post Posted: Mon Dec 01, 2003 7:46 pm Reply with quote    Back to top    

PhantomSquawk wrote: remember this, it is the phrase to get in to the special meetings. Say it to the doorman: "The phantom squawks at midnight" Thanks for the info Ray, but this is the ...

_________________
Kenneth Bland

Rank: Sempai
Belt: First degree black
Fight name: Captain Hook
Signature knockout: right upper cut followed by left hook
Signature submission: Crucifix combined with leg triangle
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54582
Location: Sydney, Australia
Points: 295988

Post Posted: Tue Dec 02, 2003 10:04 am Reply with quote    Back to top    

Nope, that one's got me, too. Embarassed
PhantomSquawk, care to enlighten the world?

_________________
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours