Clear & PH& logs & RT_LOG

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
Akumar1
Participant
Posts: 48
Joined: Tue May 22, 2007 3:38 am
Location: bangalore
Contact:

Clear & PH& logs & RT_LOG

Post by Akumar1 »

Hi There,

What happens actually if we do not Clear & PH& logs & RT_LOG at regular intervals or if we dont clear the unwanted logs in scratch disk.

Can it cause datstage jobs being HUNG or LOCKED?


thanks in advance for kind input on this.

Akumar
Akumar
Sainath.Srinivasan
Participant
Posts: 3337
Joined: Mon Jan 17, 2005 4:49 am
Location: United Kingdom

Post by Sainath.Srinivasan »

Nothing will happen.

I thought a poster who is level 5 in both Server and PX will be aware of that.
JRodriguez
Premium Member
Premium Member
Posts: 425
Joined: Sat Nov 19, 2005 9:26 am
Location: New York City
Contact:

Post by JRodriguez »

Well ... in my humble opinion I would clear those logs regulary, DS jobs can and will fail if not under certain conditions

It will be good to state that I'm just level 3, not 5 (Before I get a very rude or judgemental reply from another level 5 poster)

Regards
Last edited by JRodriguez on Tue Aug 17, 2010 11:36 am, edited 3 times in total.
Julio Rodriguez
ETL Developer by choice

"Sure we have lots of reasons for being rude - But no excuses
kumar_s
Charter Member
Charter Member
Posts: 5245
Joined: Thu Jun 16, 2005 11:00 pm

Post by kumar_s »

Yeah... creates an issue when the &PH& gets full.
And RT_LOG, you can purge it with Admin level settings. Either Time based or run based.
Maintenance is all what, we talking about.
Impossible doesn't mean 'it is not possible' actually means... 'NOBODY HAS DONE IT SO FAR'
Akumar1
Participant
Posts: 48
Joined: Tue May 22, 2007 3:38 am
Location: bangalore
Contact:

Post by Akumar1 »

Hi Kumar , thanks for the kind input on this , however I just wanted to know whether this will cause datstage jobs being HUNG/LOCKED or not?
Akumar
Akumar1
Participant
Posts: 48
Joined: Tue May 22, 2007 3:38 am
Location: bangalore
Contact:

Post by Akumar1 »

I believe it should never get hung or get locked because of it.
Akumar
mandyli
Premium Member
Premium Member
Posts: 898
Joined: Wed May 26, 2004 10:45 pm
Location: Chicago

Post by mandyli »

Hi

Best one clear every month or ever weekly.

Datastage will not hung but bit slow down when you compile or view log.


Thanks
Man
kduke
Charter Member
Charter Member
Posts: 5227
Joined: Thu May 29, 2003 9:47 am
Location: Dallas, TX
Contact:

Post by kduke »

Unless you get warnings on every row then a log file will not get filled up. By default they hold 2GB. &PH& is a directory and the files in here are very small. I have seen a lot of places not clear these and they run fine. Logs should be auto purged based on days or number of job runs especially in DEV. Set these up at the begining of a project.

You may want to change your rating. It is usually wise to be under estimated than over estimated on a web site like this. Make yourself a 5 on your resume otherwise you might take abuse from someone on this site. Ray can call himself a 1 and everybody knows he is a 5. The truth is nobody knows it all. So you might be a 5 in many aspects. I have no idea. Besides it is just a number.
Mamu Kim
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The more entries that exist in &PH& and/or logs, the slower job startup times will be, particularly on operating systems that use linear directory file structures. &PH&, being a directory, can not fill with files until there are more than 4G entries (or the disk fills).

If RT_LOGnnn fills (reaches 2GB) it will become corrupted. It will no longer be able to open this log in Director (fortunately Clear Log can be invoked from Status view). A full log will not prevent the job from being opened in Designer. However a full or corrupted log will prevent the job from being run.
Last edited by ray.wurlod on Wed Aug 18, 2010 8:05 pm, edited 1 time in total.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
kris007
Charter Member
Charter Member
Posts: 1102
Joined: Tue Jan 24, 2006 5:38 pm
Location: Riverside, RI

Post by kris007 »

We have had instances where the RT_LOGnnn files got huge and it slowed the start up times of the parallel jobs literally around 2-4 minutes. We cleared the log files and things came back to normal.
Kris

Where's the "Any" key?-Homer Simpson
Post Reply