[hobbit] Sun Grid Engine monitoring
Martin Flemming
martin.flemming at desy.de
Wed Oct 15 22:58:46 CEST 2008
Thanks, i will test it and give feedback .. :-)
.. unfortunatley, i'm short in time for testing very short :-(
cheers,
martin
On Fri, 10 Oct 2008, rdeal wrote:
> We have several queues, primary are default, fast, medium.
>
> The config file is pretty simple:
> Unscaled[_]: y
>
> Target[sge_1]: `/local/packages/IT/MRTG/bin/qgraph.sh both`
> MaxBytes[sge_1]: 625
> AbsMax[sge_1]: 100000000
> ShortLegend[sge_1]: Jobs
> YLegend[sge_1]: jobs
> Options[sge_1]: absolute, gauge, noinfo, nopercent, growright, integer,
> unknaszero
> Title[sge_1]: Current Jobs on JCVI GRID
> Legend1[sge_1]: Running
> Legend2[sge_1]: Queued
> Legend3[sge_1]: Peak running
> Legend4[sge_1]: Peak queued
> LegendI[sge_1]: running
> LegendO[sge_1]: queued
> Colours[sge_1]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff
> PageTop[sge_1]: <H1>Current Jobs on JCVI GRID</H1>
> <TABLE>
> <TR><TD>Maintainer:</TD> <TD>rdeal at tigr.org</TD></TR>
> <TR><TD>Description:</TD><TD>Number of current SGE Jobs running on the
> JCVI SGE GRID</TD></TR>
> </TABLE>
> routers.cgi*Options[sge_1]: noabsmax nodetail
>
> Target[sge_7]: `/local/packages/IT/MRTG/bin/qgraph.sh medium`
> MaxBytes[sge_7]: 354
> AbsMax[sge_7]: 100000000
> ShortLegend[sge_7]: Jobs
> YLegend[sge_7]: jobs
> Options[sge_7]: absolute, gauge, noinfo, nopercent, growright, integer,
> unknaszero
> Title[sge_7]: Current Jobs in medium.q and fast.q
> Legend1[sge_7]: Medium
> Legend2[sge_7]: Fast
> Legend3[sge_7]: Peak medium
> Legend4[sge_7]: Peak fast
> LegendI[sge_7]: medium
> LegendO[sge_7]: fast
> Colours[sge_7]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff
> PageTop[sge_7]: <H1>Current Jobs on JCVI GRID</H1>
> <TABLE>
> <TR><TD>Maintainer:</TD> <TD>rdeal at tigr.org</TD></TR>
> <TR><TD>Description:</TD><TD>Number of current SGE Jobs in the fast.q and
> medium.q</TD></TR>
> </TABLE>
> routers.cgi*Options[sge_7]: noabsmax nodetail
>
> The script is rather simple:
>
> #!/bin/sh
> #
>
> case "$1" in
> test )
> echo 50
> echo 20 ;;
> total )
> echo $T
> echo 0 ;;
> running )
> echo $R
> echo 0 ;;
> msc )
> T=`/usr/local/bin/qstat -q fast.msc.q -s r | /usr/bin/tail +3 |
> /usr/bin/wc -l`
> R=`/usr/local/bin/qstat -q msc.q -s r | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> echo $R
> echo $T ;;
> medium )
> T=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> R=`/usr/local/bin/qstat -q medium.q -s r | /usr/bin/tail +3 |
> /usr/bin/wc -l`
> echo $R
> echo $T ;;
> fast )
> T=`/usr/local/bin/qstat -q default.q -s r | /usr/bin/tail +3 |
> /usr/bin/wc -l`
> R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> echo $R
> echo $T ;;
> desktop )
> T=`/usr/local/bin/qstat -q desktop.q -s r | /usr/bin/tail +3 |
> /usr/bin/wc -l`
> R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> echo $R
> echo $T ;;
> jtc )
> T=`ssh wasp "use sgejcvi; qstat -g dt" | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> R=`ssh wasp "use sgejcvi; qstat -s r" | /usr/bin/tail +3 | /usr/bin/wc
> -l`
> echo $R
> echo $T ;;
> * | both )
> T=`/usr/local/bin/qstat -g dt | /usr/bin/tail +3 | /usr/bin/wc -l`
> R=`/usr/local/bin/qstat -s r | /usr/bin/tail +3 | /usr/bin/wc -l`
> echo $R
> echo $T ;;
> esac
>
> echo foo
> echo SGE
>
>
> The two graphs configured above:
>
>
>
>> From: Martin Flemming <martin.flemming at desy.de>
>> Reply-To: <hobbit at hswn.dk>
>> Date: Fri, 10 Oct 2008 11:46:29 +0200 (CEST)
>> To: <hobbit at hswn.dk>
>> Subject: Re: [hobbit] Sun Grid Engine monitoring
>>
>>
>> Hmm, i didn't run mrtg ...
>>
>> How can i do it for sge ?
>>
>> .. i want to graph e.g jobs in the queue for each node, project or queue ..
>>
>> ... everything i can do :-)
>>
>> Or is it maybe possible to create graphs with the data of sge.sh script ?
>>
>> thanks & cheers
>>
>> martin
>>
>> On Fri, 10 Oct 2008, michael nemeth wrote:
>>
>>> Ok! well I run mrtg too so I can do that. Also I thought I try creating
>>> graphs for the sge.sh when
>>> it's implemented. I've done custom graphs before (clearcase).
>>> As I said I know little about SGE and the SGE support person knows little
>>> about hobbit.
>>>
>>> Deal, Richard wrote:
>>>> What did you want to graph. I use mrtg to graph global she stats
>>>>
>>>> Sent from a portable system with a small keyboard.
>>>>
>>>> On Oct 9, 2008, at 5:51 PM, "Martin Flemming" <martin.flemming at desy.de>
>>>> wrote:
>>>>
>>>>>
>>>>> Yep, i use it too ... but unfortunatley it's without trending graphs ..
>>>>>
>>>>> Got anybody a solution for it ?
>>>>>
>>>>> .. i'm very interested :-)
>>>>>
>>>>> cheers,
>>>>> martin
>>>>>
>>>>> On Thu, 9 Oct 2008, rdeal wrote:
>>>>>
>>>>>>
>>>>>> It is called sge.sh
>>>>>> http://www.deadcat.net/viewfile.php?fileid=920
>>>>>> And we run it under hobbit now.
>>>>>> Richard
>>>>>>
>>>>>>> From: Galen Johnson <Galen.Johnson at sas.com>
>>>>>>> Reply-To: <hobbit at hswn.dk>
>>>>>>> Date: Thu, 9 Oct 2008 14:57:10 -0400
>>>>>>> To: "hobbit at hswn.dk" <hobbit at hswn.dk>
>>>>>>> Subject: RE: [hobbit] Sun Grid Engine monitoring
>>>>>>>
>>>>>>> Where on deadcat? I can't find anything that mentions it (a search
>>>>>>> on grid on
>>>>>>> Deacat turns up something for the California power grid). Most
>>>>>>> monitors from
>>>>>>> deadcat should work with little to no modification for Hobbit.
>>>>>>> Also, Hobbit
>>>>>>> will monitor whatever you tell it so the sky's the limit there...or
>>>>>>> in this
>>>>>>> case the scripter is the limit.
>>>>>>>
>>>>>>> =G=
>>>>>>>
>>>>>>> -----Original Message-----
>>>>>>> From: michael nemeth [mailto:michael.nemeth at lmco.com]
>>>>>>> Sent: Thursday, October 09, 2008 2:46 PM
>>>>>>> To: hobbit at hswn.dk
>>>>>>> Subject: [hobbit] Sun Grid Engine monitoring
>>>>>>>
>>>>>>> While I not been involved in the effort yet,we are about to bring as
>>>>>>> "farm" under Sun Grid Engine in to production. Anyone doing any
>>>>>>> monitoring like this? I saw a script on deadcat. I really know
>>>>>>> little about it but said Id check into what monitoring and metrics
>>>>>>> could
>>>>>>> be done by hobbit.
>>>>>>>
>>>>>>>
>>>>>>> To unsubscribe from the hobbit list, send an e-mail to
>>>>>>> hobbit-unsubscribe at hswn.dk
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> To unsubscribe from the hobbit list, send an e-mail to
>>>>>>> hobbit-unsubscribe at hswn.dk
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> To unsubscribe from the hobbit list, send an e-mail to
>>>>>> hobbit-unsubscribe at hswn.dk
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> Gruss
>>>>>
>>>>> Martin Flemming
>>>>>
>>>>>
>>>>> ______________________________________________________
>>>>> Martin Flemming
>>>>> DESY / IT office : Building 2b / 008a
>>>>> Notkestr. 85 phone : 040 - 8998 - 4667
>>>>> 22603 Hamburg mail : martin.flemming at desy.de
>>>>> ______________________________________________________
>>>>>
>>>>> To unsubscribe from the hobbit list, send an e-mail to
>>>>> hobbit-unsubscribe at hswn.dk
>>>>>
>>>>>
>>>>
>>>> To unsubscribe from the hobbit list, send an e-mail to
>>>> hobbit-unsubscribe at hswn.dk
>>>>
>>>>
>>>>
>>>
>>>
>>> To unsubscribe from the hobbit list, send an e-mail to
>>> hobbit-unsubscribe at hswn.dk
>>>
>>>
>>>
>>>
>>
>> Gruss
>>
>> Martin Flemming
>>
>>
>> ______________________________________________________
>> Martin Flemming
>> DESY / IT office : Building 2b / 008a
>> Notkestr. 85 phone : 040 - 8998 - 4667
>> 22603 Hamburg mail : martin.flemming at desy.de
>> ______________________________________________________
>>
>> To unsubscribe from the hobbit list, send an e-mail to
>> hobbit-unsubscribe at hswn.dk
>>
>>
>
>
Gruss
Martin Flemming
______________________________________________________
Martin Flemming
DESY / IT office : Building 2b / 008a
Notkestr. 85 phone : 040 - 8998 - 4667
22603 Hamburg mail : martin.flemming at desy.de
______________________________________________________
More information about the Xymon
mailing list