[hobbit] Sun Grid Engine monitoring

[Martin Flemming]

Nice, the update work's ... unfortunatley,
i've to change the command

qstat -s r

to

qhost -j -h

because i've got no output for qstat ... don't know why ..

.. for the mrtg- and graph-question i will be answer/ask again,
if i've got time test it ... :-(

 	martin

On Thu, 16 Oct 2008, Martin Flemming wrote:

>
> Nice, that will be easier and quicker to test it, Thanks !
>
> cheers,
> 	 martin
>
> On Wed, 15 Oct 2008, rdeal wrote:
>
>>  I just put an upgrade to the test on deadcat yesterday to version 0.3e...
>>  Richard
>> 
>> 
>> >  From: Martin Flemming <martin.flemming at desy.de>
>> >  Reply-To: <hobbit at hswn.dk>
>> >  Date: Wed, 15 Oct 2008 22:58:46 +0200 (CEST)
>> >  To: <hobbit at hswn.dk>
>> >  Subject: Re: [hobbit] Sun Grid Engine monitoring
>> > 
>> > 
>> >  Thanks, i will test it and give feedback .. :-)
>> > 
>> >  .. unfortunatley, i'm short in time for testing very short :-(
>> > 
>> >  cheers,
>> >  martin
>> > 
>> >  On Fri, 10 Oct 2008, rdeal wrote:
>> > 
>> > >  We have several queues, primary are default, fast, medium.
>> > > 
>> > >  The config file is pretty simple:
>> > >  Unscaled[_]: y
>> > > 
>> > >  Target[sge_1]: `/local/packages/IT/MRTG/bin/qgraph.sh both`
>> > >  MaxBytes[sge_1]: 625
>> > >  AbsMax[sge_1]: 100000000
>> > >  ShortLegend[sge_1]:  Jobs
>> > >  YLegend[sge_1]: jobs
>> > >  Options[sge_1]: absolute, gauge, noinfo, nopercent, growright, 
>> > >  integer,
>> > >  unknaszero
>> > >  Title[sge_1]: Current Jobs on JCVI GRID
>> > >  Legend1[sge_1]: Running
>> > >  Legend2[sge_1]: Queued
>> > >  Legend3[sge_1]: Peak running
>> > >  Legend4[sge_1]: Peak queued
>> > >  LegendI[sge_1]: running
>> > >  LegendO[sge_1]: queued
>> > >  Colours[sge_1]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff
>> > >  PageTop[sge_1]: <H1>Current Jobs on JCVI GRID</H1>
>> > >  <TABLE>
>> > >    <TR><TD>Maintainer:</TD> <TD>rdeal at tigr.org</TD></TR>
>> > >    <TR><TD>Description:</TD><TD>Number of current SGE Jobs running on 
>> > >    the
>> > >  JCVI SGE GRID</TD></TR>
>> > >  </TABLE>
>> > >  routers.cgi*Options[sge_1]: noabsmax nodetail
>> > > 
>> > >  Target[sge_7]: `/local/packages/IT/MRTG/bin/qgraph.sh medium`
>> > >  MaxBytes[sge_7]: 354
>> > >  AbsMax[sge_7]: 100000000
>> > >  ShortLegend[sge_7]:  Jobs
>> > >  YLegend[sge_7]: jobs
>> > >  Options[sge_7]: absolute, gauge, noinfo, nopercent, growright, 
>> > >  integer,
>> > >  unknaszero
>> > >  Title[sge_7]: Current Jobs in medium.q and fast.q
>> > >  Legend1[sge_7]: Medium
>> > >  Legend2[sge_7]: Fast
>> > >  Legend3[sge_7]: Peak medium
>> > >  Legend4[sge_7]: Peak fast
>> > >  LegendI[sge_7]: medium
>> > >  LegendO[sge_7]: fast
>> > >  Colours[sge_7]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff
>> > >  PageTop[sge_7]: <H1>Current Jobs on JCVI GRID</H1>
>> > >  <TABLE>
>> > >    <TR><TD>Maintainer:</TD> <TD>rdeal at tigr.org</TD></TR>
>> > >    <TR><TD>Description:</TD><TD>Number of current SGE Jobs in the 
>> > >    fast.q and
>> > >  medium.q</TD></TR>
>> > >  </TABLE>
>> > >  routers.cgi*Options[sge_7]: noabsmax nodetail
>> > > 
>> > >  The script is rather simple:
>> > > 
>> > > # !/bin/sh
>> > > # 
>> > > 
>> > >  case "$1" in
>> > >   test )
>> > >           echo 50
>> > >           echo 20 ;;
>> > >   total )
>> > >           echo $T
>> > >           echo 0 ;;
>> > >   running )
>> > >           echo $R
>> > >           echo 0 ;;
>> > >   msc )
>> > >     T=`/usr/local/bin/qstat -q fast.msc.q -s r | /usr/bin/tail +3 |
>> > >  /usr/bin/wc -l`
>> > >     R=`/usr/local/bin/qstat -q msc.q -s r | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >   medium )
>> > >     T=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     R=`/usr/local/bin/qstat -q medium.q -s r | /usr/bin/tail +3 |
>> > >  /usr/bin/wc -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >   fast )
>> > >     T=`/usr/local/bin/qstat -q default.q -s r | /usr/bin/tail +3 |
>> > >  /usr/bin/wc -l`
>> > >     R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >   desktop )
>> > >     T=`/usr/local/bin/qstat -q desktop.q -s r | /usr/bin/tail +3 |
>> > >  /usr/bin/wc -l`
>> > >     R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >   jtc )
>> > >     T=`ssh wasp "use sgejcvi; qstat -g dt" | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     R=`ssh wasp "use sgejcvi; qstat -s r" | /usr/bin/tail +3 | 
>> > >  /usr/bin/wc
>> > >  -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >   * | both )
>> > >     T=`/usr/local/bin/qstat -g dt | /usr/bin/tail +3 | /usr/bin/wc -l`
>> > >     R=`/usr/local/bin/qstat -s r | /usr/bin/tail +3 | /usr/bin/wc -l`
>> > >     echo $R
>> > >     echo $T ;;
>> > >  esac
>> > > 
>> > >  echo foo
>> > >  echo SGE
>> > > 
>> > > 
>> > >  The two graphs configured above:
>> > > 
>> > > 
>> > > 
>> > > >  From: Martin Flemming <martin.flemming at desy.de>
>> > > >  Reply-To: <hobbit at hswn.dk>
>> > > >  Date: Fri, 10 Oct 2008 11:46:29 +0200 (CEST)
>> > > >  To: <hobbit at hswn.dk>
>> > > >  Subject: Re: [hobbit] Sun Grid Engine monitoring
>> > > > 
>> > > > 
>> > > >  Hmm, i didn't run mrtg ...
>> > > > 
>> > > >  How can i do it for sge ?
>> > > > 
>> > > >  .. i want to graph e.g jobs in the queue for each node, project or 
>> > > >  queue ..
>> > > > 
>> > > >  ... everything i can do :-)
>> > > > 
>> > > >  Or is it maybe possible to create graphs with the data of sge.sh 
>> > > >  script ?
>> > > > 
>> > > >  thanks & cheers
>> > > > 
>> > > >  martin
>> > > > 
>> > > >  On Fri, 10 Oct 2008, michael nemeth wrote:
>> > > > 
>> > > > >  Ok! well I run mrtg too so I can do that. Also I thought I try 
>> > > > >  creating
>> > > > >  graphs for  the sge.sh when
>> > > > >  it's implemented.   I've done custom graphs before (clearcase).
>> > > > >  As I said I know little about SGE and the SGE support person knows 
>> > > > >  little
>> > > > >  about hobbit.
>> > > > > 
>> > > > >  Deal, Richard wrote:
>> > > > > >   What did you want to graph.  I use mrtg to graph global she 
>> > > > > >   stats
>> > > > > > 
>> > > > > >   Sent from a portable system with a small keyboard.
>> > > > > > 
>> > > > > >   On Oct 9, 2008, at 5:51 PM, "Martin Flemming" 
>> > > > > >   <martin.flemming at desy.de>
>> > > > > >   wrote:
>> > > > > > 
>> > > > > > > 
>> > > > > > >   Yep, i use it too ... but unfortunatley it's without trending 
>> > > > > > >   graphs ..
>> > > > > > > 
>> > > > > > >   Got anybody a solution for it ?
>> > > > > > > 
>> > > > > > >   .. i'm very interested :-)
>> > > > > > > 
>> > > > > > >   cheers,
>> > > > > > >      martin
>> > > > > > > 
>> > > > > > >   On Thu, 9 Oct 2008, rdeal wrote:
>> > > > > > > 
>> > > > > > > > 
>> > > > > > > >   It is called sge.sh
>> > > > > > > >   http://www.deadcat.net/viewfile.php?fileid=920
>> > > > > > > >   And we run it under hobbit now.
>> > > > > > > >   Richard
>> > > > > > > > 
>> > > > > > > > >   From: Galen Johnson <Galen.Johnson at sas.com>
>> > > > > > > > >   Reply-To: <hobbit at hswn.dk>
>> > > > > > > > >   Date: Thu, 9 Oct 2008 14:57:10 -0400
>> > > > > > > > >   To: "hobbit at hswn.dk" <hobbit at hswn.dk>
>> > > > > > > > >   Subject: RE: [hobbit] Sun Grid Engine monitoring
>> > > > > > > > > 
>> > > > > > > > >   Where on deadcat?  I can't find anything that mentions it 
>> > > > > > > > >   (a search
>> > > > > > > > >   on grid on
>> > > > > > > > >   Deacat turns up something for the California power grid). 
>> > > > > > > > >   Most
>> > > > > > > > >   monitors from
>> > > > > > > > >   deadcat should work with little to no modification for 
>> > > > > > > > >   Hobbit.
>> > > > > > > > >   Also, Hobbit
>> > > > > > > > >   will monitor whatever you tell it so the sky's the limit 
>> > > > > > > > >   there...or
>> > > > > > > > >   in this
>> > > > > > > > >   case the scripter is the limit.
>> > > > > > > > > 
>> > > > > > > > >   =G=
>> > > > > > > > > 
>> > > > > > > > >   -----Original Message-----
>> > > > > > > > >   From: michael nemeth [mailto:michael.nemeth at lmco.com]
>> > > > > > > > >   Sent: Thursday, October 09, 2008 2:46 PM
>> > > > > > > > >   To: hobbit at hswn.dk
>> > > > > > > > >   Subject: [hobbit] Sun Grid Engine monitoring
>> > > > > > > > > 
>> > > > > > > > >   While I not been involved in the effort yet,we are about 
>> > > > > > > > >   to bring as
>> > > > > > > > >   "farm" under Sun Grid Engine in to production. Anyone 
>> > > > > > > > >   doing any
>> > > > > > > > >   monitoring like this?  I saw a script on deadcat.  I 
>> > > > > > > > >   really know
>> > > > > > > > >   little about it but said Id check into what monitoring 
>> > > > > > > > >   and metrics
>> > > > > > > > >   could
>> > > > > > > > >   be done by hobbit.
>> > > > > > > > > 
>> > > > > > > > > 
>> > > > > > > > >   To unsubscribe from the hobbit list, send an e-mail to
>> > > > > > > > >   hobbit-unsubscribe at hswn.dk
>> > > > > > > > > 
>> > > > > > > > > 
>> > > > > > > > > 
>> > > > > > > > > 
>> > > > > > > > >   To unsubscribe from the hobbit list, send an e-mail to
>> > > > > > > > >   hobbit-unsubscribe at hswn.dk
>> > > > > > > > > 
>> > > > > > > > > 
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > >   To unsubscribe from the hobbit list, send an e-mail to
>> > > > > > > >   hobbit-unsubscribe at hswn.dk
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > 
>> > > > > > >   Gruss
>> > > > > > > 
>> > > > > > >         Martin Flemming
>> > > > > > > 
>> > > > > > > 
>>>>>>>> ______________________________________________________
>> > > > > > >   Martin Flemming
>> > > > > > >   DESY / IT          office : Building 2b / 008a
>> > > > > > >   Notkestr. 85       phone  : 040 - 8998 - 4667
>> > > > > > >   22603 Hamburg      mail   : martin.flemming at desy.de
>>>>>>>> ______________________________________________________
>> > > > > > > 
>> > > > > > >   To unsubscribe from the hobbit list, send an e-mail to
>> > > > > > >   hobbit-unsubscribe at hswn.dk
>> > > > > > > 
>> > > > > > > 
>> > > > > > 
>> > > > > >   To unsubscribe from the hobbit list, send an e-mail to
>> > > > > >   hobbit-unsubscribe at hswn.dk
>> > > > > > 
>> > > > > > 
>> > > > > > 
>> > > > > 
>> > > > > 
>> > > > >  To unsubscribe from the hobbit list, send an e-mail to
>> > > > >  hobbit-unsubscribe at hswn.dk
>> > > > > 
>> > > > > 
>> > > > > 
>> > > > > 
>> > > > 
>> > > >  Gruss
>> > > > 
>> > > >          Martin Flemming
>> > > > 
>> > > > 
>>>>> ______________________________________________________
>> > > >  Martin Flemming
>> > > >  DESY / IT          office : Building 2b / 008a
>> > > >  Notkestr. 85       phone  : 040 - 8998 - 4667
>> > > >  22603 Hamburg      mail   : martin.flemming at desy.de
>>>>> ______________________________________________________
>> > > > 
>> > > >  To unsubscribe from the hobbit list, send an e-mail to
>> > > >  hobbit-unsubscribe at hswn.dk
>> > > > 
>> > > > 
>> > > 
>> > > 
>> > 
>> >  Gruss
>> > 
>> >          Martin Flemming
>> > 
>> > 
>>> ______________________________________________________
>> >  Martin Flemming
>> >  DESY / IT          office : Building 2b / 008a
>> >  Notkestr. 85       phone  : 040 - 8998 - 4667
>> >  22603 Hamburg      mail   : martin.flemming at desy.de
>>> ______________________________________________________
>> > 
>> >  To unsubscribe from the hobbit list, send an e-mail to
>> >  hobbit-unsubscribe at hswn.dk
>> > 
>> > 
>> 
>>
>>  To unsubscribe from the hobbit list, send an e-mail to
>>  hobbit-unsubscribe at hswn.dk
>> 
>> 
>> 
>
> Gruss
>
>       Martin Flemming
>
>
> ______________________________________________________
> Martin Flemming
> DESY / IT          office : Building 2b / 008a
> Notkestr. 85       phone  : 040 - 8998 - 4667
> 22603 Hamburg      mail   : martin.flemming at desy.de
> ______________________________________________________
>
> To unsubscribe from the hobbit list, send an e-mail to
> hobbit-unsubscribe at hswn.dk
>
>
>

Gruss

        Martin Flemming


______________________________________________________
Martin Flemming
DESY / IT          office : Building 2b / 008a
Notkestr. 85       phone  : 040 - 8998 - 4667
22603 Hamburg      mail   : martin.flemming at desy.de
______________________________________________________