<HTML>
<HEAD>
<TITLE>Re: [hobbit] Sun Grid Engine monitoring</TITLE>
</HEAD>
<BODY>
<FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'>We have several queues, primary are default, fast, medium.<BR>
<BR>
The config file is pretty simple:<BR>
Unscaled[_]: y<BR>
<BR>
Target[sge_1]: `/local/packages/IT/MRTG/bin/qgraph.sh both`<BR>
MaxBytes[sge_1]: 625<BR>
AbsMax[sge_1]: 100000000<BR>
ShortLegend[sge_1]: Jobs<BR>
YLegend[sge_1]: jobs<BR>
Options[sge_1]: absolute, gauge, noinfo, nopercent, growright, integer, unknaszero<BR>
Title[sge_1]: Current Jobs on JCVI GRID<BR>
Legend1[sge_1]: Running<BR>
Legend2[sge_1]: Queued<BR>
Legend3[sge_1]: Peak running<BR>
Legend4[sge_1]: Peak queued<BR>
LegendI[sge_1]: running<BR>
LegendO[sge_1]: queued<BR>
Colours[sge_1]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff<BR>
PageTop[sge_1]: <H1>Current Jobs on JCVI GRID</H1><BR>
<TABLE><BR>
<TR><TD>Maintainer:</TD> <TD><a href="rdeal@tigr.org</TD></TR>">rdeal@tigr.org</TD></TR></a><BR>
<TR><TD>Description:</TD><TD>Number of current SGE Jobs running on the JCVI SGE GRID</TD></TR><BR>
</TABLE><BR>
routers.cgi*Options[sge_1]: noabsmax nodetail<BR>
<BR>
Target[sge_7]: `/local/packages/IT/MRTG/bin/qgraph.sh medium`<BR>
MaxBytes[sge_7]: 354<BR>
AbsMax[sge_7]: 100000000<BR>
ShortLegend[sge_7]: Jobs<BR>
YLegend[sge_7]: jobs<BR>
Options[sge_7]: absolute, gauge, noinfo, nopercent, growright, integer, unknaszero<BR>
Title[sge_7]: Current Jobs in medium.q and fast.q<BR>
Legend1[sge_7]: Medium<BR>
Legend2[sge_7]: Fast<BR>
Legend3[sge_7]: Peak medium<BR>
Legend4[sge_7]: Peak fast<BR>
LegendI[sge_7]: medium<BR>
LegendO[sge_7]: fast<BR>
Colours[sge_7]: GREEN#00eb0c,BLUE#0000ff,GRAY#AAAAAA,VIOLET#ff00ff<BR>
PageTop[sge_7]: <H1>Current Jobs on JCVI GRID</H1><BR>
<TABLE><BR>
<TR><TD>Maintainer:</TD> <TD><a href="rdeal@tigr.org</TD></TR>">rdeal@tigr.org</TD></TR></a><BR>
<TR><TD>Description:</TD><TD>Number of current SGE Jobs in the fast.q and medium.q</TD></TR><BR>
</TABLE><BR>
routers.cgi*Options[sge_7]: noabsmax nodetail<BR>
<BR>
The script is rather simple:<BR>
<BR>
#!/bin/sh<BR>
#<BR>
<BR>
case "$1" in <BR>
test )<BR>
echo 50<BR>
echo 20 ;;<BR>
total )<BR>
echo $T<BR>
echo 0 ;;<BR>
running )<BR>
echo $R<BR>
echo 0 ;;<BR>
msc )<BR>
T=`/usr/local/bin/qstat -q fast.msc.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`/usr/local/bin/qstat -q msc.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
medium )<BR>
T=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`/usr/local/bin/qstat -q medium.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
fast )<BR>
T=`/usr/local/bin/qstat -q default.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
desktop )<BR>
T=`/usr/local/bin/qstat -q desktop.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`/usr/local/bin/qstat -q fast.q -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
jtc )<BR>
T=`ssh wasp "use sgejcvi; qstat -g dt" | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`ssh wasp "use sgejcvi; qstat -s r" | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
* | both )<BR>
T=`/usr/local/bin/qstat -g dt | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
R=`/usr/local/bin/qstat -s r | /usr/bin/tail +3 | /usr/bin/wc -l`<BR>
echo $R<BR>
echo $T ;;<BR>
esac<BR>
<BR>
echo foo<BR>
echo SGE<BR>
<BR>
<BR>
The two graphs configured above:<BR>
<IMG src="cid:3306471740_10976938" ><BR>
<BR>
<BR>
<FONT COLOR="#0000FF">> From: Martin Flemming <<a href="martin.flemming@desy.de">martin.flemming@desy.de</a>><BR>
> Reply-To: <<a href="hobbit@hswn.dk">hobbit@hswn.dk</a>><BR>
> Date: Fri, 10 Oct 2008 11:46:29 +0200 (CEST)<BR>
> To: <<a href="hobbit@hswn.dk">hobbit@hswn.dk</a>><BR>
> Subject: Re: [hobbit] Sun Grid Engine monitoring<BR>
> <BR>
> <BR>
> Hmm, i didn't run mrtg ...<BR>
> <BR>
> How can i do it for sge ?<BR>
> <BR>
> .. i want to graph e.g jobs in the queue for each node, project or queue ..<BR>
> <BR>
> ... everything i can do :-)<BR>
> <BR>
> Or is it maybe possible to create graphs with the data of sge.sh script ?<BR>
> <BR>
> thanks & cheers<BR>
> <BR>
> martin<BR>
> <BR>
> On Fri, 10 Oct 2008, michael nemeth wrote:<BR>
> <BR>
</FONT><FONT COLOR="#008000">>> Ok! well I run mrtg too so I can do that. Also I thought I try creating <BR>
>> graphs for the sge.sh when<BR>
>> it's implemented. I've done custom graphs before (clearcase).<BR>
>> As I said I know little about SGE and the SGE support person knows little <BR>
>> about hobbit.<BR>
>> <BR>
>> Deal, Richard wrote:<BR>
</FONT><FONT COLOR="#FF0000">>>> What did you want to graph. I use mrtg to graph global she stats<BR>
>>> <BR>
>>> Sent from a portable system with a small keyboard.<BR>
>>> <BR>
>>> On Oct 9, 2008, at 5:51 PM, "Martin Flemming" <<a href="martin.flemming@desy.de">martin.flemming@desy.de</a>><BR>
>>> wrote:<BR>
>>> <BR>
</FONT><FONT COLOR="#800080">>>>> <BR>
>>>> Yep, i use it too ... but unfortunatley it's without trending graphs ..<BR>
>>>> <BR>
>>>> Got anybody a solution for it ?<BR>
>>>> <BR>
>>>> .. i'm very interested :-)<BR>
>>>> <BR>
>>>> cheers,<BR>
>>>> martin<BR>
>>>> <BR>
>>>> On Thu, 9 Oct 2008, rdeal wrote:<BR>
>>>> <BR>
>>>>> <BR>
>>>>> It is called sge.sh<BR>
>>>>> <a href="http://www.deadcat.net/viewfile.php?fileid=920">http://www.deadcat.net/viewfile.php?fileid=920</a><BR>
>>>>> And we run it under hobbit now.<BR>
>>>>> Richard<BR>
>>>>> <BR>
>>>>>> From: Galen Johnson <<a href="Galen.Johnson@sas.com">Galen.Johnson@sas.com</a>><BR>
>>>>>> Reply-To: <<a href="hobbit@hswn.dk">hobbit@hswn.dk</a>><BR>
>>>>>> Date: Thu, 9 Oct 2008 14:57:10 -0400<BR>
>>>>>> To: "<a href="hobbit@hswn.dk">hobbit@hswn.dk</a>" <<a href="hobbit@hswn.dk">hobbit@hswn.dk</a>><BR>
>>>>>> Subject: RE: [hobbit] Sun Grid Engine monitoring<BR>
>>>>>> <BR>
>>>>>> Where on deadcat? I can't find anything that mentions it (a search <BR>
>>>>>> on grid on<BR>
>>>>>> Deacat turns up something for the California power grid). Most <BR>
>>>>>> monitors from<BR>
>>>>>> deadcat should work with little to no modification for Hobbit. <BR>
>>>>>> Also, Hobbit<BR>
>>>>>> will monitor whatever you tell it so the sky's the limit there...or <BR>
>>>>>> in this<BR>
>>>>>> case the scripter is the limit.<BR>
>>>>>> <BR>
>>>>>> =G=<BR>
>>>>>> <BR>
>>>>>> -----Original Message-----<BR>
>>>>>> From: michael nemeth [<a href="mailto:michael.nemeth@lmco.com">mailto:michael.nemeth@lmco.com</a>]<BR>
>>>>>> Sent: Thursday, October 09, 2008 2:46 PM<BR>
>>>>>> To: <a href="hobbit@hswn.dk">hobbit@hswn.dk</a><BR>
>>>>>> Subject: [hobbit] Sun Grid Engine monitoring<BR>
>>>>>> <BR>
>>>>>> While I not been involved in the effort yet,we are about to bring as<BR>
>>>>>> "farm" under Sun Grid Engine in to production. Anyone doing any<BR>
>>>>>> monitoring like this? I saw a script on deadcat. I really know<BR>
>>>>>> little about it but said Id check into what monitoring and metrics <BR>
>>>>>> could<BR>
>>>>>> be done by hobbit.<BR>
>>>>>> <BR>
>>>>>> <BR>
>>>>>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>>>>>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>>>>>> <BR>
>>>>>> <BR>
>>>>>> <BR>
>>>>>> <BR>
>>>>>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>>>>>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>>>>>> <BR>
>>>>>> <BR>
>>>>> <BR>
>>>>> <BR>
>>>>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>>>>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>>>>> <BR>
>>>>> <BR>
>>>>> <BR>
>>>> <BR>
>>>> Gruss<BR>
>>>> <BR>
>>>> Martin Flemming<BR>
>>>> <BR>
>>>> <BR>
>>>> ______________________________________________________<BR>
>>>> Martin Flemming<BR>
>>>> DESY / IT office : Building 2b / 008a<BR>
>>>> Notkestr. 85 phone : 040 - 8998 - 4667<BR>
>>>> 22603 Hamburg mail : <a href="martin.flemming@desy.de">martin.flemming@desy.de</a><BR>
>>>> ______________________________________________________<BR>
>>>> <BR>
>>>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>>>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>>>> <BR>
>>>> <BR>
</FONT><FONT COLOR="#FF0000">>>> <BR>
>>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>>> <BR>
>>> <BR>
>>> <BR>
</FONT><FONT COLOR="#008000">>> <BR>
>> <BR>
>> To unsubscribe from the hobbit list, send an e-mail to<BR>
>> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
>> <BR>
>> <BR>
>> <BR>
>> <BR>
</FONT><FONT COLOR="#0000FF">> <BR>
> Gruss<BR>
> <BR>
> Martin Flemming<BR>
> <BR>
> <BR>
> ______________________________________________________<BR>
> Martin Flemming<BR>
> DESY / IT office : Building 2b / 008a<BR>
> Notkestr. 85 phone : 040 - 8998 - 4667<BR>
> 22603 Hamburg mail : <a href="martin.flemming@desy.de">martin.flemming@desy.de</a><BR>
> ______________________________________________________<BR>
> <BR>
> To unsubscribe from the hobbit list, send an e-mail to<BR>
> <a href="hobbit-unsubscribe@hswn.dk">hobbit-unsubscribe@hswn.dk</a><BR>
> <BR>
> <BR>
</FONT></SPAN></FONT>
</BODY>
</HTML>