[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

FW: Re: [hobbit] bbdisplay problems after adding some new hosts



Hello,

is the number of tests per host limited? I've cleaned my bb-hosts and as I add one host with many tests. I disabled all customized tests and tried to find out if its a single test. But all test run by itself didn't crash the hobbit server - running all together did!
The host runs about 20 tests.


Regards,

Stefan


<br><br><br>&gt;From: &quot;Stefan Loos&quot; &lt;stefan_loos (at) hotmail.com&gt;<br>&gt;Reply-To: hobbit (at) hswn.dk<br>&gt;To: hobbit (at) hswn.dk<br>&gt;Subject: Re: [hobbit] bbdisplay problems after adding some new hosts<br>&gt;Date: Wed, 11 May 2005 09:49:30 +0000<br>&gt;<br>&gt;Hi Henrik,<br>&gt;<br>&gt;now the errors in the hobbitlaunch.log are gone but in <br>&gt;bb-display.log are still there. And another strange thing - since I <br>&gt;reenabled the bbdisplay this morning I didn't see any host at the <br>&gt;hobbit server! Just the subpages and groups are there.<br>&gt;<br>&gt;Regards,<br>&gt;<br>&gt;Stefan Loos<br>&gt;<br>&gt;&lt;br&gt;&lt;br&gt;&lt;br&gt;&amp;gt;From: henrik (at) hswn.dk (Henrik <br>&gt;Stoerner)&lt;br&gt;&amp;gt;Reply-To: hobbit (at) hswn.dk&lt;br&gt;&amp;gt;To: <br>&gt;hobbit (at) hswn.dk&lt;br&gt;&amp;gt;Subject: Re: [hobbit] bbdisplay problems after <br>&gt;adding some new hosts&lt;br&gt;&amp;gt;Date: Wed, 11 May 2005 11:06:13 <br>&gt;+0200&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;Could you try removing the <br>&gt;&amp;quot;HEARTBEAT&amp;quot; line from hobbitlaunch.cfg and&lt;br&gt;&amp;gt;see if <br>&gt;things run OK after that <br>&gt;?&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;Regards,&lt;br&gt;&amp;gt;Henrik&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;On <br>&gt;Wed, May 11, 2005 at 07:41:37AM +0000, Stefan Loos wrote:&lt;br&gt;&amp;gt; <br>&gt;&amp;gt; Hi,&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; yesterday I add some new hosts to <br>&gt;my hobbit-server and short after that&lt;br&gt;&amp;gt; &amp;gt; hobbit had some <br>&gt;problems.&lt;br&gt;&amp;gt; &amp;gt; Here is what hobbitlauch.log says:&lt;br&gt;&amp;gt; <br>&gt;&amp;gt;&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:18 Heartbeat lost for task <br>&gt;hobbitd, bouncing it&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:18 Task bbretest <br>&gt;started with PID 4523&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Heartbeat <br>&gt;lost for task hobbitd, killing it&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 <br>&gt;Task bbdisplay started with PID 4524&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:11:23 Task hobbitd terminated by signal 9&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:11:23 Task hobbitd started with PID 4525&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:11:23 Loading hostnames&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Loading <br>&gt;saved state&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Setting up network <br>&gt;listener on 0.0.0.0:1984&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Setting up <br>&gt;signal handlers&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Setting up hobbitd <br>&gt;channels&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Setting up <br>&gt;logfiles&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:28 Task bbhistory started <br>&gt;with PID 4527&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:28 Task bbenadis started <br>&gt;with PID 4528&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:28 Task bbpage started <br>&gt;with PID 4530&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:28 Task larrdstatus <br>&gt;started with PID 4532&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:28 Task <br>&gt;larrddata started with PID 4534&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:12:18 <br>&gt;Task bbretest started with PID 4541&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:12:23 <br>&gt;Task bbdisplay started with PID 4542&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:12:43 Heartbeat lost for task hobbitd, bouncing it&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;2005-05-11 09:12:48 Heartbeat lost for task hobbitd, killing <br>&gt;it&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:12:48 Task hobbitd terminated by <br>&gt;signal 9&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:12:48 Task bbdisplay terminated <br>&gt;by signal 15&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; So I tried to find out which <br>&gt;component causes the problem and disabled&lt;br&gt;&amp;gt; &amp;gt; everything in <br>&gt;hobbitlauch.cfg and reenabled one by one.&lt;br&gt;&amp;gt; &amp;gt; I found out <br>&gt;that everytime I enabled bbdisplay those errors occour.&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;The bb-display.log looks like this:&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;2005-05-11 09:09:48 Whoops ! bb failed to send message - <br>&gt;timeout&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:09:48 hobbitd status-board not <br>&gt;available&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:09:53 Whoops ! bb failed to <br>&gt;send message - timeout&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:10:53 Whoops ! bb <br>&gt;failed to send message - timeout&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:10:53 <br>&gt;hobbitd status-board not available&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 <br>&gt;Could not connect to bbd (at) 10.207.193.41:1984 -&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;Connection refused&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Whoops ! bb <br>&gt;failed to send message - Connection failed&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:11:23 hobbitd status-board not available&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 <br>&gt;09:11:23 Could not connect to bbd (at) 10.207.193.41:1984 -&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;Connection refused&lt;br&gt;&amp;gt; &amp;gt; 2005-05-11 09:11:23 Whoops ! bb <br>&gt;failed to send message - Connection failed&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;I also found some core files in ~server/tmp but I'm pretty shure <br>&gt;they came&lt;br&gt;&amp;gt; &amp;gt; from killing hobbit - nevertheless I've run <br>&gt;the gdb util:&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; GNU gdb Red Hat Linux <br>&gt;(6.1post-1.20040607.52rh)&lt;br&gt;&amp;gt; &amp;gt; Copyright 2004 Free Software <br>&gt;Foundation, Inc.&lt;br&gt;&amp;gt; &amp;gt; GDB is free software, covered by the <br>&gt;GNU General Public License, and you are&lt;br&gt;&amp;gt; &amp;gt; welcome to <br>&gt;change it and/or distribute copies of it under certain&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;conditions.&lt;br&gt;&amp;gt; &amp;gt; Type &amp;quot;show copying&amp;quot; to see the <br>&gt;conditions.&lt;br&gt;&amp;gt; &amp;gt; There is absolutely no warranty for GDB. <br>&gt;Type &amp;quot;show warranty&amp;quot; for details.&lt;br&gt;&amp;gt; &amp;gt; This GDB <br>&gt;was configured as &amp;quot;i386-redhat-linux-gnu&amp;quot;...Using <br>&gt;host&lt;br&gt;&amp;gt; &amp;gt; libthread_db library <br>&gt;&amp;quot;/lib/tls/libthread_db.so.1&amp;quot;.&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;Core was generated by `hobbitd --debug&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;--pidfile=/var/log/hobbit/hobbitd.pid <br>&gt;--restart=/usr/local/hobb'.&lt;br&gt;&amp;gt; &amp;gt; Program terminated with <br>&gt;signal 6, Aborted.&lt;br&gt;&amp;gt; &amp;gt; Reading symbols from <br>&gt;/lib/tls/libc.so.6...done.&lt;br&gt;&amp;gt; &amp;gt; Loaded symbols for <br>&gt;/lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; Reading symbols from <br>&gt;/lib/ld-linux.so.2...done.&lt;br&gt;&amp;gt; &amp;gt; Loaded symbols for <br>&gt;/lib/ld-linux.so.2&lt;br&gt;&amp;gt; &amp;gt; #0 0x00df4cef in raise () from <br>&gt;/lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; (gdb) bt&lt;br&gt;&amp;gt; &amp;gt; #0 0x00df4cef <br>&gt;in raise () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; #1 0x00df64f5 in <br>&gt;abort () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; #2 0x08054126 in <br>&gt;sigsegv_handler (signum=11) at sig.c:57&lt;br&gt;&amp;gt; &amp;gt; #3 &amp;lt;signal <br>&gt;handler called&amp;gt;&lt;br&gt;&amp;gt; &amp;gt; #4 0x00e46cac in mempcpy () from <br>&gt;/lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; #5 0x00e3a4d2 in <br>&gt;_IO_default_xsputn_internal () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;#6 0x00e13527 in vfprintf () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;#7 0x00e2f3dc in vsprintf () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;#8 0x00e1a03d in sprintf () from /lib/tls/libc.so.6&lt;br&gt;&amp;gt; &amp;gt; #9 <br>&gt; 0x0804d7a4 in do_message (msg=0x9e0b3f8, origin=0x80554bb <br>&gt;&amp;quot;&amp;quot;) at&lt;br&gt;&amp;gt; &amp;gt; hobbitd.c:1903&lt;br&gt;&amp;gt; &amp;gt; #10 <br>&gt;0x0804fcb5 in main (argc=8, argv=0xbfff9084) at <br>&gt;hobbitd.c:2944&lt;br&gt;&amp;gt; &amp;gt; (gdb)&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; Now I <br>&gt;try to find out which of the new hosts - and what test causes <br>&gt;the&lt;br&gt;&amp;gt; &amp;gt; problems...&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; <br>&gt;Regards,&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; Stefan Loos&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; <br>&gt;&amp;gt;&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt; &amp;gt; To unsubscribe from the hobbit list, <br>&gt;send an e-mail to&lt;br&gt;&amp;gt; &amp;gt; hobbit-unsubscribe (at) hswn.dk&lt;br&gt;&amp;gt; <br>&gt;&amp;gt;&lt;br&gt;&amp;gt; &amp;gt;&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;--&lt;br&gt;&amp;gt;Henrik <br>&gt;Storner&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;To unsubscribe from the hobbit list, send an <br>&gt;e-mail to&lt;br&gt;&amp;gt;hobbit-unsubscribe (at) hswn.dk&lt;br&gt;&amp;gt;&lt;br&gt;&amp;gt;&lt;br&gt;<br>&gt;<br>&gt;<br>&gt;<br>&gt;To unsubscribe from the hobbit list, send an e-mail to<br>&gt;hobbit-unsubscribe (at) hswn.dk<br>&gt;<br>&gt;<br>