[hobbit] A few hobbit problems

[Henrik Stoerner]

Hi Eric,

On Sun, Apr 03, 2005 at 04:53:28PM -0400, Schwimmer, Eric E *HS wrote:
> 
> We're in the process of migrating from BB to hobbit, and, for the most part,
> the process has been quick and painless (hobbit seems to be handling our
> 800+ hosts much better than BB did).

Glad to hear that.

> 1. We see the occaisional yellow message from bbtest:
>   Error output:
>   dns_queue_run deadlock - loops=260
> 
> During this problem, ~70 seconds get added to our "Test setup" phase
> as reported by bb-test.  This only happens once or twice an hour so
> far, so its not a showstopper.  We are using the --dns=ip option
> when calling the bbtest-net binary from hobbitlaunch.

Since you're seeing this, some DNS lookups must be happening. Most
likely, they are from http tests, or hosts that have a "0.0.0.0" IP.

I dont have a solution for this problem - it would mean digging into
the C-ARES library which handles the DNS lookups, and I haven't done
that yet. If it becomes more urgent, I'll see what I can do about it.


> 2. The bb-eventlog.sh script dumps core.  I've run it successfully
> in the past, but at some point, as we added more hosts to our
> bb-hosts file, it began to fail.  Calling it from the command line:
>   
>   % setenv QUERY_STRING 'MAXTIME=140&MAXCOUNT=&Send=View+log'
>   % /usr/local/hobbit/bb-eventlog.sh
>   Segmentation fault (core dumped)

Could you try getting the call trace from the core file ? Assuming
the core file is in the current directory, you should do this:

    $ gdb /usr/local/hobbit/server/bin/bb-eventlog.cgi core
    [messages from gdb]
    gdb> bt

The output from the "bt" command would be very helpful in narrowing
down the problem.


Thanks,
Henrik