[hobbit] only alert if X number of hosts are already in error

[Henrik Stoerner]

On Thu, Jun 16, 2005 at 01:31:32PM -0700, Bruce Lysik wrote:
> So while discussing monitoring with my coworkers, the most common statement is:
> 
> I don't really care if one server in a certain pool goes into error.  I only want to get paged if 5 or 10 in that same pool do.
> 
> I've been trying to figure out how to make this work in hobbit.  I suppose a paging script which keeps track of hosts in error and only pages if above that number would be possible. 
> 
> But would this be something more easily done within hobbit itself?  Does anyone think this would be useful?

My best suggestion would be to use the bbcombotest tool to define
a pseudo "host" with the combined status of your host "pool".

E.g. if you're monitoring http on 5 hosts, you could define a
combination test like this:

Pool1.http=(hostA.http+hostB.http+hostC.http+hostD.http+hostE.http)>3

That would give you a red alert if 3 or fewer hosts in the pool were
green. And you could then trigger an alert based on that test result.


Regards,
Henrik