[Xymon] Looking to monitor ~20,000 hosts.

[Thomas Eckert]

Hi Matt,

the reply by J.C. Cleaver pretty much obsoletes my message-in-progress but it may be of some help anyway (see `<original reply>` below).

Like J.C. I’m not sure if using xymonfetch (pulldata) is fast enough. In addition it requires extra setup of the msgcache on all systems, requires an tcp-port to be reachable from the xymon server and adds extra latency (depending on the configured poll interval).

Depending on your network topology using `ssh-tunnel`, shared by Padraig Lennon, in conjunction with xymonproxy might be an alternative to use Xymon satellite servers. I published two blog-posts about that [1][2] and have a patched version of ssh-tunnel (along with documentation) describing the setup [3].

Probably old news: You should definitely route the xymon messages through xymonproxy.

HTH
Thomas

[1] http://www.it-eckert.com/blog/2014/remote-site-monitoring-with-ssh-tunnel/
[2] http://www.it-eckert.com/blog/2014/combine-ssh-tunnel-with-xymonproxy/
[3] http://www.it-eckert.com/software/patches/ssh-tunnel/

<original reply>
There was as thread on the mailing list (Subject: Big Environment) a while ago

http://lists.xymon.com/archive/2011-October/032605.html

One setup at least in the range you are looking for was with satellite xymon servers reporting to one central instance w/ ~10k hosts (contributed by Nicolas Lienard). That was on a 4x SSD RAID5 system.

Another setup (reported by Thomas Brand) had ~8k hosts on a single instance (but with 2 network test satellites). The disk setup was not reported in detail but there were a significant IO issues.

Given that SSD technology made massive progress since Oct. 201. An 8 disk SSD system in RAID10 is definitely affordable nowadays and I would _expect_ that the IO-problems can be solved with a modern RAID setup.

Both installations are _way_ below the 3300 msg/s limit where the backfeed-queue (http://sourceforge.net/p/xymon/code/HEAD/tree/branches/4.3.18/README.backfeed) feature is needed.
</original reply>



On 15 May 2014, at 16:26, Weber, Matt <matt.weber at bnymellon.com> wrote:

> Hi all,
> 
> We are attempting to setup Xymon at our organization, where it would be monitoring approximately 20,000 hosts with the Xymon client in central mode (pulldata).  Just wondering if anyone has Xymon monitoring anywhere close to that number of machines? We are looking for ideas on what hardware specs would be required for the machine running the server side of the Xymon software, or other suggestions on how to setup the environment.  Is there a way to load balance multiple Xymon servers?
> 
> Thanks,
> Matt
> 
> 
>  
> 
> The information contained in this e-mail, and any attachment, is confidential and is intended solely for the use of the intended recipient. Access, copying or re-use of the e-mail or any attachment, or any information contained therein, by any other person is not authorized. If you are not the intended recipient please return the e-mail to the sender and delete it from your computer. Although we attempt to sweep e-mail and attachments for viruses, we do not guarantee that either are virus-free and accept no liability for any damage sustained as a result of viruses. 
> 
> Please refer to http://disclaimer.bnymellon.com/eu.htm for certain disclosures relating to European legal entities.
> _______________________________________________
> Xymon mailing list
> Xymon at xymon.com
> http://lists.xymon.com/mailman/listinfo/xymon

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.xymon.com/pipermail/xymon/attachments/20140515/94a7f45b/attachment.html>