<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 12 (filtered medium)">
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.Section1
{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal>I am running xymon 4.3.0-0 beta 2 on a RHEL 5.4 x86_64 arch.<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>Every 5mins or so, I get an alert that hobbit_rrd has
crashed, and I get a ton of core files.<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal># uname -a<o:p></o:p></p>
<p class=MsoNormal>Linux xymon 2.6.18-164.el5xen #1 SMP Tue Aug 18 15:59:52 EDT
2009 x86_64 x86_64 x86_64 GNU/Linux<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal># rpm -qa |grep rrd<o:p></o:p></p>
<p class=MsoNormal>rrdtool-1.2.23-1.el5.rf<o:p></o:p></p>
<p class=MsoNormal>rrdtool-devel-1.2.23-1.el5.rf<o:p></o:p></p>
<p class=MsoNormal>perl-rrdtool-1.2.23-1.el5.rf<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>[root@xymon server]# file tmp/core.11912 <o:p></o:p></p>
<p class=MsoNormal>tmp/core.11912: ELF 64-bit LSB core file AMD x86-64, version
1 (SYSV), SVR4-style, from 'hobbitd_rrd'<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>Here is the backtrace:<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal># gdb bin/hobbitd_rrd tmp/core.11912 <o:p></o:p></p>
<p class=MsoNormal>GNU gdb Fedora (6.8-37.el5)<o:p></o:p></p>
<p class=MsoNormal>Copyright (C) 2008 Free Software Foundation, Inc.<o:p></o:p></p>
<p class=MsoNormal>License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html><o:p></o:p></p>
<p class=MsoNormal>This is free software: you are free to change and
redistribute it.<o:p></o:p></p>
<p class=MsoNormal>There is NO WARRANTY, to the extent permitted by law.
Type "show copying"<o:p></o:p></p>
<p class=MsoNormal>and "show warranty" for details.<o:p></o:p></p>
<p class=MsoNormal>This GDB was configured as
"x86_64-redhat-linux-gnu"...<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /usr/lib64/librrd.so.2...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /usr/lib64/librrd.so.2<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/libpcre.so.0...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/libpcre.so.0<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/librt.so.1...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/librt.so.1<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/libc.so.6...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/libc.so.6<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /usr/lib64/libfreetype.so.6...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /usr/lib64/libfreetype.so.6<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /usr/lib64/libpng12.so.0...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /usr/lib64/libpng12.so.0<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /usr/lib64/libz.so.1...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /usr/lib64/libz.so.1<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /usr/lib64/libart_lgpl_2.so.2...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /usr/lib64/libart_lgpl_2.so.2<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/libm.so.6...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/libm.so.6<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/libpthread.so.0...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/libpthread.so.0<o:p></o:p></p>
<p class=MsoNormal>Reading symbols from /lib64/ld-linux-x86-64.so.2...done.<o:p></o:p></p>
<p class=MsoNormal>Loaded symbols for /lib64/ld-linux-x86-64.so.2<o:p></o:p></p>
<p class=MsoNormal>Core was generated by `hobbitd_rrd
--rrddir=/opt/hobbit/data/rrd'.<o:p></o:p></p>
<p class=MsoNormal>Program terminated with signal 6, Aborted.<o:p></o:p></p>
<p class=MsoNormal>[New process 11912]<o:p></o:p></p>
<p class=MsoNormal>#0 0x000000398ec30265 in raise () from
/lib64/libc.so.6<o:p></o:p></p>
<p class=MsoNormal>(gdb) bt<o:p></o:p></p>
<p class=MsoNormal>#0 0x000000398ec30265 in raise () from
/lib64/libc.so.6<o:p></o:p></p>
<p class=MsoNormal>#1 0x000000398ec31d10 in abort () from
/lib64/libc.so.6<o:p></o:p></p>
<p class=MsoNormal>#2 0x00000000004201c3 in sigsegv_handler
(signum=<value optimized out>) at sig.c:57<o:p></o:p></p>
<p class=MsoNormal>#3 <signal handler called><o:p></o:p></p>
<p class=MsoNormal>#4 0x000000385dc2a823 in write_RRA_row
(rrd=0x7fffea126180, rra_idx=3, rra_current=0x7fffea126218, <o:p></o:p></p>
<p class=MsoNormal> CDP_scratch_idx=<value optimized
out>, rrd_file=0x1a3e84f0, pcdp_summary=0x0, <o:p></o:p></p>
<p class=MsoNormal> rra_time=0x7fffea126208, rrd_mmaped_file=0x2b2a8173a000)
at /usr/include/bits/string3.h:51<o:p></o:p></p>
<p class=MsoNormal>#5 0x000000385dc2c3e3 in _rrd_update (<o:p></o:p></p>
<p class=MsoNormal> filename=0x63b6c0
"/opt/hobbit/data/rrd/xymon/vmstat.rrd", <o:p></o:p></p>
<p class=MsoNormal> tmplt=<value optimized out>,
argc=9, argv=0x7fffea1262d0, pcdp_summary=0x0) at rrd_update.c:1230<o:p></o:p></p>
<p class=MsoNormal>#6 0x000000385dc2d207 in rrd_update (argc=13,
argv=0x7fffea1262b0) at rrd_update.c:183<o:p></o:p></p>
<p class=MsoNormal>#7 0x000000000040497b in flush_cached_updates
(cacheitem=0x1a3a3580, newdata=<value optimized out>)<o:p></o:p></p>
<p class=MsoNormal> at do_rrd.c:223<o:p></o:p></p>
<p class=MsoNormal>#8 0x00000000004065b9 in create_and_update_rrd
(hostname=0x2b2a8152bfb7 "xymon", <o:p></o:p></p>
<p class=MsoNormal> testname=0x2b2a8152bfc8
"vmstat", classname=<value optimized out>, <o:p></o:p></p>
<p class=MsoNormal> pagepaths=<value optimized out>,
creparams=0x1a3da170, template=0x1a3a2bb0) at do_rrd.c:393<o:p></o:p></p>
<p class=MsoNormal>#9 0x000000000040d8b2 in do_vmstat_rrd
(hostname=0x2b2a8152bfb7 "xymon", <o:p></o:p></p>
<p class=MsoNormal> testname=0x2b2a8152bfc8
"vmstat", classname=0x2b2a8152bfcf "linux",
pagepaths=0x426002 "", <o:p></o:p></p>
<p class=MsoNormal> msg=<value optimized out>,
tstamp=<value optimized out>) at rrd/do_vmstat.c:436<o:p></o:p></p>
<p class=MsoNormal>#10 0x0000000000410885 in update_rrd
(hostname=0x2b2a8152bfb7 "xymon", <o:p></o:p></p>
<p class=MsoNormal> testname=0x2b2a8152bfc8
"vmstat", msg=0x2b2a8152bfd6 "data xymon.vmstat\nlinux\n
0", <o:p></o:p></p>
<p class=MsoNormal> tstamp=1257351440, sender=<value
optimized out>, ldef=<value optimized out>, <o:p></o:p></p>
<p class=MsoNormal> classname=0x2b2a8152bfcf
"linux", pagepaths=0x426002 "") at do_rrd.c:591<o:p></o:p></p>
<p class=MsoNormal>#11 0x0000000000403017 in main (argc=<value optimized
out>, argv=0x7fffea129908)<o:p></o:p></p>
<p class=MsoNormal> at hobbitd_rrd.c:366<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>I have done fresh recompiles of multiple versions of
xymon, used different versions of the rrd packages, and this error still
constantly pops up.<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>I get a ton of errors in rrd-data.log:<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>2009-11-04 11:17:24 Peer at 0.0.0.0:0 failed: Broken pipe<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:17:24 Peer not up, flushing message queue<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:27:26 Peer at 0.0.0.0:0 failed: Broken pipe<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:27:26 Peer not up, flushing message queue<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:42:33 Peer at 0.0.0.0:0 failed: Broken pipe<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:42:33 Peer not up, flushing message queue<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:46:08 Peer at 0.0.0.0:0 failed: Broken pipe<o:p></o:p></p>
<p class=MsoNormal>2009-11-04 11:46:08 Peer not up, flushing message queue<o:p></o:p></p>
<p class=MsoNormal><o:p> </o:p></p>
<p class=MsoNormal>I’ve honestly never had this problem before, and I’m
pretty baffled.<o:p></o:p></p>
</div>
</body>
</html>