[Xymon] some graphs 5 hours behind

[Novosielski, Ryan]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Not a one from me -- I'm very new to graphing, and it's seemed like
once you get it working, it just works.

Might check the rrd logs though and try rrddump or whatever command on
the data to see if looking through it gives you any clues.

On 10/09/2012 01:23 PM, Steve Holmes wrote:
> Yes, they are in sync. In fact the phenomena applies to graphs for
> the xymon server itself. The rrd files are now 7 hours and 15
> minutes behind. So it becomes worse.
> 
> Any thoughts?
> 
> Thanks, Steve
> 
> On Mon, Oct 8, 2012 at 8:01 PM, Steve Holmes <sholmes42 at gmail.com 
> <mailto:sholmes42 at gmail.com>> wrote:
> 
> You are right. I'm pretty sure they are all in sync, but will
> verify that tomorrow. Thanks Steve
> 
> Wherever you go, there you are.
> 
> On Oct 8, 2012, at 6:32 PM, "Novosielski, Ryan"
> <novosirj at umdnj.edu <mailto:novosirj at umdnj.edu>> wrote:
> 
>> You didn't mention that you checked that all of your clocks are
>> in sync/in the right timezone. Did you?
>> 
>> 
>> *From*: Steve Holmes [mailto:sholmes42 at mac.com] *Sent*: Monday,
>> October 08, 2012 05:40 PM *To*: xymon at xymon.com
>> <mailto:xymon at xymon.com> <xymon at xymon.com 
>> <mailto:xymon at xymon.com>> *Subject*: [Xymon] some graphs 5 hours
>> behind
>> 
>> We are working on upgrading, but in the mean time I'm trying to 
>> keep our Xymon 4.2.3 on an older SPARC running and making sense. 
>> So, for some as yet undetermined reason some (but not all) rrd 
>> files have started being updated about 5 hours behind. I.e. we
>> can correlate events that we know happened at certain times with
>> the graphs so the clock isn't somehow messed up (besides it looks
>> ok to us in the shell), and when I do an rrdtool dump it is
>> clear that the data is being added from 5 hours ago, or at least
>> the last entry in the 12 hour database is stamped from about 5
>> hours earlier.
>> 
>> It appears to only be affecting the rrd files for the graphs
>> that are only on the trends page. I.e. graphs that appear on the
>> test pages (e.g. memory, cpu, disk) are not affected.
>> 
>> The two hobbit_rrd processes are running with 30+ hours and 640 
>> minutes of cpu time according to top. The system has been up for 
>> 30 days but Xymon was restarted about 3 weeks ago.
>> 
>> The effect of this is the graphs, of course, for the data that
>> is behind looks like it stopped recording 5 hours ago. As we
>> watch it the data appears but there is this gap for the last 5
>> hours. So the customers are uncomfortable with this.
>> 
>> My questions are: What can be done about it? I hesitate to stop 
>> and start Xymon for fear of loosing all of that data. What can
>> be the cause? I know the server is slightly overloaded and has
>> been for a few months, but this is really weird.
>> 
>> We also have been getting warnings (yellow) from bbtest Whoops !
>> bb failed to send message - timeout Which results in gaps in the
>> data, but those are usually only a few minutes in duration and
>> are only occasional.
>> 
>> Thanks, Steve -- If they give you ruled paper, write the other
>> way. -Juan Ramon Jimenez, poet, Nobel Prize in literature
>> (1881-1958)
>> 
>> I prayed for freedom for twenty years, but received no answer 
>> until I prayed with my legs. -Frederick Douglass, Former slave, 
>> abolitionist, editor, and orator (1817-1895)
>> 
>> _______________________________________________ Xymon mailing
>> list Xymon at xymon.com <mailto:Xymon at xymon.com> 
>> http://lists.xymon.com/mailman/listinfo/xymon
> 
> 
> 
> 
> -- If they give you ruled paper, write the other way. -Juan Ramon
> Jimenez, poet, Nobel Prize in literature (1881-1958)
> 
> I prayed for freedom for twenty years, but received no answer until
> I prayed with my legs. -Frederick Douglass, Former slave,
> abolitionist, editor, and orator (1817-1895)
> 


- -- 
- ---- _  _ _  _ ___  _  _  _
|Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Sr. Systems Programmer
|$&| |__| |  | |__/ | \| _| |novosirj at umdnj.edu - 973/972.0922 (2-0922)
\__/ Univ. of Med. and Dent.|IST/EI-Academic Svcs. - ADMC 450, Newark
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iEYEARECAAYFAlB0eK4ACgkQmb+gadEcsb4LvQCgoV6SiKpB3MwYyXz5p0N0irtW
H+wAoMW11cGyBhR0+KdlTRLwXINqU5ts
=8F6B
-----END PGP SIGNATURE-----