<div dir="ltr">I haven't noticed any errors through xymond_client or from debug mode.<div><br></div><div>After running the xymoncmd line above I get the following:</div><div><br></div><div><div>./xymoncmd xymon 127.0.0.1 "xymondlog wstc-lr0dhcp1.svcs"</div><div>wstc-lr0dhcp1|svcs|red||1477331698|1477331698|1477333498|0|0|15.1.160.11|460159|||Y|</div><div>red Mon Oct 24 11:55:55 2016 - Services NOT ok</div><div>&red BBWin: No matching service - want started/automatic</div><div>&green DHCPServer is started/automatic - want started/automatic</div><div>&green McAfeeFramework is started/automatic - want started/automatic</div><div>&green McShield is started/automatic - want started/automatic</div><div>&green McTaskManager is started/automatic - want started/automatic</div><div>&green VMTools is started/automatic - want started/automatic</div><div><br></div><div>Name StartupType Status DisplayName</div><div>AeLookupSvc manual stopped Application Experience</div><div>ALG manual stopped Application Layer Gateway Service</div><div>AppIDSvc manual stopped Application Identity</div><div>Appinfo manual</div><div> sta]ted Application Information</div><div>AppMgmt manual stopped Application Management</div><div>AppReadiness manual stopped App Readiness</div><div>AppXSvc manual stopped AppX Deployment Service (AppXSVC)</div><div>AudioEndpointBuilder manual stopped Windows Audio Endpoint Builder</div><div>Audiosrv ]</div><div> manual st]</div><div>ped Windows Audio</div><div>]BWin automatic started Big Brother Xymon Client</div><div>BFE automatic started Base Filtering Engine</div><div>BITS automatic started Background Intelligent Transfer Service</div><div>BrokerInfrastructure automatic started Background Tasks Infrastructure Service</div><div>Browser disabled stopped Computer Browser</div><div>CcmExec automatic started SMS Agent Host</div><div>CertPropSvc manual started Certificate Propagation</div><div>CmRcService disabled stopped Configuration Manager Remote Control</div><div>COMSysApp manual started COM+ System Application</div><div>CryptSvc automatic started Cryptographic Services</div><div>DcomLaunch automatic started DCOM Server Process Launcher</div><div>defragsvc manual stopped Optimize drives</div><div>DeviceAssociationService manual stopped Device Association Service</div><div>DeviceInstall manual stopped Device Install Service</div><div>Dhcp automatic started DHCP Client</div><div>DHCPServer automatic started DHCP Server</div><div>DiagTrack automatic started Diagnostics Tracking Service</div><div>Dnscache automatic started DNS Client</div><div>dot3svc manual stopped Wired AutoConfig</div><div>DPS automatic started Diagnostic Policy Service</div><div>DsmSvc manual stopped Device Setup Manager</div><div>Eaphost manual stopped Extensible Authentication Protocol</div><div>EFS manual stopped Encrypting File System (EFS)</div><div>EventLog automatic started Windows Event Log</div><div>EventSystem automatic started COM+ Event System</div><div>fdPHost manual stopped Function Discovery Provider Host</div><div>FDResPub manual stopped Function Discovery Resource Publication</div><div>FontCache automatic started Windows Font Cache Service</div><div>gpsvc automatic started Group Policy Client</div><div>hidserv manual stopped Human Interface Device Service</div><div>hkmsvc manual stopped Health Key and Certificate Managemen</div><div><br></div><div>IEEtwCollectorService ]</div><div> manual stopped ]</div><div>Internet Explorer ETW Collector Servi]</div><div><br></div><div>IKEEXT ]</div><div> automat]c started IKE and AuthIP IPsec Keying Modules</div><div>iphlpsvc automatic started IP Helper</div><div>KeyIso manual started CNG Key Isolation</div><div>KPSSVC manual stopped KDC Proxy Server service (KPS)</div><div>KtmRm manual stopped KtmRm for Distributed Transaction Coordinator</div><div>LanmanServer automatic started Server</div><div>LanmanWorkstation automatic started Workstation</div><div>lltdsvc manual stopped Link-Layer Topology Discovery Mapper</div><div>lmhosts automatic started TCP/IP NetBIOS Helper</div><div>lpasvc manual stopped Microsoft Policy Platform Local Authority</div><div>lppsvc manual stopped Microsoft Policy Platform Processor</div><div>LSM automatic started Local Session Manager</div><div>McAfeeFramework automatic started McAfee Framework Service</div><div>McShield automatic started McAfee McShield</div><div>McTaskManager automatic started McAfee Task Manager</div><div>MMCSS manual stopped Multimedia Class Scheduler</div><div>MpsSvc automatic started Windows Firewall</div><div>MSDTC automatic started Distributed Transaction Coordinator</div><div>MSiSCSI manual stopped Microsoft iSCSI Initiator Service</div><div>msiserver manual stopped Windows Installer</div><div>napagent manual stopped Network Access Protection Agent</div><div>NcaSvc manual stopped Network Connectivity Assistant</div><div>Netlogon automatic started Netlogon</div><div>Netman manual stopped Network Connections</div><div>netprofm manual started Network List Service</div><div>NetTcpPortSharing disabled stopped Net.Tcp Port Sharing Service</div><div>NlaSvc automatic started Network Location Awareness</div><div>nsi automatic started Network Store Interface Service</div><div>PerfHost manual stopped Performance Counter DLL Host</div><div>pla manual stopped Performance Logs & Alerts</div><div>PlugPlay manual started Plug and Play</div><div>PolicyAgent manual started IPsec Policy Agent</div><div>Power automatic started Power</div><div>PrintNotify manual stopped Printer Extensions and Notifications</div><div>ProfSvc automatic started User Profile Service</div><div>RasAuto manual stopped Remote Access Auto Connection Manager</div><div>RasMan manual stopped Remote Access Connection Manager</div><div>RemoteAccess disabled stopped Routing and Remote Access</div><div>RemoteRegistry automatic stopped Remote Registry</div><div>RpcEptMapper automatic started RPC Endpoint Mapper</div><div>RpcLocator manual stopped Remote Procedure Call (RPC) Locator</div><div>RpcSs automatic started Remote Procedure Call (RPC)</div><div>RSoPProv manual stopped Resultant Set of Policy Provider</div><div>sacsvr manual stopped Special Administration Console Helper</div><div>SamSs automatic started Security Accounts Manager</div><div>SCardSvr disabled stopped Smart Card</div><div>ScDeviceEnum manual started Smart Card Device Enumeration Service</div><div>Schedule automatic started Task Scheduler</div><div>SCPolicySvc manual stopped Smart Card Removal Policy</div><div>seclogon manual stopped Secondary Logon</div><div>SENS automatic started System Event Notification Service</div><div>SessionEnv manual started Remote Desktop Configuration</div><div>SharedAccess disabled stopped Internet Connection Sharing (ICS)</div><div>ShellHWDetection automatic started Shell Hardware Detection</div><div>smphost manual stopped Microsoft Storage Spaces SMP</div><div>smstsmgr manual stopped ConfigMgr Task Sequence Agent</div><div>SNMP automatic started SNMP Service</div><div>SNMPTRAP manual stopped SNMP Trap</div><div>Spooler automatic started Print Spooler</div><div>sppsvc automatic stopped Software Protection</div><div>SSDPSRV disabled stopped SSDP Discovery</div><div>SstpSvc manual stopped Secure Socket Tunneling Protocol Service</div><div>svsvc manual stopped Spot Verifier</div><div>swprv manual stopped Microsoft Software Shadow Copy Provider</div><div>SysMain manual stopped Superfetch</div><div>SystemEventsBroker automatic started System Events Broker</div><div>TapiSrv manual stopped Telephony</div><div>TermService manual started Remote Desktop Services</div><div>Themes automatic started Themes</div><div>THREADORDER manual stopped Thread Ordering Server</div><div>TieringEngineService manual stopped Storage Tiers Management</div><div>TrkWks automatic started Distributed Link Tracking Client</div><div>TrustedInstaller manual stopped Windows Modules Installer</div><div>UALSVC automatic started User Access Logging Service</div><div>UI0Detect manual stopped Interactive Services Detection</div><div>UmRdpService manual started Remote Desktop Services UserMode Port Redirector</div><div>upnphost disabled stopped UPnP Device Host</div><div>VaultSvc manual stopped Credential Manager</div><div>vds manual stopped Virtual Disk</div><div>VGAuthService automatic started VMware Alias Manager and Ticket Service</div><div>vmicguestinterface manual stopped Hyper-V Guest Service Interface</div><div>vmicheartbeat manual stopped Hyper-V Heartbeat Service</div><div>vmickvpexchange manual stopped Hyper-V Data Exchange Service</div><div>vmicrdv manual stopped Hyper-V Remote Desktop Virtualization Service</div><div>vmicshutdown manual stopped Hyper-V Guest Shutdown Service</div><div>vmictimesync manual stopped Hyper-V Time Synchronization Service</div><div>vmicvss manual stopped Hyper-V Volume Shadow Copy Requestor</div><div>VMTools automatic started VMware Tools</div><div>vmvss manual stopped VMware Snapshot Provider</div><div>VSS manual stopped Volume Shadow Copy</div><div>W32Time manual started Windows Time</div><div>Wcmsvc automatic started Windows Connection Manager</div><div>WcsPlugInService manual stopped Windows Color System</div><div>WdiServiceHost manual stopped Diagnostic Service Host</div><div>WdiSystemHost manual stopped Diagnostic System Host</div><div>Wecsvc manual stopped Windows Event Collector</div><div>WEPHOSTSVC manual stopped Windows Encryption Provider Host Service</div><div>wercplsupport manual stopped Problem Reports and Solutions Control Panel Support</div><div>WerSvc manual stopped Windows Error Reporting Service</div><div>WinHttpAutoProxySvc manual stopped WinHTTP Web Proxy Auto-Discovery Service</div><div>Winmgmt automatic started Windows Management Instrumentation</div><div>WinRM automatic started Windows Remote Management (WS-Management)</div><div>wmiApSrv manual stopped WMI Performance Adapter</div><div>WPDBusEnum manual stopped Portable Device Enumerator Service</div><div>WSService manual stopped Windows Store Service (WSService)</div><div>wuauserv manual started Windows Update</div><div>wudfsvc manual stopped Windows Driver Foundation - User-mode Driver Framework</div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Oct 21, 2016 at 5:24 PM, J.C. Cleaver <span dir="ltr"><<a href="mailto:cleaver@terabithia.org" target="_blank">cleaver@terabithia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br>
<span class=""><br>
On Fri, October 21, 2016 9:19 am, Greg Krpan wrote:<br>
> As an additional update, I've checked multiple times and the raw data that<br>
> is passed to the system is correct. It appears to be when it is displayed<br>
> on the webpage where the problem occurs. I have not updated xymon- it<br>
> appears as though the version that I am on is still the most recent<br>
> version<br>
> (4.3.27) Is anyone aware of any conflicts that may have been introduced<br>
> after patching? Since this is a production server, I run patches on a<br>
> monthly basis, with the most recent patching occurring on 9/29, which is<br>
> coincidentally when the problem started occurring.<br>
<br>
<br>
</span>Can you run from the command line:<br>
xymoncmd xymon 127.0.0.1 "xymondlog <hostname>.<affectedtestname>"<br>
for a test (like svcs) that you're seeing now? I'm curious if the garbled<br>
data is showing in memory or if it's happening (just) on the web layer.<br>
<br>
I'm not aware of any outstanding issues in xymond_client code that<br>
wouldn't be affecting lots of people, but it's possible we have a bug<br>
here. Most of the recent changes have been either new features or CSP/XSS<br>
fixes at the display layer.<br>
<br>
<br>
Have you noticed any errors coming through xymond_client, or any patterns<br>
from running it in --debug mode?<br>
<span class="HOEnZb"><font color="#888888"><br>
-jc<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
<br>
<br>
><br>
> On Mon, Oct 17, 2016 at 4:27 PM, Greg Krpan <<a href="mailto:gjkrpan43@gmail.com">gjkrpan43@gmail.com</a>> wrote:<br>
><br>
>> I've included an entire "SVCS" status below on a failed status screen.<br>
>> As<br>
>> you can see, it is random as to how and where the output corrupts,<br>
>><br>
>> On the Windows systems, I run BBWin for the client (version 0.13). I<br>
>> should be able to put the xymond_client process into debug mode to<br>
>> monitor<br>
>> for a while as well.. The problem is less predominant on Linux clients<br>
>> than on Windows, but it is occurring on both.<br>
>><br>
>> The server is running on CentOS 7 with current patches.<br>
>> # uname -a<br>
>> Linux ************************* 3.10.0-327.36.1.el7.x86_64 #1 SMP Sun<br>
>> Sep<br>
>> 18 13:04:29 UTC 2016 x86_64 x86_64 x86_64 GNU/Linu<br>
>><br>
>> # cat /etc/centos-release<br>
>> CentOS Linux release 7.2.1511 (Core)<br>
>><br>
>> [# cat /etc/os-release<br>
>> NAME="CentOS Linux"<br>
>> VERSION="7 (Core)"<br>
>> ID="centos"<br>
>> ID_LIKE="rhel fedora"<br>
>> VERSION_ID="7"<br>
>> PRETTY_NAME="CentOS Linux 7 (Core)"<br>
>> ANSI_COLOR="0;31"<br>
>> CPE_NAME="cpe:/o:centos:<wbr>centos:7"<br>
>> HOME_URL="<a href="https://www.centos.org/" rel="noreferrer" target="_blank">https://www.centos.<wbr>org/</a>"<br>
>> BUG_REPORT_URL="<a href="https://bugs.centos.org/" rel="noreferrer" target="_blank">https://bugs.<wbr>centos.org/</a>"<br>
>><br>
>> CENTOS_MANTISBT_PROJECT="<wbr>CentOS-7"<br>
>> CENTOS_MANTISBT_PROJECT_<wbr>VERSION="7"<br>
>> REDHAT_SUPPORT_PRODUCT="<wbr>centos"<br>
>> REDHAT_SUPPORT_PRODUCT_<wbr>VERSION="7"<br>
>><br>
>><br>
>> Name StartupType Status<br>
>> DisplayName<br>
>> AeLookupSvc manual stopped<br>
>> Application Experience<br>
>> ALG manual stopped<br>
>> Application Layer Gateway Service<br>
>> AppHostSvc automatic started<br>
>> Application Host Helper Service<br>
>> AppIDSvc manual stopped<br>
>> Application Identity<br>
>> Appinfo manual stopped<br>
>> Application I<br>
>> forma]ion<br>
>> AppMgmt manual stopped<br>
>> Application Management<br>
>> AppReadiness manual stopped App<br>
>> Readiness<br>
>> AppXSvc manual stopped AppX<br>
>> Deployment Service (AppXSVC)<br>
>> aspnet_state manual stopped <a href="http://ASP.NET" rel="noreferrer" target="_blank">ASP.NET</a><br>
>> State Service<br>
>> AudioEndpointBuilder man<br>
>> al stopped Wi]dows Audio Endpoint Builder<br>
>> Audiosrv manual stopped Windows<br>
>> Audio<br>
>> BBWin automatic started Big<br>
>> Brother Xymon Client<br>
>> BFE automatic started Base<br>
>> Filtering Engine<br>
>> BITS automatic started Back<br>
>> round Intelligent Trans]<br>
>> r Service<br>
>> BrokerInfrastru]<br>
>> ure automatic ]<br>
>> started Background Tasks]<br>
>> nfrastructure Service<br>
>> Browser ]<br>
>> ]isabled stopped Computer Browser<br>
>> CcmExec automatic started SMS<br>
>> Agent Host<br>
>> CertPropSvc manual started<br>
>> Certificate Propagation<br>
>> CmRcService disabled stopped<br>
>> Configuration Manager Remote Control<br>
>> COMSysApp manual started COM+<br>
>> System Application<br>
>> CryptSvc automatic started<br>
>> Cryptographic Services<br>
>> DcomLaunch automatic started DCOM<br>
>> Server Process Launcher<br>
>> defragsvc manual stopped Optimize<br>
>> drives<br>
>> DeviceAssociationService manual stopped Device<br>
>> Association Service<br>
>> DeviceInstall manual stopped Device<br>
>> Install Service<br>
>> Dhcp automatic started DHCP<br>
>> Client<br>
>> DiagTrack automatic started<br>
>> Diagnostics Tracking Service<br>
>> Dnscache automatic started DNS<br>
>> Client<br>
>> dot3svc manual stopped Wired<br>
>> AutoConfig<br>
>> DPS automatic started<br>
>> Diagnostic Policy Service<br>
>> DsmSvc manual started Device<br>
>> Setup Manager<br>
>> Eaphost manual stopped<br>
>> Extensible Authentication Protocol<br>
>> EFS manual stopped<br>
>> Encrypting File System (EFS)<br>
>> EventLog automatic started Windows<br>
>> Event Log<br>
>> EventSystem automatic started COM+<br>
>> Event System<br>
>> fdPHost manual stopped Function<br>
>> Discovery Provider Host<br>
>> FDResPub manual stopped Function<br>
>> Discovery Resource Publication<br>
>> FontCache automatic started Windows<br>
>> Font Cache Service<br>
>> gpsvc automatic started Group<br>
>> Policy Client<br>
>> hidserv manual stopped Human<br>
>> Interface Device Service<br>
>> hkmsvc manual stopped Health<br>
>> Key and Certificate Management<br>
>> IEEtwCollectorService manual stopped Internet<br>
>> Explorer ETW Collector Service<br>
>> IISADMIN automatic started IIS<br>
>> Admin Service<br>
>> IKEEXT automatic started IKE and<br>
>> AuthIP IPsec Keying Modules<br>
>> iphlpsvc automatic started IP<br>
>> Helper<br>
>> KeyIso manual started CNG Key<br>
>> Isolation<br>
>> KPSSVC manual stopped KDC<br>
>> Proxy Server service (KPS)<br>
>> KtmRm manual stopped KtmRm<br>
>> for Distributed Transaction Coordinator<br>
>> LanmanServer automatic started Server<br>
>> LanmanWorkstation automatic started<br>
>> Workstation<br>
>> lltdsvc manual stopped<br>
>> Link-Layer Topology Discovery Mapper<br>
>> lmhosts automatic started TCP/IP<br>
>> NetBIOS Helper<br>
>> lpasvc manual stopped<br>
>> Microsoft Policy Platform Local Authority<br>
>> lppsvc manual stopped<br>
>> Microsoft Policy Platform Processor<br>
>> LSM automatic started Local<br>
>> Session Manager<br>
>> McAfeeFramework automatic started McAfee<br>
>> Framework Service<br>
>> McShield automatic started McAfee<br>
>> McShield<br>
>> McTaskManager automatic started McAfee<br>
>> Task Manager<br>
>> MMCSS manual stopped<br>
>> Multimedia Class Scheduler<br>
>> MpsSvc<br>
>> automatic started ] Windows Firewall<br>
>> MSDTC automatic started<br>
>> Distributed Transaction Coordinator<br>
>> MSiSCSI manual stopped<br>
>> Microsoft iSCSI Initiator Service<br>
>> msiserver manual stopped Windows<br>
>> Installer<br>
>> napagent manual stopped Network<br>
>> Access Protection Agent<br>
>> NcaSvc manual stopped Network<br>
>> Connectivity Assistant<br>
>> Netlogon automatic started Netlogon<br>
>> Netman manual stopped Network<br>
>> Connections<br>
>> netprofm manual started Network<br>
>> List Service<br>
>> NetTcpPortSharing disabled stopped Net.Tcp<br>
>> Port Sharing Service<br>
>> NlaSvc automatic started Network<br>
>> Location Awareness<br>
>> nsi automatic started Network<br>
>> Store Interface Service<br>
>> PerfHost manual stopped<br>
>> Performance Counter DLL Host<br>
>> pla manual stopped<br>
>> Performance Logs & Alerts<br>
>> PlugPlay manual started Plug and<br>
>> Play<br>
>> PolicyAgent manual started IPsec<br>
>> Policy Agent<br>
>> Power automatic started Power<br>
>> PrintNotify manual stopped Printer<br>
>> Extensions and Notifications<br>
>> ProfSvc automatic started User<br>
>> Profile Service<br>
>> QBCFMonitorService automatic started<br>
>> QuickBooks Database Manager Service<br>
>> QBFCService manual stopped Intuit<br>
>> QuickBooks FCS<br>
>> QuickBooksDB17 automatic started<br>
>> QuickBooksDB17<br>
>> RasAuto manual stopped Remote<br>
>> Access Auto Connection Manager<br>
>> RasMan manual stopped Remote<br>
>> Access Connection Manager<br>
>> RemoteAccess disabled stopped Routing<br>
>> and Remote Access<br>
>> RemoteRegistry automatic stopped Remote<br>
>> Registry<br>
>> RpcEptMapper automatic started RPC<br>
>> Endpoint Mapper<br>
>> RpcLocator manual stopped Remote<br>
>> Procedure Call (RPC) Locator<br>
>> RpcSs automatic started Remote<br>
>> Procedure Call (RPC)<br>
>> RSoPProv manual stopped<br>
>> Resultant Set of Policy Provider<br>
>> sacsvr manual stopped Special<br>
>> Administration Console Helper<br>
>> SamSs automatic started Security<br>
>> Accounts Manager<br>
>> SCardSvr disabled stopped Smart<br>
>> Card<br>
>> ScDeviceEnum manual stopped Smart<br>
>> Card Device Enumeration Service<br>
>> Schedule automatic started Task<br>
>> Scheduler<br>
>> SCPolicySvc manual stopped Smart<br>
>> Card Removal Policy<br>
>> seclogon manual stopped<br>
>> Secondary Logon<br>
>> SENS automatic started System<br>
>> Event Notification Service<br>
>> SessionEnv manual started Remote<br>
>> Desktop Configuration<br>
>> SharedAccess disabled stopped Internet<br>
>> Connection Sharing (ICS)<br>
>> ShellHWDetection automatic stopped Shell<br>
>> Hardware Detection<br>
>> smphost manual stopped<br>
>> Microsoft Storage Spaces SMP<br>
>> smstsmgr manual stopped<br>
>> ConfigMgr Task Sequence Agent<br>
>> SNMP automatic started SNMP<br>
>> Service<br>
>> SNMPTRAP automatic started SNMP<br>
>> Trap<br>
>> Spooler automatic started Print<br>
>> Spooler<br>
>> sppsvc automatic stopped Software<br>
>> Protection<br>
>> SSDPSRV disabled stopped SSDP<br>
>> Discovery<br>
>> SstpSvc manual stopped Secure<br>
>> Socket Tunneling Protocol Service<br>
>> svsvc manual stopped Spot<br>
>> Verifier<br>
>> swprv manual stopped<br>
>> Microsoft Software Shadow Copy Provider<br>
>> SysMain manual stopped<br>
>> Superfetch<br>
>> SystemEventsBroker automatic started System<br>
>> Events Broker<br>
>> TapiSrv manual stopped<br>
>> Telephony<br>
>> TermService manual started Remote<br>
>> Desktop Services<br>
>> Themes automatic started Themes<br>
>> THREADORDER manual stopped Thread<br>
>> Ordering Server<br>
>> TieringEngineService manual stopped Storage<br>
>> Tiers Management<br>
>> TrkWks automatic started<br>
>> Distributed Link Tracking Client<br>
>> TrustedInstaller manual stopped Windows<br>
>> Modules Installer<br>
>> UALSVC automatic started User<br>
>> Access Logging Service<br>
>> UI0Detect manual stopped<br>
>> Interactive Services Detection<br>
>> UmRdpService manual started Remote<br>
>> Desktop Services UserMode Port Redirector<br>
>> upnphost disabled stopped UPnP<br>
>> Device Host<br>
>> VaultSvc manual stopped<br>
>> Credential Manager<br>
>> vds manual stopped Virtual<br>
>> Disk<br>
>> VGAuthService automatic started VMware<br>
>> Alias Manager and Ticket Service<br>
>> vmicguestinterface manual stopped Hyper-V<br>
>> Guest Service Interface<br>
>> vmicheartbeat manual stopped Hyper-V<br>
>> Heartbeat Service<br>
>> vmickvpexchange manual stopped Hyper-V<br>
>> Data Exchange Service<br>
>> vmicrdv manual stopped Hyper-V<br>
>> Remote Desktop Virtualization Service<br>
>> vmicshutdown manual stopped Hyper-V<br>
>> Guest Shutdown Service<br>
>> vmictimesync manual stopped Hyper-V<br>
>> Time Synchronization Service<br>
>> vmicvss manual stopped Hyper-V<br>
>> Volume Shadow Copy Requestor<br>
>> VMTools automatic started VMware<br>
>> Tools<br>
>> vmvss manual stopped VMware<br>
>> Snapshot Provider<br>
>> VSS manual stopped Volume<br>
>> Shadow Copy<br>
>> W32Time manual started Windows<br>
>> Time<br>
>> w3logsvc manual stopped W3C<br>
>> Logging Service<br>
>> W3SVC automatic started World<br>
>> Wide Web Publishing Service<br>
>> WAS manual started Windows<br>
>> Process Activation Service<br>
>> Wcmsvc automatic started Windows<br>
>> Connection Manager<br>
>> WcsPlugInService manual stopped Windows<br>
>> Color System<br>
>> WdiServiceHost manual stopped<br>
>> Diagnostic Service Host<br>
>> WdiSystemHost manual stopped<br>
>> Diagnostic System Host<br>
>> Wecsvc manual stopped Windows<br>
>> Event Collector<br>
>> WEPHOSTSVC manual stopped Windows<br>
>> Encryption Provider Host Service<br>
>> wercplsupport manual stopped Problem<br>
>> Reports and Solutions Control Panel Support<br>
>> WerSvc manual stopped Windows<br>
>> Error Reporting Service<br>
>> WinHttpAutoProxySvc manual started WinHTTP<br>
>> Web Proxy Auto-Discovery Service<br>
>> Winmgmt automatic started Windows<br>
>> Management Instrumentation<br>
>> WinRM automatic started Windows<br>
>> Remote Management (WS-Management)<br>
>> wmiApSrv manual stopped WMI<br>
>> Performance Adapter<br>
>> WPDBusEnum manual stopped Portable<br>
>> Device Enumerator Service<br>
>> WSService manual stopped Windows<br>
>> Store Service (WSService)<br>
>> wuauserv automatic started Windows<br>
>> Update<br>
>> wudfsvc manual stopped Windows<br>
>> Driver Foundation - User-mode Driver Framework<br>
>><br>
>><br>
>> On Mon, Oct 17, 2016 at 4:10 PM, Japheth Cleaver<br>
>> <<a href="mailto:cleaver@terabithia.org">cleaver@terabithia.org</a>><br>
>> wrote:<br>
>><br>
>>> Hmm. Does the data after the corrupted lines appear to match the<br>
>>> remaining data for the server in question? From the sample below it<br>
>>> seems<br>
>>> not (as I believe this is reported in alphabetical order), which might<br>
>>> indicate indicate a broader memory corruption issue going on within<br>
>>> xymond_client, where it's somehow losing track of the end or garbling<br>
>>> the<br>
>>> data in the buffer being used for holding status output. If it's<br>
>>> causing a<br>
>>> false positive, then it's not merely the final output that's the<br>
>>> problem,<br>
>>> but something occurring earlier in processing.<br>
>>><br>
>>> What OS+distro is the server running on?<br>
>>> Any chance you might be able to run xymond_client in debug mode for a<br>
>>> bit<br>
>>> while this is occurring?<br>
>>><br>
>>> -jc<br>
>>><br>
>>><br>
>>><br>
>>> On 10/17/2016 7:56 AM, Greg Krpan wrote:<br>
>>><br>
>>> Hi JC-<br>
>>><br>
>>> Thanks for the response.<br>
>>><br>
>>> I am using Xymon 4.3.27 currently. The raw client data looks fine-<br>
>>> there<br>
>>> are no corrupted lines and no added brackets or special characters that<br>
>>> I<br>
>>> can see. This only occurs on the status pages.<br>
>>><br>
>>> The server has been running since May, and this particular problem<br>
>>> started at the end of Sept., after running Windows Update on my<br>
>>> servers,<br>
>>> but as both Windows and Linux clients are showing the behavior, I have<br>
>>> ruled out the updates as the issue.<br>
>>><br>
>>> I have tried restarting the service with no effect on behavior and<br>
>>> there<br>
>>> is nothing in the log files that show a problem that I can see. The<br>
>>> level<br>
>>> of false positives due to formatting errors has remained relatively<br>
>>> consistent, and tends to be limited to the PROCS (Win, Linux) and SVCS<br>
>>> (Win<br>
>>> only) tests, but occasionally will see the same error occurring on the<br>
>>> DISK<br>
>>> and CPU tests, although that is significantly less frequent, and is not<br>
>>> across all configured machines. The PROCS/SVCS tests are showing<br>
>>> random<br>
>>> errors on one machine or another approximately every 5 minutes.<br>
>>><br>
>>> Thanks<br>
>>> Greg.<br>
>>><br>
>>> On Fri, Oct 14, 2016 at 6:52 PM, J.C. Cleaver <<a href="mailto:cleaver@terabithia.org">cleaver@terabithia.org</a>><br>
>>> wrote:<br>
>>><br>
>>>><br>
>>>><br>
>>>> On Fri, October 14, 2016 3:52 pm, Greg Krpan wrote:<br>
>>>> > Recently, my monitoring has been generating frequent errors that are<br>
>>>> > false,<br>
>>>> > due to improper formatting, It is happening on both Windows and<br>
>>>> Linux<br>
>>>> > clients. I've included an example of how the tests are sending data<br>
>>>> back<br>
>>>> > to the xymon server. I have not made any changes to my client or<br>
>>>> server<br>
>>>> > configurations. Has anyone else been experiencing this behavior, or<br>
>>>> know<br>
>>>> > of a fix?<br>
>>>> ><br>
>>>> > Greg.<br>
>>>> ><br>
>>>> > Name StartupType Status<br>
>>>> > DisplayName<br>
>>>> > AeLookupSvc manual stopped<br>
>>>> > Application Experience<br>
>>>> > ALG manual stopped<br>
>>>> > Application Layer Gateway Service<br>
>>>> > AppIDSvc manual stopped<br>
>>>> > Application Identity<br>
>>>> > Appinfo manual stopped<br>
>>>> > Application Information<br>
>>>> > AppMgmt manual stopped<br>
>>>> > Application Management<br>
>>>> > AppReadiness manual stopped App<br>
>>>> > Readiness<br>
>>>> > AppXSvc manual stopped AppX<br>
>>>> > Deployment Service (AppXSVC)<br>
>>>> > AudioEndpointBuilder manual<br>
>>>> > toppe] Windows Audio Endpoint Builder<br>
>>>> > Audiosrv manual stopped<br>
>>>> Windows<br>
>>>> > Audio<br>
>>>> > BBWin automatic started Big<br>
>>>> > Brother Xymon Client<br>
>>>> > BFE automatic started Base<br>
>>>> > Filtering Engine<br>
>>>> > BITS automatic started<br>
>>>> > Background Intelligent Transfer Serv<br>
>>>> > ce<br>
>>>> > BrokerInfrastructure ] automatic started<br>
>>>> > Background Tasks Infrastructure Service<br>
>>>> > Browser disabled stopped<br>
>>>> Computer<br>
>>>> > Browser<br>
>>>> > CcmExec automatic started SMS<br>
>>>> Agent<br>
>>>> > Host<br>
>>>> > CertPropSvc manual started<br>
>>>> > Certificate Propagation<br>
>>>> > CmRcService disabled stopped<br>
>>>> > Configuration Manager Remote Control<br>
>>>> > COMSysApp manual<br>
>>>> > started COM+ Sys]<br>
>>>> > m Application<br>
>>>> > CryptSvc]<br>
>>>> > ]<br>
>>>> > utomatic started Cr]<br>
>>>> > tographic Services<br>
>>>> > DcomLaunch ]<br>
>>>> > automatic sta]<br>
>>>> > ed DCOM Serv]<br>
>>>> > Process Launcher<br>
>>>> > defra]svc manual stopped<br>
>>>> Optimize<br>
>>>> > drives<br>
>>>> > DeviceAssociationService manual stopped<br>
>>>> Device<br>
>>>> > Association Service<br>
>>>><br>
>>>><br>
>>>> Hi Greg,<br>
>>>><br>
>>>> Is there anything unusual about the process names on the lines<br>
>>>> immediately<br>
>>>> before the corruption? There's a known issue in that lines starting<br>
>>>> with<br>
>>>> a<br>
>>>> bracket will cause missing data, and this can happen more frequently<br>
>>>> on<br>
>>>> Windows servers just by virtue of some of the data that's coming<br>
>>>> across,<br>
>>>> but that doesn't appear to be causing this specific issue.<br>
>>>><br>
>>>><br>
>>>> Can you confirm which version of Xymon server you're using? Do you see<br>
>>>> the<br>
>>>> same corruption in the "raw" Client Data for the affected servers, or<br>
>>>> is<br>
>>>> it only occurring on the status pages?<br>
>>>><br>
>>>> Also -- anything unusual in the log files? Has this problem been<br>
>>>> constant<br>
>>>> since it started, or is it getting worse? Does restarting the xymon<br>
>>>> service fix it (temporarily)?<br>
>>>><br>
>>>><br>
>>>> Regards,<br>
>>>> -jc<br>
>>>><br>
>>>><br>
>>><br>
>>><br>
>>> --<br>
>>> ------------------------------<wbr>------------------------------<wbr>---------------<br>
>>><br>
>>> In honor of those who lost their lives exploring the final frontier:<br>
>>> Apollo 1; January 27, 1967 Virgil "Gus" Ivan Grissom, Edward Higgins<br>
>>> White II, Roger Bruce Chaffee<br>
>>> Space Shuttle Challenger, Mission STS-51-L; January 28, 1986 Francis R.<br>
>>> Scobee, Michael J. Smith, Judith A. Resnik, Ellison S. Onizuka, Ronald<br>
>>> E.<br>
>>> McNair, Gregory B. Jarvis, Sharon Christa McAuliffe<br>
>>> Space Shuttle Columbia, Mission STS-107; February 1, 2003 Rick D.<br>
>>> Husband, William C. McCool, Michael P. Anderson, Kalpana Chawla, David<br>
>>> M.<br>
>>> Brown, Laurel Blair Salton Clark, Ilan Ramon<br>
>>><br>
>>><br>
>>><br>
>><br>
>><br>
>> --<br>
>> ------------------------------<wbr>------------------------------<wbr>---------------<br>
>><br>
>> In honor of those who lost their lives exploring the final frontier:<br>
>> Apollo 1; January 27, 1967 Virgil "Gus" Ivan Grissom, Edward Higgins<br>
>> White<br>
>> II, Roger Bruce Chaffee<br>
>> Space Shuttle Challenger, Mission STS-51-L; January 28, 1986 Francis R.<br>
>> Scobee, Michael J. Smith, Judith A. Resnik, Ellison S. Onizuka, Ronald<br>
>> E.<br>
>> McNair, Gregory B. Jarvis, Sharon Christa McAuliffe<br>
>> Space Shuttle Columbia, Mission STS-107; February 1, 2003 Rick D.<br>
>> Husband,<br>
>> William C. McCool, Michael P. Anderson, Kalpana Chawla, David M. Brown,<br>
>> Laurel Blair Salton Clark, Ilan Ramon<br>
>><br>
><br>
><br>
><br>
> --<br>
> ------------------------------<wbr>------------------------------<wbr>---------------<br>
> In honor of those who lost their lives exploring the final frontier:<br>
> Apollo 1; January 27, 1967 Virgil "Gus" Ivan Grissom, Edward Higgins White<br>
> II, Roger Bruce Chaffee<br>
> Space Shuttle Challenger, Mission STS-51-L; January 28, 1986 Francis R.<br>
> Scobee, Michael J. Smith, Judith A. Resnik, Ellison S. Onizuka, Ronald E.<br>
> McNair, Gregory B. Jarvis, Sharon Christa McAuliffe<br>
> Space Shuttle Columbia, Mission STS-107; February 1, 2003 Rick D. Husband,<br>
> William C. McCool, Michael P. Anderson, Kalpana Chawla, David M. Brown,<br>
> Laurel Blair Salton Clark, Ilan Ramon<br>
><br>
<br>
<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>--------------------------------------------------------------------------- <br>In honor of those who lost their lives exploring the final frontier: <br>Apollo 1; January 27, 1967 Virgil "Gus" Ivan Grissom, Edward Higgins White II, Roger Bruce Chaffee <br></div><div style="text-align:left">Space Shuttle Challenger, Mission STS-51-L; January 28, 1986 Francis R. Scobee, Michael J. Smith, Judith A. Resnik, Ellison S. Onizuka, Ronald E. McNair, Gregory B. Jarvis, Sharon Christa McAuliffe <br></div><div>Space Shuttle Columbia, Mission STS-107; February 1, 2003 Rick D. Husband, William C. McCool, Michael P. Anderson, Kalpana Chawla, David M. Brown, Laurel Blair Salton Clark, Ilan Ramon<br></div></div></div>
</div>