help setting up SNMP traps to Xymon

[Nicole Beck <nskyrca (at) syr.edu>]

Hello,
I'm running Xymon 4.2.3 on RHEL 5.4 and I'm trying to setup Xymon to receive SNMP traps from our Oracle database servers.    We are also running Oracle Enterprise Manager on another server (we call it the "grid") that monitors the Oracle database servers too, but our DBA's want to use Xymon to alert them of Oracle problems instead of the grid server so they don't get alerts from two different places.   The DBA's manage OEM(therefore I'm not familiar with it), and have configured it to recieve SNMP traps and send them to Xymon.

I configured the Xymon server to receive traps using the documentation at http://cerebro.victoriacollege.edu/hobbit-trap.html.  We do receive traps, but there are two problems:

1-      The trap status diamond does not change color when it gets a trap or when the trap clears.  My understanding is that this is set in the Oracle MIBS that are translated to the /etc/snmp/snmptt.conf.oracle file.  I'm not sure how to change the file to get it to give different alerts.  If I change the word "NORMAL" in the following line to "SEVERE" the trap status will go red, but will not return to green when the trap clears. Any suggestions on how to fix this?

EVENT oraEM4Alert .1.3.6.1.4.1.111.15.2.0.1 "Status Events" Normal

2-      The traps status changes for the grid server instead of the database server with the problem.  Drilling down into the "trap" status, you will see an error for the database server though.   The snmptrapd.log and snmptt.log files (examples below) show the traps coming from the grid server.  Does anyone know how to get the traps to appear under the database server name rather than the grid server?

Example snmptrapd.log entry (host name changed):
2010-10-14 19:04:49 grid-server [xxx.xxx.xxx.xxx] (via UDP: [xxx.xxx.xxx.xxx]:51617) TRAP, SNMP v1, community public
        .1.3.6.1.4.1.111.15.2 Enterprise Specific Trap (1) Uptime: 0:06:31.00
        .1.3.6.1.4.1.111.15.1.1.1.2.1 = STRING: "DB00157.world" .1.3.6.1.4.1.111.15.1.1.1.3.1 = STRING: "Database Instance"     .1.3.6.1.4.1.111.15.1.1.1.4.1 = STRING: "database-server "   .1.3.6.1.4.1.111.15.1.1.1.5.1 = STRING: "Status".1.3.6.1.4.1.111.15.1.1.1.6.1 = ""      .1.3.6.1.4.1.111.15.1.1.1.7.1 = ""     .1.3.6.1.4.1.111.15.1.1.1.8.1 = STRING: "Oct 14, 2010 7:04:00 PM EDT"    .1.3.6.1.4.1.111.15.1.1.1.9.1 = STRING: "Critical"      .1.3.6.1.4.1.111.15.1.1.1.10.1 = STRING: "Failed to connect to database instance: ORA-01033: ORACLE initialization or shutdown in progress (DBD ERROR: OCISessionBegin)."       .1.3.6.1.4.1.111.15.1.1.1.11.1 = STRING: "Test SNMP database-server DB Down "       .1.3.6.1.4.1.111.15.1.1.1.12.1 = STRING: "SYSMAN"       .1.3.6.1.4.1.111.15.1.1.1.13.1 = STRING: "0"    .1.3.6.1.4.1.111.15.1.1.1.14.1 = ""     .1.3.6.1.4.1.111.15.1.1.1.15.1 = STRING: "923A730174F36B87E040E6801417642D"     .1.3.6.1.4.1.111.15.1.1.1.16.1 = STRING: "0"    .1.3.6.1.4.1.111.15.1.1.1.17.1 = ""     .1.3.6.1.4.1.111.15.1.1.1.18.1 = STRING: "0"    .1.3.6.1.4.1.111.15.1.1.1.19.1 = ""     .1.3.6.1.4.1.111.15.1.1.1.20.1 = STRING: "1"    .1.3.6.1.4.1.111.15.1.1.1.21.1 = STRING: "923A421065A8A060E040E68015173993"

Example snmptt.log entry:
Oct 14 19:04:52 xymon-server snmptt[0]: .1.3.6.1.4.1.111.15.2.0.1 SEVERE "Status Events" grid-server - The variables included in the oraEM4Alert trap. DB00157.world Database Instance database-server Status   Oct 14, 2010 7:04:00 PM EDT Critical Failed to connect to database instance: ORA-01033: ORACLE initialization or shutdown in progress (DBD ERROR: OCISessionBegin). Test SNMP database-server DB Down  SYSMAN 0  923A730174F36B87E040E6801417642D 0  0  1 923A421065A8A060E040E68015173993



Thanks in advance for any help.  I'm sorry for the lengthy question.

Nicole Beck