hobbit not sending on email alerts
list Paul Ehrenreich
Hi everyone,
Long time listener, first time caller (or maybe second time ;) ). I seem to
be having a weird issue with hobbit not sending out email alerts. I have the
following rules set up (emails changed to protect the innocent). I did have
macros setup for this and I thought it was part of the problem, but it was
not.
PAGE=oracle
MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m
RECOVERED
MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m
RECOVERED
I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1
oracle which is a host on my oracle page and it shows that the rules match
and that it sends on the emails
2007-11-07 15:42:52 Using default environment file
/usr/lib/hobbit/server/etc/hobbitserver.cfg
00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle state Paging
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 131
00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' ***
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 132
00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid
SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' ***
00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit
[12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid'
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 133
00030883 2007-11-07 15:42:52 *** Match with 'MAIL
user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m
RECOVERED' ***
00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit
[12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid'
I verified that my server can send mail out by sending a test message using
mailx to myself and I did receive it. I even took my troubleshooting a step
further and ran tcpdump on the network interface looking for anything going
to the remote mail server and saw SMTP traffic when i sent my test message,
but not my hobbitd_alert --test message. At this point I am scratching my
head. Is there is anything in hobbit to debug why messages are not being
sent out? I tried looking at some of the hobbit and postfix logs, but
nothing really indicated any problems.
The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0
Thanks for the help!
-Paul
list Josh Luthman
Paul, Can you use your SMTP agent to make mails manually? I'm lazy and old fashioned, try telnet'ing on port 25 and follow this: Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 localhost ESMTP Sendmail 8.13.5.20060308/8.13.5/Debian-3ubuntu1.1; Fri, 26 Jan 2007 19:15:30 -0500; (No UCE/UBE) logging access from: localhost(OK)-localhost [127.0.0.1] helo me 250 localhost Hello localhost [127.0.0.1], pleased to meet you mail from: <> 250 2.1.0 <>... Sender ok rcpt to: user-98a0adc73677@xymon.invalid 250 2.1.5 user-98a0adc73677@xymon.invalid... Recipient ok data 354 Enter mail, end with "." on a line by itself subject: test hello . 250 2.0.0 l0R0FUx5001380 Message accepted for delivery quit 221 2.0.0 localhost closing connection Connection closed by foreign host.
▸
On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:
Hi everyone,
Long time listener, first time caller (or maybe second time ;) ). I seem
to be having a weird issue with hobbit not sending out email alerts. I have
the following rules set up (emails changed to protect the innocent). I did
have macros setup for this and I thought it was part of the problem, but it
was not.
PAGE=oracle
MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red
REPEAT=15m RECOVERED
MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m
RECOVERED
I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1
oracle which is a host on my oracle page and it shows that the rules match
and that it sends on the emails
2007-11-07 15:42:52 Using default environment file
/usr/lib/hobbit/server/etc/hobbitserver.cfg
00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle state Paging
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 131
00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' ***
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 132
00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid
SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' ***
00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit
[12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid'
00030883 2007-11-07 15:42:52 Matching host:service:page
'atgtier2app1:oracle:oracle' against rule line 133
00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' ***
00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit
[12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid'
I verified that my server can send mail out by sending a test message
using mailx to myself and I did receive it. I even took my troubleshooting a
step further and ran tcpdump on the network interface looking for anything
going to the remote mail server and saw SMTP traffic when i sent my test
message, but not my hobbitd_alert --test message. At this point I am
scratching my head. Is there is anything in hobbit to debug why messages are
not being sent out? I tried looking at some of the hobbit and postfix logs,
but nothing really indicated any problems.
The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0
Thanks for the help!
-Paul
--
Josh Luthman
Office: XXX-XXX-XXXX
Direct: XXX-XXX-XXXX
XXXX Wayne St
Suite XXXX
Troy, OH XXXXX
Those who don't understand UNIX are condemned to reinvent it, poorly.
--- Henry Spencer
list Gary Baluha
▸
On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:
Hi everyone,
Long time listener, first time caller (or maybe second time ;) ). I seem
to be having a weird issue with hobbit not sending out email alerts. I have
the following rules set up (emails changed to protect the innocent). I did
have macros setup for this and I thought it was part of the problem, but it
was not.
PAGE=oracle
MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red
REPEAT=15m RECOVERED
MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m
RECOVERED
Looks okay. This won't fix the problem, but you can shorten the individual
MAIL lines by removing "RECOVERED" and adding it to the end of
"PAGE=oracle". Same with "SERVICE" and "COLOR"
"REPEAT=15m" will have to be on each MAIL line.
You can also do "MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid".
So in the end, you get:
PAGE=oracle SERVICE=conn,oracle,disk RECOVERED
MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid REPEAT=15m
▸
I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1oracle which is a host on my oracle page and it shows that the rules match and that it sends on the emails 2007-11-07 15:42:52 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg 00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle state Paging 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 131 00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' *** 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 132 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid' 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 133 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid' I verified that my server can send mail out by sending a test message using mailx to myself and I did receive it. I even took my troubleshooting a step further and ran tcpdump on the network interface looking for anything going to the remote mail server and saw SMTP traffic when i sent my test message, but not my hobbitd_alert --test message. At this point I am scratching my head. Is there is anything in hobbit to debug why messages are not being sent out? I tried looking at some of the hobbit and postfix logs, but nothing really indicated any problems.
"hobbitd_alert --test" won't actually execute the alert rules. It will just
run through all of the alert rules and show you what matches and doesn't.
Check the notifications.log file in your Hobbit log directory. If Hobbit is
doing what it should, you will see messages that say emails were sent out.
If you see this and you aren't getting the emails, then it wouldn't be a
problem with Hobbit that is causing it, and the problem is probably
somewhere else.
▸
The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0Thanks for the help! -Paul
list Paul Ehrenreich
Ooo ok, I thought the test actually would trigger the email to go out. If that is the case then I'll force a failure and see if the email gets generated. Thanks for the help!
▸
On 11/7/07, Gary Baluha <user-ae3e15c22de1@xymon.invalid> wrote:On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Hi everyone, Long time listener, first time caller (or maybe second time ;) ). I seem to be having a weird issue with hobbit not sending out email alerts. I have the following rules set up (emails changed to protect the innocent). I did have macros setup for this and I thought it was part of the problem, but it was not. PAGE=oracle MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVEREDLooks okay. This won't fix the problem, but you can shorten the individual MAIL lines by removing "RECOVERED" and adding it to the end of "PAGE=oracle". Same with "SERVICE" and "COLOR" "REPEAT=15m" will have to be on each MAIL line. You can also do "MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid". So in the end, you get: PAGE=oracle SERVICE=conn,oracle,disk RECOVERED MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid REPEAT=15m I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1oracle which is a host on my oracle page and it shows that the rules match and that it sends on the emails 2007-11-07 15:42:52 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg 00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle state Paging 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 131 00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' *** 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 132 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid' 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 133 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid' I verified that my server can send mail out by sending a test message using mailx to myself and I did receive it. I even took my troubleshooting a step further and ran tcpdump on the network interface looking for anything going to the remote mail server and saw SMTP traffic when i sent my test message, but not my hobbitd_alert --test message. At this point I am scratching my head. Is there is anything in hobbit to debug why messages are not being sent out? I tried looking at some of the hobbit and postfix logs, but nothing really indicated any problems."hobbitd_alert --test" won't actually execute the alert rules. It will just run through all of the alert rules and show you what matches and doesn't. Check the notifications.log file in your Hobbit log directory. If Hobbit is doing what it should, you will see messages that say emails were sent out. If you see this and you aren't getting the emails, then it wouldn't be a problem with Hobbit that is causing it, and the problem is probably somewhere else. The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0Thanks for the help! -Paul
list Josh Luthman
Those telnet commands is the equivalent of you opening up Outlook/Thunderbird and writing a message, then clicking send/receive. The message was stored in queue and now sendmail is trying to get it out to its destination. Try looking at your mail logs and seeing if it is having some sort of problems. Since the message did not go through when you issued those telnet commands, you need to fix your mail server before trying alerts! Josh
▸
On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Ooo ok, I thought the test actually would trigger the email to go out. If that is the case then I'll force a failure and see if the email gets generated. Thanks for the help! On 11/7/07, Gary Baluha <user-ae3e15c22de1@xymon.invalid> wrote:On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Hi everyone, Long time listener, first time caller (or maybe second time ;) ). I seem to be having a weird issue with hobbit not sending out email alerts. I have the following rules set up (emails changed to protect the innocent). I did have macros setup for this and I thought it was part of the problem, but it was not. PAGE=oracle MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=redREPEAT=15mRECOVEREDLooks okay. This won't fix the problem, but you can shorten the individual MAIL lines by removing "RECOVERED" and adding it to the end of "PAGE=oracle". Same with "SERVICE" and "COLOR" "REPEAT=15m" will have to be on each MAIL line. You can also do "MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid". So in the end, you get: PAGE=oracle SERVICE=conn,oracle,disk RECOVERED MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid REPEAT=15m I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1oracle which is a host on my oracle page and it shows that the rules match and that it sends on the emails 2007-11-07 15:42:52 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg 00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle statePaging00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 131 00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' *** 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 132 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid' 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 133 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED'***00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid' I verified that my server can send mail out by sending a test message using mailx to myself and I did receive it. I even took my troubleshooting a step further and ran tcpdump on the network interface looking for anything going to the remote mail server and saw SMTP traffic when i sent my test message, but not my hobbitd_alert --test message. At this point I am scratching my head. Is there is anything in hobbit to debug why messages are not being sent out? I tried looking at some of the hobbit and postfix logs, but nothing really indicated any problems."hobbitd_alert --test" won't actually execute the alert rules. It will just run through all of the alert rules and show you what matches and doesn't. Check the notifications.log file in your Hobbit log directory. IfHobbit isdoing what it should, you will see messages that say emails were sent out. If you see this and you aren't getting the emails, then it wouldn't be a problem with Hobbit that is causing it, and the problem is probably somewhere else. The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0Thanks for the help! -Paul
-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer
list Paul Ehrenreich
Mail is being sent out fine, As stated in my first email I am able to send mail just using the mailx command from the command line. This is just more my misunderstanding on what exactly the hobbitd_alert --test is doing. -Paul
▸
On Nov 7, 2007 9:52 PM, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Those telnet commands is the equivalent of you opening up Outlook/Thunderbird and writing a message, then clicking send/receive. The message was stored in queue and now sendmail is trying to get it out to its destination. Try looking at your mail logs and seeing if it is having some sort of problems. Since the message did not go through when you issued those telnet commands, you need to fix your mail server before trying alerts! Josh On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Ooo ok, I thought the test actually would trigger the email to go out. If that is the case then I'll force a failure and see if the email gets generated. Thanks for the help! On 11/7/07, Gary Baluha < user-ae3e15c22de1@xymon.invalid> wrote:On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Hi everyone, Long time listener, first time caller (or maybe second time ;) ). I seem to be having a weird issue with hobbit not sending out email alerts. I have the following rules set up (emails changed to protect the innocent). I did have macros setup for this and I thought it was part of the problem, but it was not. PAGE=oracle MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=redREPEAT=15mRECOVEREDLooks okay. This won't fix the problem, but you can shorten the individual MAIL lines by removing "RECOVERED" and adding it to the end of "PAGE=oracle". Same with "SERVICE" and "COLOR" "REPEAT=15m" will have to be on each MAIL line. You can also do "MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid ". So in the end, you get: PAGE=oracle SERVICE=conn,oracle,disk RECOVERED MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid REPEAT=15m I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1oracle which is a host on my oracle page and it shows that the rules match and that it sends on the emails 2007-11-07 15:42:52 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg 00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle statePaging00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 131 00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' *** 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 132 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid' 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 133 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED'***00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s "Hobbit [12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid' I verified that my server can send mail out by sending a test message using mailx to myself and I did receive it. I even took my troubleshooting a step further and ran tcpdump on the network interface looking for anything going to the remote mail server and saw SMTP traffic when i sent my test message, but not my hobbitd_alert --test message. At this point I am scratching my head. Is there is anything in hobbit to debug why messages are not being sent out? I tried looking at some of the hobbit and postfix logs, but nothing really indicated any problems."hobbitd_alert --test" won't actually execute the alert rules. It will just run through all of the alert rules and show you what matches and doesn't. Check the notifications.log file in your Hobbit log directory. IfHobbit isdoing what it should, you will see messages that say emails were sent out. If you see this and you aren't getting the emails, then it wouldn't be a problem with Hobbit that is causing it, and the problem is probably somewhere else. The hobbit server is running Linux (ubuntu 7.04 server) and hobbit 4.2.0Thanks for the help! -Paul-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer
list Paul Ehrenreich
Small update. I modified our monitoring script to cause an alert to go off and we did get the email notifications from hobbit as expected. Thanks again for the help!
▸
On 11/8/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Mail is being sent out fine, As stated in my first email I am able to send mail just using the mailx command from the command line. This is just more my misunderstanding on what exactly the hobbitd_alert --test is doing. -Paul On Nov 7, 2007 9:52 PM, Josh Luthman <user-4c45a83f15cb@xymon.invalid> wrote:Those telnet commands is the equivalent of you opening up Outlook/Thunderbird and writing a message, then clicking send/receive.Themessage was stored in queue and now sendmail is trying to get it out to its destination. Try looking at your mail logs and seeing if it is having some sort of problems. Since the message did not go through when you issued those telnet commands, you need to fix your mail server before trying alerts! Josh On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Ooo ok, I thought the test actually would trigger the email to go out. If that is the case then I'll force a failure and see if the email gets generated. Thanks for the help! On 11/7/07, Gary Baluha < user-ae3e15c22de1@xymon.invalid> wrote:On 11/7/07, Paul Ehrenreich <user-98a0adc73677@xymon.invalid> wrote:Hi everyone, Long time listener, first time caller (or maybe second time ;) ). I seem to be having a weird issue with hobbit not sending out email alerts.Ihavethe following rules set up (emails changed to protect the innocent).Ididhave macros setup for this and I thought it was part of the problem, but it was not. PAGE=oracle MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED MAIL user-1534f7d357d0@xymon.invalid SERVICE=conn,oracle,disk COLOR=redREPEAT=15mRECOVEREDLooks okay. This won't fix the problem, but you can shorten the individual MAIL lines by removing "RECOVERED" and adding it to the end of "PAGE=oracle". Same with "SERVICE" and "COLOR" "REPEAT=15m" will have to be on each MAIL line. You can also do "MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid ". So in the end, you get: PAGE=oracle SERVICE=conn,oracle,disk RECOVERED MAIL user-26a36fa41997@xymon.invalid,user-1534f7d357d0@xymon.invalid REPEAT=15m I sent out a test alert using bbcmd hobbitd_alerts --test atgtier2app1oracle which is a host on my oracle page and it shows that the rules match and that it sends on the emails 2007-11-07 15:42:52 Using default environment file /usr/lib/hobbit/server/etc/hobbitserver.cfg 00030883 2007-11-07 15:42:52 send_alert atgtier2app1:oracle statePaging00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 131 00030883 2007-11-07 15:42:52 *** Match with 'PAGE=oracle' *** 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 132 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-26a36fa41997@xymon.invalid SERVICE=conn,oracle,disk COLOR=red REPEAT=15m RECOVERED' *** 00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s"Hobbit[12345] atgtier2app1:oracle CRITICAL (RED)" user-26a36fa41997@xymon.invalid' 00030883 2007-11-07 15:42:52 Matching host:service:page 'atgtier2app1:oracle:oracle' against rule line 133 00030883 2007-11-07 15:42:52 *** Match with 'MAIL user-ec4f5087583a@xymon.invalid=conn,oracle,disk COLOR=red REPEAT=15mRECOVERED'***00030883 2007-11-07 15:42:52 Mail alert with command 'mailx -s"Hobbit[12345] atgtier2app1:oracle CRITICAL (RED)" user-1534f7d357d0@xymon.invalid' I verified that my server can send mail out by sending a test message using mailx to myself and I did receive it. I even took my troubleshooting a step further and ran tcpdump on the network interface looking for anything going to the remote mail server and saw SMTP traffic when i sent my test message, but not my hobbitd_alert --test message. At this point I am scratching my head. Is there is anything in hobbit to debug why messages are not being sent out? I tried looking at some of the hobbit and postfix logs, but nothing really indicated any problems."hobbitd_alert --test" won't actually execute the alert rules. It will just run through all of the alert rules and show you what matches and doesn't. Check the notifications.log file in your Hobbit log directory. IfHobbit isdoing what it should, you will see messages that say emails were sent out. If you see this and you aren't getting the emails, then it wouldn't be a problem with Hobbit that is causing it, and the problem is probably somewhere else. The hobbit server is running Linux (ubuntu 7.04 server) and hobbit4.2.0Thanks for the help! -Paul-- Josh Luthman Office: XXX-XXX-XXXX Direct: XXX-XXX-XXXX XXXX Wayne St Suite XXXX Troy, OH XXXXX Those who don't understand UNIX are condemned to reinvent it, poorly. --- Henry Spencer