Thursday, September 11, 2014

Spammed!

Oops!

So I was getting the first checks on my sensu client to report back to the server and these checks were controlled via an email handler. I had a ping check running every minute (I thought), that was causing some issues due to permissions and thought I had it resolved by the time I got done working on it. Turns out that the issue persisted and I left the check on, and in reality the check was occurring every second. So when I started up my computer and opened my email and was massacred by around 65,000 emails all saying that the ping check failed (18 hours * 60 minutes * 60 seconds ~ 65,000). 



So the lesson that I learned was make sure to double check that checks are reporting correctly before you leave for the day, and if they are not turn off the handler so your email doesn't get blown up by failed check reports.

No comments:

Post a Comment