DEV Community

Discussion on: For the Love of Bleep! Building a Scalable Monitoring System

Collapse
 
valandinos profile image
Valentin Eleftheriou

Nice post !

I'm happy to see we're not the only ones to use DataDog for our monitoring. We use it as a central console, and with a few Twilio Webhooks we are now able to have customized Voice Call & SMS alerting for whoever is on-call.

But still, you have to be careful and manage closely your DataDog setup, otherwise it will end up like all the others: clogged and false-alerting for pretty much everything. To avoid that, we conduct monthly review of the alerts, and tune them so they are most accurate possible :-)

Collapse
 
molly profile image
Molly Struve (she/her)

Thanks!

So true, you definitely have to stay on top of all your alerts. I like the idea of a monthly review, I will keep that in mind. It is nice though when you do that monthly review you only have one place you have to go πŸ˜ƒ