Some real hands-on articles and stories from production this week, with a particular emphasis on monitoring alerts and logging best practices. Enjoy! ☕🗻📢

This issue is sponsored by:

Chronosphere logo

Open-source Prometheus is a good starting place for monitoring cloud native environments. But, as data grows and use cases become more complex, organizations begin to see challenges with reliability, scalability, and controlling costs. Don't struggle with scaling Prometheus. Take your monitoring to the next level with the ultimate kit.

Articles & News on

Observability & Monitoring Community Slack

It’s amazing to see the community continue to grow. We’d love to have you join us and share what you’ve been working on.

From The Community

Grafana Mimir — our journey towards infinite wisdom with 5m active time series

A fabulously detailed writeup of lovehistory’s migration from Thanos to Mimir (and other considerations along the way). Great story!

6 Best Practices for Effective Monitoring Alerts

I love this topic because alerting has the potential to directly impact our lives in a manner proportionate to the thought and consideration that went into their designs. Practice effective alerting and it will reward your efforts.

Test In Production — The Ideal Monitoring

Not every code path can be tested effectively in development or staging environments. Running tests in production can be an effective monitoring strategy when done right.

Interesting talks on Observability from Fosdem 2023

If you missed this year’s Fosdem, this post has you covered with summaries and links to some of the more interesting monitoring & observability talks.

9 Logging best practices

A collection of best practices and precautions for your logging setup. Many of these fall into the “seems obvious until you catch yourself doing the same thing” category.

MongoDB Atlas & Prometheus Integration

If you’re using MongoDB Atlas, it’s pretty easy to capture those service metrics in your own Grafana and Prometheus cluster. Go share this with your app developers and make their day. 😺

MetricFire logo

Monitor your Heroku applications with MetricFire

Easily observe your Heroku apps by using MetricFire’s Heroku addon. Our integration allows you to enhance the versatility of your Heroku App with better features for data retention, resolution, alerts, visualization, and more! Learn more about how you can enrich your Heroku App insights with Hosted Graphite by MetricFire. (SPONSORED)

Distributed Tracing for Message Broker Subscribers

A handy tutorial for setting up tracing with context propagation across your distributed services.

Spotify Engineering Incident Report: Spotify Outage on January 14, 2023

It’s always DNS.

An Overview of Syslog Parsing with Fluentd

A super detailed look at parsing your Syslog messages with Fluentd. Feels like one of those posts that future-you will be glad if today-you remembers to bookmark it.

Prometheus Alerting with AlertManager

A solid guide for setting up Alertmanager to manage your Prometheus alerts.


Monitorama PDX 2023 - June 26-28 (Portland, OR)

We’re really looking forward to this event which marks the ten-year anniversary of Monitorama 2013 originally held in Boston, MA. Proposals are currently being reviewed and if they’re anything to go by, this should be an awesome lineup of talks. Hope to see you there!

See you next week!

– Jason (@obfuscurity) Monitoring Weekly Editor