DEV Community

Cover image for Demystifying Log Collection in Cloud-Native Applications on Kubernetes
Cloud Native Engineer
Cloud Native Engineer

Posted on

Demystifying Log Collection in Cloud-Native Applications on Kubernetes

🚢 My latest newsletter episode "Demystifying Log Collection in Cloud-Native Applications on Kubernetes"

Episode #36: A DevOps Engineer’s Guide to Aggregating Distributed Logs with Kubernetes and Elastic Tools.

  • 🖥️ DevOps Engineer Perspective: Exploring log collection from a DevOps viewpoint, aggregating logs from distributed sources into a single log analysis tool, like Elasticsearch

  • 🌐 Common challenges on Distributed Log Collection: log rotation, retry logic, in-memory buffers, async logging, and more.

  • 🛠️ Kubernetes Logging Mechanisms: how Kubernetes gathers and makes container logs available to log collection agents.

  • 🕸️ Nginx's logs in Kubernetes: how the modify Nginx container image to work in Kubernetes

  • 🔧 Node logging agent architecture: offload log collection to an external agent

  • 🪵Some common logging agents: Elastic agent, Elastic Beats, Otel collector

👉 Read the full article https://open.substack.com/pub/cloudnativeengineer/p/log-collection-in-kubernetes

Sentry image

Hands-on debugging session: instrument, monitor, and fix

Join Lazar for a hands-on session where you’ll build it, break it, debug it, and fix it. You’ll set up Sentry, track errors, use Session Replay and Tracing, and leverage some good ol’ AI to find and fix issues fast.

RSVP here →

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay