🚢 My latest newsletter episode "Demystifying Log Collection in Cloud-Native Applications on Kubernetes"

Episode #36: A DevOps Engineer’s Guide to Aggregating Distributed Logs with Kubernetes and Elastic Tools.

• 🖥️ DevOps Engineer Perspective: Exploring log collection from a DevOps viewpoint, aggregating logs from distributed sources into a single log analysis tool, like Elasticsearch

• 🌐 Common challenges on Distributed Log Collection: log rotation, retry logic, in-memory buffers, async logging, and more.

• 🛠️ Kubernetes Logging Mechanisms: how Kubernetes gathers and makes container logs available to log collection agents.

• 🕸️ Nginx's logs in Kubernetes: how the modify Nginx container image to work in Kubernetes

• 🔧 Node logging agent architecture: offload log collection to an external agent

• 🪵Some common logging agents: Elastic agent, Elastic Beats, Otel collector

👉 Read the full article https://open.substack.com/pub/cloudnativeengineer/p/log-collection-in-kubernetes