DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Rollback Chains: When Payment Fails, What Actually Happens

Rollback Chains: When Payment Fails, What Actually Happens

Comments
4 min read
One-shotting a Diskless Kafka in Python with a Leaderless Log Protocol

One-shotting a Diskless Kafka in Python with a Leaderless Log Protocol

Comments
14 min read
Kafka 101: Why Event Streaming is the Central Nervous System of Modern Data

Kafka 101: Why Event Streaming is the Central Nervous System of Modern Data

Comments
14 min read
Real-Time Fraud Detection in Java with Kafka Streams and Vector Similarity

Real-Time Fraud Detection in Java with Kafka Streams and Vector Similarity

2
Comments
12 min read
War Story: Debugging a Kafka 4.0 Consumer Lag Spike During a Product Launch Using Cilium 1.17 and Datadog 2026

War Story: Debugging a Kafka 4.0 Consumer Lag Spike During a Product Launch Using Cilium 1.17 and Datadog 2026

Comments
13 min read
War Story: Debugging a Kafka 3.7 Consumer Lag Issue in K8s 1.32 with KEDA 2.14 and Prometheus 2.50

War Story: Debugging a Kafka 3.7 Consumer Lag Issue in K8s 1.32 with KEDA 2.14 and Prometheus 2.50

Comments
14 min read
GitHub Copilot Missed It. I Found a Silent Kafka Bug Hidden in Plain Sight

GitHub Copilot Missed It. I Found a Silent Kafka Bug Hidden in Plain Sight

Comments
5 min read
Step-by-Step Guide to Encrypting Kafka 3.9 Topics with TLS 1.3 and HashiCorp Vault 1.16

Step-by-Step Guide to Encrypting Kafka 3.9 Topics with TLS 1.3 and HashiCorp Vault 1.16

Comments
15 min read
End-to-End Testing: Validating Kafka Messages with Playwright

End-to-End Testing: Validating Kafka Messages with Playwright

Comments
10 min read
Giving Kafka-Style Topics the Routing Power of RabbitMQ

Giving Kafka-Style Topics the Routing Power of RabbitMQ

Comments
6 min read
Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform

Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform

3
Comments
8 min read
Why I Designed the Whole System Around Kafka and Then Deployed Without It

Why I Designed the Whole System Around Kafka and Then Deployed Without It

1
Comments
6 min read
Mastering Schema Evolution: Why Apache Avro is the King of Big Data (Part 2)

Mastering Schema Evolution: Why Apache Avro is the King of Big Data (Part 2)

Comments
3 min read
We Ditched RabbitMQ for Kafka 4.0 and Cut Our Message Processing Latency by 55%

We Ditched RabbitMQ for Kafka 4.0 and Cut Our Message Processing Latency by 55%

Comments
15 min read
Postmortem: A Kafka 4.0 Broker Failure on Kubernetes 1.34 Caused 1 Hour of Message Lag for 10k Topics

Postmortem: A Kafka 4.0 Broker Failure on Kubernetes 1.34 Caused 1 Hour of Message Lag for 10k Topics

Comments
18 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.