DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Understanding Kafka Lag: Causes and How to Reduce It

Understanding Kafka Lag: Causes and How to Reduce It

Comments
5 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
🔥 𝗔𝗱-𝗧𝗲𝗰𝗵 𝗔𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 𝗮𝘁 𝗦𝗰𝗮𝗹𝗲 — 𝗕𝘂𝗶𝗹𝘁 𝗼𝗻 𝗝𝗮𝘃𝗮 𝗠𝗶𝗰𝗿𝗼𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀

🔥 𝗔𝗱-𝗧𝗲𝗰𝗵 𝗔𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 𝗮𝘁 𝗦𝗰𝗮𝗹𝗲 — 𝗕𝘂𝗶𝗹𝘁 𝗼𝗻 𝗝𝗮𝘃𝗮 𝗠𝗶𝗰𝗿𝗼𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀

2
Comments
2 min read
🛒 𝗗𝗲𝘀𝗶𝗴𝗻𝗶𝗻𝗴 𝗠𝘂𝗹𝘁𝗶-𝗥𝗲𝗴𝗶𝗼𝗻 𝗘-𝗖𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗖𝗵𝗲𝗰𝗸𝗼𝘂𝘁 𝗶𝗻 𝗝𝗮𝘃𝗮 (𝘁𝗵𝗮𝘁 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝘀𝘂𝗿𝘃𝗶𝘃𝗲𝘀 𝗕𝗹𝗮𝗰𝗸 𝗙𝗿𝗶𝗱𝗮𝘆)

🛒 𝗗𝗲𝘀𝗶𝗴𝗻𝗶𝗻𝗴 𝗠𝘂𝗹𝘁𝗶-𝗥𝗲𝗴𝗶𝗼𝗻 𝗘-𝗖𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗖𝗵𝗲𝗰𝗸𝗼𝘂𝘁 𝗶𝗻 𝗝𝗮𝘃𝗮 (𝘁𝗵𝗮𝘁 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝘀𝘂𝗿𝘃𝗶𝘃𝗲𝘀 𝗕𝗹𝗮𝗰𝗸 𝗙𝗿𝗶𝗱𝗮𝘆)

1
Comments
2 min read
Wednesday Links - Edition 2025-11-05

Wednesday Links - Edition 2025-11-05

Comments
2 min read
Integration Digest for September 2025

Integration Digest for September 2025

Comments
11 min read
Kafka | everything you need to get started

Kafka | everything you need to get started

Comments
5 min read
Real-Time Crypto Data Pipeline with Change Data Capture (CDC) Using PostgreSQL, Kafka, Cassandra, and Grafana

Real-Time Crypto Data Pipeline with Change Data Capture (CDC) Using PostgreSQL, Kafka, Cassandra, and Grafana

2
Comments 1
4 min read
Interesting links - September 2025

Interesting links - September 2025

Comments
13 min read
Kafka Streams Make AI Agents Fraud Detection Smarter

Kafka Streams Make AI Agents Fraud Detection Smarter

Comments
7 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
How Software Architects Choose the Right Technology Stack

How Software Architects Choose the Right Technology Stack

1
Comments
3 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
Event-Driven Architecture with Blockchain: Use Kafka/MSK and Blockchain Logs

Event-Driven Architecture with Blockchain: Use Kafka/MSK and Blockchain Logs

Comments
2 min read
You don't need Kafka: Building a message queue with only two UNIX signals

You don't need Kafka: Building a message queue with only two UNIX signals

5
Comments
15 min read
Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Comments
1 min read
How to Use Kubernetes Metadata for Dynamic Kafka Topics in Fluent Bit

How to Use Kubernetes Metadata for Dynamic Kafka Topics in Fluent Bit

Comments
3 min read
Streaming Data Using Apache Kafka

Streaming Data Using Apache Kafka

1
Comments
2 min read
📌 Kafka Auth in 2025

📌 Kafka Auth in 2025

1
Comments
1 min read
Apache Kafka in Data Engineering

Apache Kafka in Data Engineering

Comments
1 min read
All About Change Data Capture CDC

All About Change Data Capture CDC

1
Comments
6 min read
Kubernetes Scaling with KEDA: Zero-Loss Data Processing at Scale

Kubernetes Scaling with KEDA: Zero-Loss Data Processing at Scale

Comments 1
2 min read
Apache Kafka in Data engineering

Apache Kafka in Data engineering

6
Comments 1
1 min read
Presentation: Building Scalable Data Pipelines with Docker and Docker Compose

Presentation: Building Scalable Data Pipelines with Docker and Docker Compose

3
Comments
3 min read
loading...