DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

1
Comments
7 min read
Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

1
Comments
7 min read
๐ŸŽฏ Apache Kafka Single-Node Practice Guide

๐ŸŽฏ Apache Kafka Single-Node Practice Guide

1
Comments
4 min read
Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

2
Comments
6 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
๐Ÿง  Kafka Broker vs Controller - Complete Guide

๐Ÿง  Kafka Broker vs Controller - Complete Guide

1
Comments
5 min read
Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

2
Comments
7 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

3
Comments
4 min read
๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

1
Comments
2 min read
Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Understanding Kafka Lag: Causes and How to Reduce It

Understanding Kafka Lag: Causes and How to Reduce It

Comments
5 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

2
Comments
2 min read
๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

1
Comments
2 min read
Wednesday Links - Edition 2025-11-05

Wednesday Links - Edition 2025-11-05

Comments
2 min read
Integration Digest for September 2025

Integration Digest for September 2025

Comments
11 min read
Kafka | everything you need to get started

Kafka | everything you need to get started

Comments
5 min read
Real-Time Crypto Data Pipeline with Change Data Capture (CDC) Using PostgreSQL, Kafka, Cassandra, and Grafana

Real-Time Crypto Data Pipeline with Change Data Capture (CDC) Using PostgreSQL, Kafka, Cassandra, and Grafana

2
Comments 1
4 min read
Interesting links - September 2025

Interesting links - September 2025

Comments
13 min read
loading...