DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
Integration Digest for November 2025

Integration Digest for November 2025

1
Comments
16 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures

When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures

Comments
7 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge

1
Comments
7 min read
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

Building a Spring Boot Application with Spring Cloud Stream for Kafka Stream Processing

1
Comments
7 min read
Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

Understanding Kafka Storage Architecture: How It Handles Billions of Messagesโšก

1
Comments
7 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
๐ŸŽฏ Apache Kafka Single-Node Practice Guide

๐ŸŽฏ Apache Kafka Single-Node Practice Guide

1
Comments
4 min read
Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

Understanding Kafka Complete Architecture Flow - Advanced๐ŸŽฏ

2
Comments 1
6 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
๐Ÿง  Kafka Broker vs Controller - Complete Guide

๐Ÿง  Kafka Broker vs Controller - Complete Guide

1
Comments
5 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

2
Comments
1 min read
Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

Understanding Kafka Architecture - The Complete Mental Model ๐Ÿง 

3
Comments 1
7 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
Making Kafka 7,658x slower for theย Lulz

Making Kafka 7,658x slower for theย Lulz

Comments
7 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

Building a Mini Kafka in Go โ€” My Journey Creating go-pub-sub

3
Comments
4 min read
๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

1
Comments
2 min read
loading...