DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

Comments
6 min read
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
Kafka Streams Make AI Agents Fraud Detection Smarter

Kafka Streams Make AI Agents Fraud Detection Smarter

Comments
7 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
How Software Architects Choose the Right Technology Stack

How Software Architects Choose the Right Technology Stack

1
Comments
3 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Comments
1 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

6
Comments
1 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
Making Kafka 7,658x slower for theย Lulz

Making Kafka 7,658x slower for theย Lulz

Comments
7 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
You don't need Kafka: Building a message queue with only two UNIX signals

You don't need Kafka: Building a message queue with only two UNIX signals

5
Comments
15 min read
๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

1
Comments
2 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

2
Comments
2 min read
๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

1
Comments
2 min read
Integration Digest for September 2025

Integration Digest for September 2025

Comments
11 min read
Kafka | everything you need to get started

Kafka | everything you need to get started

Comments
5 min read
Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Comments
2 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
loading...