DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
From Chaos to Clarity: Building a Robust Log Aggregation Pipeline with Kafka (KRaft) and ELK

From Chaos to Clarity: Building a Robust Log Aggregation Pipeline with Kafka (KRaft) and ELK

Comments
8 min read
Event-Driven Architecture 101: Building a Simple App with Kafka - By Gopi Gugan

Event-Driven Architecture 101: Building a Simple App with Kafka - By Gopi Gugan

Comments
3 min read
SQL on Kafka Data Does Not Require a Streaming Engine

SQL on Kafka Data Does Not Require a Streaming Engine

Comments
4 min read
Building a Kafka Wikimedia Producer: Solving 403 Errors and Understanding Java Fundamentals

Building a Kafka Wikimedia Producer: Solving 403 Errors and Understanding Java Fundamentals

Comments
9 min read
Kafka interview questions for Data Engineer

Kafka interview questions for Data Engineer

3
Comments
3 min read
The Messaging Challenges No One Talks About in Regulated, Air-Gapped, and Hybrid Environments

The Messaging Challenges No One Talks About in Regulated, Air-Gapped, and Hybrid Environments

Comments
5 min read
Kafka Ingestion & Processing at Scale | Rajamohan Jabbala

Kafka Ingestion & Processing at Scale | Rajamohan Jabbala

Comments
2 min read
Federated Learning System for IoT Devices (Anomaly Detection)

Federated Learning System for IoT Devices (Anomaly Detection)

Comments
1 min read
Building a Kafka Event-Driven Spring Boot Application with Avro, Schema Registry and PostgreSQL

Building a Kafka Event-Driven Spring Boot Application with Avro, Schema Registry and PostgreSQL

1
Comments
2 min read
Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern

Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern

Comments
3 min read
Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Comments
2 min read
Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Comments
10 min read
Data Processing Does Not Belong in the Message Broker

Data Processing Does Not Belong in the Message Broker

Comments
3 min read
ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

Comments
4 min read
Mastering Event-Driven Systems with Kafka & Redpanda

Mastering Event-Driven Systems with Kafka & Redpanda

Comments
2 min read
Stateless Kafka-compatible brokers backed by object storage, k8s native

Stateless Kafka-compatible brokers backed by object storage, k8s native

Comments
1 min read
Kafka’s Broker As A Traffic Cop

Kafka’s Broker As A Traffic Cop

Comments
12 min read
Interesting links - December 2025

Interesting links - December 2025

Comments
13 min read
S3-Native Kafka Alternatives: What's Actually Different

S3-Native Kafka Alternatives: What's Actually Different

Comments
3 min read
Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Comments 1
10 min read
When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

Comments
4 min read
Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

5
Comments
5 min read
The Big Data Showdown: Apache Spark vs. Hadoop in 2026

The Big Data Showdown: Apache Spark vs. Hadoop in 2026

5
Comments
4 min read
Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data

Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data

5
Comments
3 min read
Kafka Consumer Rebalancing: From Stop-the-World to Cooperative Protocol

Kafka Consumer Rebalancing: From Stop-the-World to Cooperative Protocol

Comments
6 min read
loading...