DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Iceberg Dev List Digest (Sept 15–19, 2025)

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

Comments
3 min read
Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

Building a Reddit Sentiment Pipeline using Python, PostgreSQL, VADER, Airflow, Grafana, Prometheus and StatsD

6
Comments 1
5 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
7 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

2
Comments
4 min read
Polyglot Data Engineering: Python + Go in the Same Pipeline

Polyglot Data Engineering: Python + Go in the Same Pipeline

3
Comments 2
2 min read
Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

Apache Kafka & Amazon MSK: The Beating Heart of Real-Time Data

1
Comments
4 min read
Why Apache Iceberg is needed?

Why Apache Iceberg is needed?

2
Comments
6 min read
🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

Comments
2 min read
Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

1
Comments
9 min read
Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

1
Comments
3 min read
Beginner guide for Apache Kafka

Beginner guide for Apache Kafka

Comments
1 min read
Apache Kafka in Data Engineering for Beginners

Apache Kafka in Data Engineering for Beginners

Comments
1 min read
Apache Kafka in Data Engineering.

Apache Kafka in Data Engineering.

Comments
1 min read
Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

1
Comments
11 min read
Automating Your Local DBT & Snowflake Playground with Python

Automating Your Local DBT & Snowflake Playground with Python

2
Comments
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.