DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Polyglot Data Engineering: Python + Go in the Same Pipeline

Polyglot Data Engineering: Python + Go in the Same Pipeline

3
Comments 2
2 min read
🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

🚀 Why You Should Pick Auto Loader Over Structured Streaming in Azure Databricks (The Funny Truth)

Comments
2 min read
Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

Real-Time CDC with Debezium and Kafka for Sharded PostgreSQL Integration

1
Comments
9 min read
Apache Kafka in Data Engineering.

Apache Kafka in Data Engineering.

Comments
1 min read
Beginner guide for Apache Kafka

Beginner guide for Apache Kafka

Comments
1 min read
Apache Kafka in Data Engineering for Beginners

Apache Kafka in Data Engineering for Beginners

Comments
1 min read
SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

SeaTunnel Community Rocked July: New Features, Major Optimizations, All-Star Contributors

Comments
11 min read
Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

Sagas vs ACID Transactions: Ensuring Reliability in Distributed Architectures

1
Comments
11 min read
Automating Your Local DBT & Snowflake Playground with Python

Automating Your Local DBT & Snowflake Playground with Python

2
Comments
10 min read
Running the "Quickstart for dbt and Snowflake" Tutorial with dbt Projects on Snowflake

Running the "Quickstart for dbt and Snowflake" Tutorial with dbt Projects on Snowflake

Comments
14 min read
15 foundational concepts on Data Engineering

15 foundational concepts on Data Engineering

Comments
6 min read
Apache Arrow dev list digest (Sept 8–12, 2025)

Apache Arrow dev list digest (Sept 8–12, 2025)

1
Comments
4 min read
Apache Polaris dev list digest (Sept 8–12, 2025)

Apache Polaris dev list digest (Sept 8–12, 2025)

1
Comments
4 min read
Why I’m Switching to Parquet for Data Storage

Why I’m Switching to Parquet for Data Storage

Comments
3 min read
Stop Writing Nested Loops for ETL. Compile Them with convtools

Stop Writing Nested Loops for ETL. Compile Them with convtools

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.