DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

Comments
6 min read
I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

1
Comments
6 min read
Lakehouse ETL on Kubernetes: an introduction to DataFlow Operator

Lakehouse ETL on Kubernetes: an introduction to DataFlow Operator

6
Comments
5 min read
Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

Comments
19 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR

Querying Germany's Company Register via API: Clean JSON and the new eGbR

Comments
1 min read
Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries

Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries

Comments
5 min read
Understanding Docker for Data Engineering

Understanding Docker for Data Engineering

1
Comments
5 min read
Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Comments
4 min read
Vertica vs VoltDB (Volt Active Data): Key Differences, Use Cases & How to Choose in 2026

Vertica vs VoltDB (Volt Active Data): Key Differences, Use Cases & How to Choose in 2026

Comments
7 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Comments
2 min read
Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups

Day 16: ClickHouse Dictionaries – Eliminating Expensive JOINs with High-Speed In-Memory Lookups

1
Comments
4 min read
AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving

AI-Native Data Engineering: From ETL Pipelines to Agentic Data Serving

Comments
12 min read
AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators

AMLA Is Coming Online: What the EU's New Anti–Money Laundering Authority Means for Builders and Regulators

Comments
7 min read
this is scary (day 0 of learning data engineering)

this is scary (day 0 of learning data engineering)

1
Comments
1 min read
Data Engineering Described

Data Engineering Described

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.