DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The 12 Data Modeling Interview Questions that Matter

The 12 Data Modeling Interview Questions that Matter

Comments
8 min read
Agentic Data Engineering in 2026: How to Build Pipelines That AI Agents Can Actually Use

Agentic Data Engineering in 2026: How to Build Pipelines That AI Agents Can Actually Use

Comments
5 min read
# Why Breaking Things Apart Eventually Brings Them Together: Modulazition in ETL

# Why Breaking Things Apart Eventually Brings Them Together: Modulazition in ETL

Comments
4 min read
Day 21 : Time-Series Data in ClickHouse®

Day 21 : Time-Series Data in ClickHouse®

7
Comments
2 min read
Top 12 Spark Interview Problems for Data Engineers, With Answers

Top 12 Spark Interview Problems for Data Engineers, With Answers

Comments
10 min read
I Built a Mini Message Broker in Pure Python and Finally Understood How Kafka Moves Millions of Events

I Built a Mini Message Broker in Pure Python and Finally Understood How Kafka Moves Millions of Events

1
Comments
6 min read
Creating HIPAA-Safe Synthetic Patient Data for Healthcare App Testing

Creating HIPAA-Safe Synthetic Patient Data for Healthcare App Testing

Comments
4 min read
Day 19 of 100 Days of ClickHouse®: Managing Users and Roles with RBAC

Day 19 of 100 Days of ClickHouse®: Managing Users and Roles with RBAC

2
Comments
4 min read
Building Confidence Scoring for Email Open Tracking (Engineering Notes)

Building Confidence Scoring for Email Open Tracking (Engineering Notes)

Comments
2 min read
Apache Data Lakehouse Weekly: June 9 to 16, 2026

Apache Data Lakehouse Weekly: June 9 to 16, 2026

Comments
24 min read
Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

Comments
6 min read
I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

1
Comments
6 min read
The Data Engineer Roadmap for 2026 (in an AI-Native World)

The Data Engineer Roadmap for 2026 (in an AI-Native World)

Comments
7 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR

Querying Germany's Company Register via API: Clean JSON and the new eGbR

Comments
1 min read
Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

5
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.