Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Gabriel Henrique

Jun 17

Agentic Data Engineering in 2026: How to Build Pipelines That AI Agents Can Actually Use

#dataengineering #ai #python #data

5 min read

Ibrahim0695

Jun 16

# Why Breaking Things Apart Eventually Brings Them Together: Modulazition in ETL

#architecture #beginners #dataengineering #softwareengineering

4 min read

Kanishga Subramani

Jun 17

Day 21 : Time-Series Data in ClickHouse®

#database #dataengineering #devops #clickhouse

2 min read

DataDriven

Jun 16

I Built a Mini Message Broker in Pure Python and Finally Understood How Kafka Moves Millions of Events

#kafka #python #dataengineering #distributedsystems

6 min read

Jitendra Devabhaktuni

Jun 16

Creating HIPAA-Safe Synthetic Patient Data for Healthcare App Testing

#ai #datascience #database #dataengineering

4 min read

Kanishga Subramani

Jun 16

Day 19 of 100 Days of ClickHouse®: Managing Users and Roles with RBAC

#clickhouse #analytics #database #dataengineering

4 min read

Nate S

Jun 15

Building Confidence Scoring for Email Open Tracking (Engineering Notes)

#email #engineering #dataengineering #sales

2 min read

Alex Merced

Jun 16

Apache Data Lakehouse Weekly: June 9 to 16, 2026

#news #data #dataengineering #opensource

24 min read

Alisson Rosa

Jun 28

Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

#airflow #go #dataengineering #kubernetes

6 min read

Haji Rufai

Jun 15

I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

#python #dataengineering #postgres #computerscience

6 min read

Petascale Labs

Jun 14

The Data Engineer Roadmap for 2026 (in an AI-Native World)

#dataengineering #career #roadmap #ai

7 min read

Patrick Lierse

Jun 14

Querying Germany's Company Register via API: Clean JSON and the new eGbR

#api #data #dataengineering #webscraping

1 min read

James Lee

Jun 18

Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

#ai #architecture #dataengineering #rag

9 min read

Kanishga Subramani

Jun 14

Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries

#clickhouse #database #dataengineering #analytics

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

#dataengineering

Agentic Data Engineering in 2026: How to Build Pipelines That AI Agents Can Actually Use

# Why Breaking Things Apart Eventually Brings Them Together: Modulazition in ETL

Day 21 : Time-Series Data in ClickHouse®

Top 12 Spark Interview Problems for Data Engineers, With Answers

I Built a Mini Message Broker in Pure Python and Finally Understood How Kafka Moves Millions of Events

Creating HIPAA-Safe Synthetic Patient Data for Healthcare App Testing

Day 19 of 100 Days of ClickHouse®: Managing Users and Roles with RBAC

Building Confidence Scoring for Email Open Tracking (Engineering Notes)

Apache Data Lakehouse Weekly: June 9 to 16, 2026

Leoflow v0.1.0 — run your Airflow DAGs on a Go control plane (no Airflow in the hot path)

I Built a B-Tree in Pure Python and Finally Understood Why Postgres Uses It for Every Index

The Data Engineer Roadmap for 2026 (in an AI-Native World)

Querying Germany's Company Register via API: Clean JSON and the new eGbR

Part 1 — How Do Unstructured Documents Become a Searchable Knowledge Base? Five Key Engineering Decisions in the Ingestion Pipeline

Day 17 of #100DaysOfClickHouse: Mastering Data Filtering for Faster ClickHouse Queries