DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
A Reader's Guide to My Books: Which One to Pick Up, Depending on What You're Building

A Reader's Guide to My Books: Which One to Pick Up, Depending on What You're Building

Comments
11 min read
I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data

I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data

Comments
6 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit

# go-intake: Go-Native Streaming Data Ingestion Toolkit

Comments
3 min read
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric

QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric

Comments
2 min read
From Data Quality Checks to Analytics-Ready Parquet with Python

From Data Quality Checks to Analytics-Ready Parquet with Python

1
Comments
8 min read
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage

The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage

Comments
21 min read
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going

Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going

Comments
22 min read
chapter 3 of ai-assisted data engineering is live

chapter 3 of ai-assisted data engineering is live

1
Comments
2 min read
When LangGraph Succeeds but Silently Goes Wrong

When LangGraph Succeeds but Silently Goes Wrong

1
Comments 19
7 min read
QN : Ingest and transform data in a lakehouse

QN : Ingest and transform data in a lakehouse

Comments
2 min read
Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory

Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory

Comments
4 min read
Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)

Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)

Comments
2 min read
Advanced Kubernetes Patterns for Data Engineers

Advanced Kubernetes Patterns for Data Engineers

5
Comments
1 min read
Extract data from Databases into DuckLake

Extract data from Databases into DuckLake

Comments
4 min read
How I forced Python standard libraries to process and serialize production server crashes into Parquet locally

How I forced Python standard libraries to process and serialize production server crashes into Parquet locally

Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.