Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
A Reader's Guide to My Books: Which One to Pick Up, Depending on What You're Building
Alex Merced
Alex Merced
Alex Merced
Follow
Jul 13
A Reader's Guide to My Books: Which One to Pick Up, Depending on What You're Building
#
ai
#
dataengineering
#
learning
#
softwaredevelopment
Comments
Add Comment
11 min read
I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data
Haji Rufai
Haji Rufai
Haji Rufai
Follow
Jun 9
I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data
#
python
#
dataengineering
#
database
#
programming
Comments
Add Comment
6 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit
Firat Celik
Firat Celik
Firat Celik
Follow
Jun 9
# go-intake: Go-Native Streaming Data Ingestion Toolkit
#
etl
#
dataengineering
#
go
#
opensource
Comments
Add Comment
3 min read
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric
Paulet Wairagu
Paulet Wairagu
Paulet Wairagu
Follow
Jun 9
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric
#
data
#
fabric
#
dataengineering
Comments
Add Comment
2 min read
From Data Quality Checks to Analytics-Ready Parquet with Python
Bob Oner
Bob Oner
Bob Oner
Follow
Jun 9
From Data Quality Checks to Analytics-Ready Parquet with Python
#
python
#
etl
#
dataengineering
#
docker
1
 reaction
Comments
Add Comment
8 min read
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage
Alex Merced
Alex Merced
Alex Merced
Follow
Jul 13
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage
#
architecture
#
database
#
dataengineering
#
machinelearning
Comments
Add Comment
21 min read
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
Alex Merced
Alex Merced
Alex Merced
Follow
Jul 13
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
#
architecture
#
database
#
dataengineering
#
opensource
Comments
Add Comment
22 min read
chapter 3 of ai-assisted data engineering is live
Philip Hern
Philip Hern
Philip Hern
Follow
Jul 13
chapter 3 of ai-assisted data engineering is live
#
ai
#
dataengineering
#
production
#
verification
1
 reaction
Comments
Add Comment
2 min read
When LangGraph Succeeds but Silently Goes Wrong
Debbie Shapiro
Debbie Shapiro
Debbie Shapiro
Follow
Jul 10
When LangGraph Succeeds but Silently Goes Wrong
#
ai
#
machinelearning
#
dataengineering
#
llm
1
 reaction
Comments
19
 comments
7 min read
QN : Ingest and transform data in a lakehouse
Paulet Wairagu
Paulet Wairagu
Paulet Wairagu
Follow
Jun 9
QN : Ingest and transform data in a lakehouse
#
architecture
#
database
#
dataengineering
#
sql
Comments
Add Comment
2 min read
Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory
Debbie Shapiro
Debbie Shapiro
Debbie Shapiro
Follow
Jun 8
Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory
#
ai
#
machinelearning
#
dataengineering
#
llm
Comments
Add Comment
4 min read
Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)
rodrigo da silva
rodrigo da silva
rodrigo da silva
Follow
Jun 8
Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)
#
api
#
data
#
dataengineering
#
resources
Comments
Add Comment
2 min read
Advanced Kubernetes Patterns for Data Engineers
Victor Kipruto
Victor Kipruto
Victor Kipruto
Follow
Jun 8
Advanced Kubernetes Patterns for Data Engineers
#
kubernetes
#
dataengineering
#
docker
#
devops
5
 reactions
Comments
Add Comment
1 min read
Extract data from Databases into DuckLake
Fritz Larco
Fritz Larco
Fritz Larco
Follow
Jun 8
Extract data from Databases into DuckLake
#
duckdb
#
ducklake
#
dataengineering
#
etl
Comments
Add Comment
4 min read
How I forced Python standard libraries to process and serialize production server crashes into Parquet locally
Syed Amman qadir bukhari
Syed Amman qadir bukhari
Syed Amman qadir bukhari
Follow
Jun 8
How I forced Python standard libraries to process and serialize production server crashes into Parquet locally
#
python
#
dataengineering
#
devops
#
opensource
Comments
Add Comment
1 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account