Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
# go-intake: Go-Native Streaming Data Ingestion Toolkit
Firat Celik
Firat Celik
Firat Celik
Follow
Jun 9
# go-intake: Go-Native Streaming Data Ingestion Toolkit
#
etl
#
dataengineering
#
go
#
opensource
Comments
Add Comment
3 min read
Moderation
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric
Paulet Wairagu
Paulet Wairagu
Paulet Wairagu
Follow
Jun 9
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric
#
data
#
fabric
#
dataengineering
Comments
Add Comment
2 min read
Moderation
From Data Quality Checks to Analytics-Ready Parquet with Python
Bob Oner
Bob Oner
Bob Oner
Follow
Jun 9
From Data Quality Checks to Analytics-Ready Parquet with Python
#
python
#
etl
#
dataengineering
#
docker
1
 reaction
Comments
Add Comment
8 min read
Moderation
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
Alex Merced
Alex Merced
Alex Merced
Follow
Jul 13
Lakehouse Table Formats in 2026: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake, How They Work, Where They Stand, and Where They're Going
#
architecture
#
database
#
dataengineering
#
opensource
Comments
Add Comment
22 min read
Moderation
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage
Alex Merced
Alex Merced
Alex Merced
Follow
Jul 13
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage
#
architecture
#
database
#
dataengineering
#
machinelearning
1
 reaction
Comments
Add Comment
21 min read
Moderation
chapter 3 of ai-assisted data engineering is live
Philip Hern
Philip Hern
Philip Hern
Follow
Jul 13
chapter 3 of ai-assisted data engineering is live
#
ai
#
dataengineering
#
production
#
verification
1
 reaction
Comments
Add Comment
2 min read
Moderation
When LangGraph Succeeds but Silently Goes Wrong
Debbie Shapiro
Debbie Shapiro
Debbie Shapiro
Follow
Jul 10
When LangGraph Succeeds but Silently Goes Wrong
#
ai
#
machinelearning
#
dataengineering
#
llm
1
 reaction
Comments
19
 comments
7 min read
Moderation
QN : Ingest and transform data in a lakehouse
Paulet Wairagu
Paulet Wairagu
Paulet Wairagu
Follow
Jun 9
QN : Ingest and transform data in a lakehouse
#
architecture
#
database
#
dataengineering
#
sql
Comments
Add Comment
2 min read
Moderation
Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory
Debbie Shapiro
Debbie Shapiro
Debbie Shapiro
Follow
Jun 8
Honest Memory: What Production Accuracy Data Actually Shows About AI Agent Memory
#
ai
#
machinelearning
#
dataengineering
#
llm
Comments
Add Comment
4 min read
Moderation
Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)
rodrigo da silva
rodrigo da silva
rodrigo da silva
Follow
Jun 8
Building on Brazilian public data: a developer's field guide (CNPJ, CEP, Congress, BACEN)
#
api
#
data
#
dataengineering
#
resources
Comments
Add Comment
2 min read
Moderation
Advanced Kubernetes Patterns for Data Engineers
Victor Kipruto
Victor Kipruto
Victor Kipruto
Follow
Jun 8
Advanced Kubernetes Patterns for Data Engineers
#
kubernetes
#
dataengineering
#
docker
#
devops
5
 reactions
Comments
Add Comment
1 min read
Moderation
Extract data from Databases into DuckLake
Fritz Larco
Fritz Larco
Fritz Larco
Follow
Jun 8
Extract data from Databases into DuckLake
#
duckdb
#
ducklake
#
dataengineering
#
etl
Comments
Add Comment
4 min read
Moderation
How I forced Python standard libraries to process and serialize production server crashes into Parquet locally
Syed Amman qadir bukhari
Syed Amman qadir bukhari
Syed Amman qadir bukhari
Follow
Jun 8
How I forced Python standard libraries to process and serialize production server crashes into Parquet locally
#
python
#
dataengineering
#
devops
#
opensource
Comments
Add Comment
1 min read
Moderation
From Clean CSVs to Production‑Shaped Data: A Practical Guide for Academic ML and Data Engineering
Jitendra Devabhaktuni
Jitendra Devabhaktuni
Jitendra Devabhaktuni
Follow
Jun 8
From Clean CSVs to Production‑Shaped Data: A Practical Guide for Academic ML and Data Engineering
#
ai
#
database
#
datascience
#
dataengineering
Comments
Add Comment
5 min read
Moderation
Data Engineering: The Data Field's Unknown Child
Itoro James
Itoro James
Itoro James
Follow
Jul 12
Data Engineering: The Data Field's Unknown Child
#
beginners
#
career
#
data
#
dataengineering
3
 reactions
Comments
Add Comment
4 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account