DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter

The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter

Comments 1
22 min read
Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data

Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data

Comments 1
22 min read
What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders

What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders

Comments
7 min read
The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

Comments
21 min read
Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse

Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse

Comments
13 min read
Linux Fundamentals for Data Engineering

Linux Fundamentals for Data Engineering

4
Comments 2
5 min read
Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü

Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü

Comments
14 min read
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough

The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough

Comments
22 min read
The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere

The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere

Comments
21 min read
The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics

The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics

Comments
22 min read
The Phantom Schema Problem: Why Your Database Contract Breaks Before Your Tests Do

The Phantom Schema Problem: Why Your Database Contract Breaks Before Your Tests Do

Comments
4 min read
QN : Get started with lakehouses in Microsoft Fabric

QN : Get started with lakehouses in Microsoft Fabric

Comments
2 min read
Designing Schema Boundaries for AI Agents

Designing Schema Boundaries for AI Agents

1
Comments
12 min read
QN:Introduction to end-to-end analytics using Microsoft Fabric

QN:Introduction to end-to-end analytics using Microsoft Fabric

Comments
2 min read
chapter 2 of ai-assisted data engineering is live

chapter 2 of ai-assisted data engineering is live

1
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.