DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders
labyrinthanalytics profile

What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders

#ai #machinelearning #dataengineering #llm
Comments
7 min read
The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade
alexmercedcoder profile

The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

#news #data #dataengineering #opensource
Comments
21 min read
Your Data Pipeline Is Probably More Fragile Than You Think
sampada_sharma_842c114249 profile

Your Data Pipeline Is Probably More Fragile Than You Think

#dataengineering #data
Comments
4 min read
Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse
tayfun_yalcinkaya_9c29444 profile

Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse

#kafka #architecture #streaming #dataengineering
Comments
13 min read
Linux Fundamentals for Data Engineering
tony-kamande profile

Linux Fundamentals for Data Engineering

#beginners #dataengineering #linux #tutorial
4
Comments 2
5 min read
Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü
tayfun_yalcinkaya_9c29444 profile

Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü

#kafka #streaming #dataengineering #turkish
Comments
14 min read
The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere
alexmercedcoder profile

The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere

#architecture #data #dataengineering #opensource
Comments
21 min read
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
alexmercedcoder profile

The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough

#architecture #dataengineering #performance #streaming
Comments
22 min read
The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics
alexmercedcoder profile

The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics

#analytics #database #dataengineering #performance
1
Comments
22 min read
The Phantom Schema Problem: Why Your Database Contract Breaks Before Your Tests Do
jitendra_devabhaktuni_0f1 profile

The Phantom Schema Problem: Why Your Database Contract Breaks Before Your Tests Do

#ai #database #datascience #dataengineering
Comments
4 min read
Debezium vs Managed CDC: How to Actually Decide Between Build and Buy
techsourabh profile

Debezium vs Managed CDC: How to Actually Decide Between Build and Buy

#dataengineering #database #cdc
6
Comments
9 min read
QN : Get started with lakehouses in Microsoft Fabric
pauletart profile

QN : Get started with lakehouses in Microsoft Fabric

#architecture #dataengineering #microsoft #tutorial
Comments
2 min read
QN:Introduction to end-to-end analytics using Microsoft Fabric
pauletart profile

QN:Introduction to end-to-end analytics using Microsoft Fabric

#dataengineering #analytics #analyticsengineering
Comments
2 min read
chapter 2 of ai-assisted data engineering is live
shrouwoods profile

chapter 2 of ai-assisted data engineering is live

#ai #dataengineering #writing #books
1
Comments
4 min read
Designing Schema Boundaries for AI Agents
gyu07 profile

Designing Schema Boundaries for AI Agents

#ai #database #dataengineering #dbt
1
Comments
12 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.