DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Kafka Consumer Patterns: What You Actually Need in Production

Kafka Consumer Patterns: What You Actually Need in Production

1
Comments
3 min read
Part 13 - Local Development and Docker Compose 🐳

Part 13 - Local Development and Docker Compose 🐳

Comments
1 min read
Part 10 - Base Model and Data Quality ✅

Part 10 - Base Model and Data Quality ✅

Comments
1 min read
Building a Daily Data Pipeline That Survives Market Holidays

Building a Daily Data Pipeline That Survives Market Holidays

1
Comments
2 min read
Deeper into Dataform 2: Other API features

Deeper into Dataform 2: Other API features

1
Comments
1 min read
Deeper into Dataform 1: Exploring the API

Deeper into Dataform 1: Exploring the API

Comments
3 min read
Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You

Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You

Comments
6 min read
ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng

ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng

Comments
2 min read
Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

1
Comments
18 min read
Your AI Security Problem Starts Before the Prompt

Your AI Security Problem Starts Before the Prompt

Comments
8 min read
Level Up Your SQL: Subqueries & CTEs in the Real World

Level Up Your SQL: Subqueries & CTEs in the Real World

Comments
9 min read
Why don’t my database numbers match? I built a tool to find out.

Why don’t my database numbers match? I built a tool to find out.

Comments
2 min read
Why every data quality tool tells you what broke — but leaves you alone to figure out why

Why every data quality tool tells you what broke — but leaves you alone to figure out why

1
Comments
5 min read
Data pipeline around 15 minute city

Data pipeline around 15 minute city

Comments
1 min read
Location as the Anchor: Mapping Species, Geology, UFOs, and Bigfoot to 105,000 Coordinates

Location as the Anchor: Mapping Species, Geology, UFOs, and Bigfoot to 105,000 Coordinates

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.