Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sneha Wasankar

Apr 20

Kafka Consumer Patterns: What You Actually Need in Production

#architecture #dataengineering #distributedsystems #systemdesign

3 min read

Abdelrahman Adnan

Apr 21

Part 13 - Local Development and Docker Compose 🐳

#dataengineering #devops #docker #tutorial

1 min read

Abdelrahman Adnan

Apr 21

Part 10 - Base Model and Data Quality ✅

#data #dataengineering #sql #tutorial

1 min read

Stock Expert AI

May 24

Building a Daily Data Pipeline That Survives Market Holidays

#automation #dataengineering #python #tutorial

2 min read

Ben Watson

May 24

Deeper into Dataform 2: Other API features

#dataform #dataengineering #gcp #bigquery

1 min read

Ben Watson

May 24

Deeper into Dataform 1: Exploring the API

#dataform #dataengineering #gcp #bigquery

3 min read

Du Tran

Apr 20

Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You

#iceberg #dataengineering #aws #python

6 min read

ITPrep

Apr 20

ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng

#dataengineering #systemdesign #ai #workflow

2 min read

Alex Merced

May 24

Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

#architecture #database #dataengineering #performance

18 min read

Maninderpreet Singh

Apr 19

Your AI Security Problem Starts Before the Prompt

#ai #security #dataengineering #architecture

8 min read

Mungai M.

Apr 19

Level Up Your SQL: Subqueries & CTEs in the Real World

#sql #dataengineering #database #assignment

9 min read

Harry Wynn

Apr 19

Why don’t my database numbers match? I built a tool to find out.

#database #webdev #programming #dataengineering

2 min read

Shiva

May 12

Why every data quality tool tells you what broke — but leaves you alone to figure out why

#dataquality #agents #opensource #dataengineering

5 min read

Ajay Katte

Apr 19

Data pipeline around 15 minute city

#datascience #dataengineering #airflow #dbt

1 min read

Velk

Apr 19

Location as the Anchor: Mapping Species, Geology, UFOs, and Bigfoot to 105,000 Coordinates

#postgressql #postgis #dataengineering #seo

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

Kafka Consumer Patterns: What You Actually Need in Production

Part 13 - Local Development and Docker Compose 🐳

Part 10 - Base Model and Data Quality ✅

Building a Daily Data Pipeline That Survives Market Holidays

Deeper into Dataform 2: Other API features

Deeper into Dataform 1: Exploring the API

Migrating Apache Iceberg Tables Between AWS Accounts: What Nobody Tells You

ByteDance DeerFlow: "Bộ Não Điều Phối" Đằng Sau Hệ Thống Tỷ Người Dùng

Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

Your AI Security Problem Starts Before the Prompt

Level Up Your SQL: Subqueries & CTEs in the Real World

Why don’t my database numbers match? I built a tool to find out.

Why every data quality tool tells you what broke — but leaves you alone to figure out why

Data pipeline around 15 minute city

Location as the Anchor: Mapping Species, Geology, UFOs, and Bigfoot to 105,000 Coordinates