DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline

Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline

Comments
5 min read
The Medallion Architecture: Turning Messy Data into Business Gold

The Medallion Architecture: Turning Messy Data into Business Gold

Comments
9 min read
Apache Data Lakehouse Weekly: April 30–May 6, 2026

Apache Data Lakehouse Weekly: April 30–May 6, 2026

Comments
9 min read
How to Think During a Data Engineering Interview in 2026

How to Think During a Data Engineering Interview in 2026

1
Comments
6 min read
We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

Comments
12 min read
Stop Using Spark for Your Small Data - Why Azure Functions is the Right Tool for the Job

Stop Using Spark for Your Small Data - Why Azure Functions is the Right Tool for the Job

Comments
3 min read
How a Simple Warehouse Resize Saved Us 11% in Daily Credits While Boosting Performance

How a Simple Warehouse Resize Saved Us 11% in Daily Credits While Boosting Performance

Comments
4 min read
SIMPLE BEGINNER CRYPTO ETL PIPELINE.

SIMPLE BEGINNER CRYPTO ETL PIPELINE.

Comments
2 min read
The Decay Curve Nobody Budgets For

The Decay Curve Nobody Budgets For

Comments
4 min read
SQL String Functions: Clean, Transform, and Tame Messy Data Like a Pro

SQL String Functions: Clean, Transform, and Tame Messy Data Like a Pro

Comments
6 min read
What is Dremio? The Unified Lakehouse and AI Platform

What is Dremio? The Unified Lakehouse and AI Platform

Comments
5 min read
ETL vs ELT: The Difference That Finally Clicked for Me

ETL vs ELT: The Difference That Finally Clicked for Me

Comments
2 min read
Stop Overpaying for AWS Data Transfer: A Guide to VPC Endpoints

Stop Overpaying for AWS Data Transfer: A Guide to VPC Endpoints

Comments
2 min read
What dbt Tests Miss (and How to Catch It Automatically)

What dbt Tests Miss (and How to Catch It Automatically)

Comments
3 min read
AI Broke Data Engineering Interviews. Nobody Knows What's Next.

AI Broke Data Engineering Interviews. Nobody Knows What's Next.

Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.