DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
850x Faster PostgreSQL Writes With One Line of Python

850x Faster PostgreSQL Writes With One Line of Python

Comments 1
3 min read
Data Engineer Salaries Are Splitting in Two. Which Side Are You On?

Data Engineer Salaries Are Splitting in Two. Which Side Are You On?

Comments
7 min read
How Databricks Genie Turns Plain English Into SQL Code

How Databricks Genie Turns Plain English Into SQL Code

5
Comments
11 min read
How a Simple Warehouse Resize Saved Us 11% in Daily Credits While Boosting Performance

How a Simple Warehouse Resize Saved Us 11% in Daily Credits While Boosting Performance

4
Comments
4 min read
From Dirty CSV to Golden Records: A Python Walkthrough

From Dirty CSV to Golden Records: A Python Walkthrough

Comments
10 min read
SIMPLE BEGINNER CRYPTO ETL PIPELINE.

SIMPLE BEGINNER CRYPTO ETL PIPELINE.

1
Comments
2 min read
Why My Spark Container Keeps Exiting — Docker PID 1 and the Daemon Trap

Why My Spark Container Keeps Exiting — Docker PID 1 and the Daemon Trap

Comments 1
5 min read
The Backyard Quarry, Part 8: From Rocks to Reality

The Backyard Quarry, Part 8: From Rocks to Reality

2
Comments
4 min read
Using Databricks Genie for Natural Language Querying on Semantic Models

Using Databricks Genie for Natural Language Querying on Semantic Models

Comments
7 min read
The Web Scraping Data Warehouse Pipeline I Run for $12/Month

The Web Scraping Data Warehouse Pipeline I Run for $12/Month

Comments
3 min read
The real problem with ingesting MongoDB into Delta Lake (and how I built a library to fix it)

The real problem with ingesting MongoDB into Delta Lake (and how I built a library to fix it)

2
Comments 7
5 min read
How to Think During a Data Engineering Interview in 2026

How to Think During a Data Engineering Interview in 2026

1
Comments
6 min read
CSV: The Format Nobody Designed

CSV: The Format Nobody Designed

Comments
2 min read
I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)

I Analyzed 10 Million Records in 47 Seconds Using Python + DuckDB (No Spark, No Cloud)

3
Comments 2
3 min read
Apache Data Lakehouse Weekly: April 30–May 6, 2026

Apache Data Lakehouse Weekly: April 30–May 6, 2026

Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.