DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Data Modeling Concepts Nobody Mentions After Star Schema 101

The Data Modeling Concepts Nobody Mentions After Star Schema 101

1
Comments
6 min read
Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases

Understanding Apache Airflow 3.3: Key Improvements, Features Every Data Engineer Should Know, and Real-World Use Cases

Comments
11 min read
Data Engineering Dropped DSA. What Replaced It Is Worse.

Data Engineering Dropped DSA. What Replaced It Is Worse.

Comments
7 min read
Parsing financial PDFs without chasing 100% accuracy

Parsing financial PDFs without chasing 100% accuracy

3
Comments
4 min read
Synthetic Time Series Data: A Practical Guide META

Synthetic Time Series Data: A Practical Guide META

Comments
6 min read
CDC with Sling: When Log-Based Works and When Query-Based Is Enough

CDC with Sling: When Log-Based Works and When Query-Based Is Enough

Comments 1
8 min read
Data Pipelines Explained: Benefits, Types, and Use Cases

Data Pipelines Explained: Benefits, Types, and Use Cases

Comments
4 min read
95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.

95% of My PySpark Job Finished in 4 Minutes. The Last Task Took 40. Here's Why.

Comments
5 min read
dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

dbt Was Not Designed for Multi-Tenant SaaS. Here's How I Made It Work.

Comments
4 min read
Building a real-time price monitoring pipeline that does not poison your data

Building a real-time price monitoring pipeline that does not poison your data

Comments
4 min read
One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One

One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One

11
Comments
7 min read
Building an investing knowledge graph, part 3: same company, seven names

Building an investing knowledge graph, part 3: same company, seven names

2
Comments
4 min read
The Pipeline Worked. Then the Research Outgrew It.

The Pipeline Worked. Then the Research Outgrew It.

Comments
4 min read
Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained

Subqueries vs CTEs: Query Optimizer Internals & Memory Spooling Explained

Comments
2 min read
One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One

One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One

Comments 2
7 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.