DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
# dbt in Production: 5 Gotchas That Broke My Pipelines

# dbt in Production: 5 Gotchas That Broke My Pipelines

1
Comments
7 min read
5 Docker Compose Mistakes That Broke My Airflow 3 Setup 𖣘

5 Docker Compose Mistakes That Broke My Airflow 3 Setup 𖣘

1
Comments
5 min read
How AI is transforming BI Engineering

How AI is transforming BI Engineering

3
Comments
7 min read
Transitioning to Data Engineering: My Top 4 Essential Tools So Far

Transitioning to Data Engineering: My Top 4 Essential Tools So Far

2
Comments
1 min read
From Local Scripts to Cloud Servers: Demystifying Docker for DataOps

From Local Scripts to Cloud Servers: Demystifying Docker for DataOps

Comments
4 min read
How to Design a Modern Data Architecture with Databricks

How to Design a Modern Data Architecture with Databricks

Comments
4 min read
Your AI agent needs data. Here's how to feed it without RAG.

Your AI agent needs data. Here's how to feed it without RAG.

Comments
5 min read
How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It

How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It

9
Comments 1
6 min read
What I Learned From Building a Data Mesh

What I Learned From Building a Data Mesh

1
Comments
4 min read
How MindsDB Is Becoming the Data Brain for AI Agents in 2026

How MindsDB Is Becoming the Data Brain for AI Agents in 2026

Comments
4 min read
Databricks Data Engineering Interview Questions

Databricks Data Engineering Interview Questions

Comments
36 min read
15 Data Integration Tools Worth Knowing in 2026 — An Engineer's Honest Take

15 Data Integration Tools Worth Knowing in 2026 — An Engineer's Honest Take

Comments
18 min read
A Beginners Guide to Apache Airflow

A Beginners Guide to Apache Airflow

2
Comments
5 min read
Exploring Snowpark While Comparing It with Apache Spark

Exploring Snowpark While Comparing It with Apache Spark

4
Comments
8 min read
Mastering Modern Data Workflows with Docker

Mastering Modern Data Workflows with Docker

1
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.