Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
# dbt in Production: 5 Gotchas That Broke My Pipelines
De' Clerke
De' Clerke
De' Clerke
Follow
Jun 2
# dbt in Production: 5 Gotchas That Broke My Pipelines
#
dbt
#
dataengineering
#
elt
#
etl
1
 reaction
Comments
Add Comment
7 min read
5 Docker Compose Mistakes That Broke My Airflow 3 Setup 𖣘
De' Clerke
De' Clerke
De' Clerke
Follow
Jun 2
5 Docker Compose Mistakes That Broke My Airflow 3 Setup 𖣘
#
apacheairflow
#
dataengineering
#
orchestration
#
airflow3
1
 reaction
Comments
Add Comment
5 min read
How AI is transforming BI Engineering
anjalika singh
anjalika singh
anjalika singh
Follow
Jun 2
How AI is transforming BI Engineering
#
agents
#
ai
#
automation
#
dataengineering
3
 reactions
Comments
Add Comment
7 min read
Transitioning to Data Engineering: My Top 4 Essential Tools So Far
Muhammadqodir
Muhammadqodir
Muhammadqodir
Follow
Jun 2
Transitioning to Data Engineering: My Top 4 Essential Tools So Far
#
dataengineering
#
python
#
sql
#
cloud
2
 reactions
Comments
Add Comment
1 min read
From Local Scripts to Cloud Servers: Demystifying Docker for DataOps
Cliffe Okoth
Cliffe Okoth
Cliffe Okoth
Follow
May 12
From Local Scripts to Cloud Servers: Demystifying Docker for DataOps
#
beginners
#
dataengineering
#
devops
#
docker
Comments
Add Comment
4 min read
How to Design a Modern Data Architecture with Databricks
Raghav Sharma
Raghav Sharma
Raghav Sharma
Follow
Apr 29
How to Design a Modern Data Architecture with Databricks
#
architecture
#
data
#
dataengineering
#
systemdesign
Comments
Add Comment
4 min read
Your AI agent needs data. Here's how to feed it without RAG.
Michael San Martim
Michael San Martim
Michael San Martim
Follow
Apr 28
Your AI agent needs data. Here's how to feed it without RAG.
#
ai
#
agents
#
automation
#
dataengineering
Comments
Add Comment
5 min read
How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It
Harish
Harish
Harish
Follow
May 28
How a 500 MB Buffer Killed Our Archival Job — And Why Streaming Fixed It
#
dataengineering
#
go
#
kubernetes
#
performance
9
 reactions
Comments
1
 comment
6 min read
What I Learned From Building a Data Mesh
Ben Watson
Ben Watson
Ben Watson
Follow
Jun 1
What I Learned From Building a Data Mesh
#
dataengineering
#
data
1
 reaction
Comments
Add Comment
4 min read
How MindsDB Is Becoming the Data Brain for AI Agents in 2026
JOYSTON
JOYSTON
JOYSTON
Follow
Apr 28
How MindsDB Is Becoming the Data Brain for AI Agents in 2026
#
agents
#
ai
#
database
#
dataengineering
Comments
Add Comment
4 min read
Databricks Data Engineering Interview Questions
Gowtham Potureddi
Gowtham Potureddi
Gowtham Potureddi
Follow
Apr 28
Databricks Data Engineering Interview Questions
#
python
#
sql
#
dataengineering
#
interview
Comments
Add Comment
36 min read
15 Data Integration Tools Worth Knowing in 2026 — An Engineer's Honest Take
Nata
Nata
Nata
Follow
Apr 28
15 Data Integration Tools Worth Knowing in 2026 — An Engineer's Honest Take
#
backend
#
data
#
dataengineering
#
tooling
Comments
Add Comment
18 min read
A Beginners Guide to Apache Airflow
GeraldM
GeraldM
GeraldM
Follow
May 2
A Beginners Guide to Apache Airflow
#
dataengineering
#
airflow
#
automation
#
beginners
2
 reactions
Comments
Add Comment
5 min read
Exploring Snowpark While Comparing It with Apache Spark
Aki
Aki
Aki
Follow
Jun 1
Exploring Snowpark While Comparing It with Apache Spark
#
dataengineering
#
snowflake
4
 reactions
Comments
Add Comment
8 min read
Mastering Modern Data Workflows with Docker
Damaa-C
Damaa-C
Damaa-C
Follow
May 11
Mastering Modern Data Workflows with Docker
#
dataengineering
#
devops
#
docker
#
tutorial
1
 reaction
Comments
Add Comment
3 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account