DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
Data Series: Understanding ETL & Medallion Architecture — Part 1
deepak_shankar_4421c006b5 profile

Data Series: Understanding ETL & Medallion Architecture — Part 1

#architecture #beginners #dataengineering #tutorial
1
Comments
2 min read
Why Your ADF Pipeline Shows Success But Your Data Is Wrong
chandramouli_kondamudi_82 profile

Why Your ADF Pipeline Shows Success But Your Data Is Wrong

#azure #dataengineering #data #etl
Comments
2 min read
Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline
ankitjswl56 profile

Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline

#systemdesign #architecture #dataengineering #automation
Comments
5 min read
The Medallion Architecture: Turning Messy Data into Business Gold
lawrence_murithi profile

The Medallion Architecture: Turning Messy Data into Business Gold

#architecture #luxdev #dataengineering #warehouse
Comments
9 min read
Data Lineage Is a Vanity Metric Without Business Context
andrew_tan_layline profile

Data Lineage Is a Vanity Metric Without Business Context

#datalineage #datagovernance #dataquality #dataengineering
Comments
6 min read
DuckDB vs SQLite: Which one is better?
ranaweerasupun profile

DuckDB vs SQLite: Which one is better?

#duckdb #sqlite #iot #dataengineering
1
Comments
6 min read
Apache Kafka Explained: A Practical Beginner Guide for Data Engineers
anthony-gicheru profile

Apache Kafka Explained: A Practical Beginner Guide for Data Engineers

#kafka #dataengineering #beginners #distributedsystems
4
Comments
9 min read
Python Week 6: Our Programs Finally Read Real Files
navas_herbert profile

Python Week 6: Our Programs Finally Read Real Files

#python #beginners #dataengineering #ai
1
Comments
8 min read
The Decay Curve Nobody Budgets For
neela_582b5c546f2e2ef65d0 profile
Neela

The Decay Curve Nobody Budgets For

#data #database #dataengineering #management
Comments
4 min read
Your ETL Pipeline Wasn't Built for AI — Here's How to Fix It in 2026
gabrielhca profile

Your ETL Pipeline Wasn't Built for AI — Here's How to Fix It in 2026

#dataengineering #python #ai #tutorial
Comments
7 min read
What dbt Tests Miss (and How to Catch It Automatically)
vahid_saber_d47950be99729 profile

What dbt Tests Miss (and How to Catch It Automatically)

#dataengineering #dbt #postgres #postgressql
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.