DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
From Dashboards to Autonomous Action: Why You Need to Attend Google Cloud Labs
joey_lynne profile

From Dashboards to Autonomous Action: Why You Need to Attend Google Cloud Labs

#googlecloud #agents #dataengineering
23
Comments
2 min read
I Just Wanted dbt State Without Another Account
sudo_pradip profile

I Just Wanted dbt State Without Another Account

#dbt #opensource #dataengineering #elt
3
Comments
2 min read
I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.
niclydon profile

I Built a Personal Knowledge Graph. Apple Had Already Built One on My Laptop.

#apple #postgres #privacy #dataengineering
1
Comments 1
6 min read
Add Data Quality Checks to Your Airflow DAG in 5 Minutes
vahid_saber_d47950be99729 profile

Add Data Quality Checks to Your Airflow DAG in 5 Minutes

#airflow #dataengineering #python #dataquality
Comments
3 min read
DatAasee 0.9 Released
gramian profile

DatAasee 0.9 Released

#metadata #lakehouse #dataengineering #database
Comments
1 min read
That Time One Field Change Took Down an Entire Production Pipeline
reetesh_kumar profile

That Time One Field Change Took Down an Entire Production Pipeline

#backend #dataengineering #distributedsystems #systemdesign
1
Comments
4 min read
Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published
amaranarun profile

Beyond Monitoring: Building AI-Powered Predictive Observability for Retail Data Pipelines published

#dataengineering #observability #mlops #dataquality
Comments
8 min read
Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs
lawrence_murithi profile

Folders, Apartments, and Fake Computers: A Guide to Virtual Environments, Docker, and VMs

#docker #virtualmachine #virtualenvironment #dataengineering
Comments
8 min read
A Step-by-Step Starter Kit for Building a Data Quality Framework
balapriya profile

A Step-by-Step Starter Kit for Building a Data Quality Framework

#data #dataengineering #testing #tutorial
Comments
6 min read
Data Series: Understanding ETL & Medallion Architecture — Part 1
deepak_shankar_4421c006b5 profile

Data Series: Understanding ETL & Medallion Architecture — Part 1

#architecture #beginners #dataengineering #tutorial
1
Comments
2 min read
Why Your ADF Pipeline Shows Success But Your Data Is Wrong
chandramouli_kondamudi_82 profile

Why Your ADF Pipeline Shows Success But Your Data Is Wrong

#azure #dataengineering #data #etl
Comments
2 min read
Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline
ankitjswl56 profile

Eradicating Operational Drag: Architecting a Resilient Data Ingestion Pipeline

#systemdesign #architecture #dataengineering #automation
Comments
5 min read
The Medallion Architecture: Turning Messy Data into Business Gold
lawrence_murithi profile

The Medallion Architecture: Turning Messy Data into Business Gold

#architecture #luxdev #dataengineering #warehouse
Comments
9 min read
Data Lineage Is a Vanity Metric Without Business Context
andrew_tan_layline profile

Data Lineage Is a Vanity Metric Without Business Context

#datalineage #datagovernance #dataquality #dataengineering
Comments
6 min read
DuckDB vs SQLite: Which one is better?
ranaweerasupun profile

DuckDB vs SQLite: Which one is better?

#duckdb #sqlite #iot #dataengineering
1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.