DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines
airtruffle profile

Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines

#dataquality #airlinetechnology #traveldatapipelines #dataengineering
Comments
7 min read
Apache Spark in Plain English: The Engine Behind Databricks
fagundesv profile

Apache Spark in Plain English: The Engine Behind Databricks

#ai #dataengineering #spark
Comments
5 min read
The Modern Data Stack Has a Coherence Problem
hui_zhao_405dc49731688b0c profile

The Modern Data Stack Has a Coherence Problem

#dataengineering #ai #architecture #database
1
Comments
7 min read
How I built a MilliSeconds data quality firewall on Cloudflare Workers
appdeviq profile

How I built a MilliSeconds data quality firewall on Cloudflare Workers

#python #dataengineering #cloudflarechallenge #opensource
2
Comments 1
7 min read
The Real Difference Between ETL and ELT
anthony-gicheru profile

The Real Difference Between ETL and ELT

#dataengineering #etl #elt
2
Comments
5 min read
How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)
naveen_badiger_47b35b3f61 profile

How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

#python #machinelearning #security #dataengineering
1
Comments
2 min read
I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up
thelinuxman profile

I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

#rust #dataengineering
1
Comments
4 min read
Prediksi ETA Pengiriman Tanpa “AI Hype”: Fitur yang Masuk Akal, Evaluasi Model, dan Cara Menghindari Bias
mightyblue profile

Prediksi ETA Pengiriman Tanpa “AI Hype”: Fitur yang Masuk Akal, Evaluasi Model, dan Cara Menghindari Bias

#ai #machinelearning #indonesia #dataengineering
Comments
8 min read
“From Chaos to Clarity: Integrating Data from Multiple Systems in Modern Data Platforms”
ramavala profile

“From Chaos to Clarity: Integrating Data from Multiple Systems in Modern Data Platforms”

#dataengineering #dataarchitecture #cloudcomputing #dataintegration
1
Comments
5 min read
El Ciclo de Vida de la IngenierĂ­a de Datos
mirinagonzales profile

El Ciclo de Vida de la IngenierĂ­a de Datos

#dataengineering #data #architecture
1
Comments
4 min read
ETL vs ELT: Which One Should You Use and Why?
lawrence_murithi profile

ETL vs ELT: Which One Should You Use and Why?

#architecture #data #database #dataengineering
Comments
7 min read
The X-Axis of Data: How BigQuery Models the Customer Dimension for Agentic AI Decisions
ramavala profile

The X-Axis of Data: How BigQuery Models the Customer Dimension for Agentic AI Decisions

#enterprisearchitecture #dataengineering #ai #bigquery
1
Comments
5 min read
Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C đŸ§±đŸ”„
nareshcn2 profile

Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C đŸ§±đŸ”„

#c #performance #dataengineering #distributedsystems
1
Comments
2 min read
Reproducibility of Analytical Decisions: Introducing a Deterministic Analytical Runtime
panorama_engine profile

Reproducibility of Analytical Decisions: Introducing a Deterministic Analytical Runtime

#analytics #architecture #dataengineering #datascience
1
Comments
3 min read
What is the difference between ETL and ELT?
cliffe_okoth profile

What is the difference between ETL and ELT?

#data #dataengineering #sql #cloud
3
Comments 2
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.