DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

1
Comments
2 min read
I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

1
Comments
4 min read
Prediksi ETA Pengiriman Tanpa “AI Hype”: Fitur yang Masuk Akal, Evaluasi Model, dan Cara Menghindari Bias

Prediksi ETA Pengiriman Tanpa “AI Hype”: Fitur yang Masuk Akal, Evaluasi Model, dan Cara Menghindari Bias

Comments
8 min read
“From Chaos to Clarity: Integrating Data from Multiple Systems in Modern Data Platforms”

“From Chaos to Clarity: Integrating Data from Multiple Systems in Modern Data Platforms”

1
Comments
5 min read
El Ciclo de Vida de la IngenierĂ­a de Datos

El Ciclo de Vida de la IngenierĂ­a de Datos

1
Comments
4 min read
ETL vs ELT: Which One Should You Use and Why?

ETL vs ELT: Which One Should You Use and Why?

Comments
7 min read
The X-Axis of Data: How BigQuery Models the Customer Dimension for Agentic AI Decisions

The X-Axis of Data: How BigQuery Models the Customer Dimension for Agentic AI Decisions

1
Comments
5 min read
Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C 🧱🔥

Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C 🧱🔥

1
Comments
2 min read
Reproducibility of Analytical Decisions: Introducing a Deterministic Analytical Runtime

Reproducibility of Analytical Decisions: Introducing a Deterministic Analytical Runtime

1
Comments
3 min read
What is the difference between ETL and ELT?

What is the difference between ETL and ELT?

3
Comments 2
5 min read
Why Shannon Entropy Catches What Schema Validation Misses

Why Shannon Entropy Catches What Schema Validation Misses

Comments
5 min read
Apache Parquet File Anatomy: Row Groups, Column Chunks, Pages, and Metadata Explained 🧱📦

Apache Parquet File Anatomy: Row Groups, Column Chunks, Pages, and Metadata Explained 🧱📦

Comments
8 min read
Turing Completeness in Reactivity

Turing Completeness in Reactivity

5
Comments
4 min read
dbt snapshots: moving from merges to native history

dbt snapshots: moving from merges to native history

1
Comments
5 min read
A Beginner's Guide to SQL Joins and Window Functions

A Beginner's Guide to SQL Joins and Window Functions

1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.