DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Real-Time Market Anomaly Dashboard with Vue3, Element Plus, and Java

Building a Real-Time Market Anomaly Dashboard with Vue3, Element Plus, and Java

1
Comments
3 min read
#Connecting Power BI to SQL Databases: A Complete Guide

#Connecting Power BI to SQL Databases: A Complete Guide

2
Comments
4 min read
Otimizando Escrita e Performance em Ambientes com Delta Lake, MinIO e Spark

Otimizando Escrita e Performance em Ambientes com Delta Lake, MinIO e Spark

1
Comments
3 min read
Quantified Self: Syncing Whoop and Garmin Metrics with InfluxDB and Grafana

Quantified Self: Syncing Whoop and Garmin Metrics with InfluxDB and Grafana

1
Comments
3 min read
Amazon S3 Files: from Kafka to S3 via NFS

Amazon S3 Files: from Kafka to S3 via NFS

3
Comments 1
11 min read
16GB of RAM, 12GB of JSON, and One Very Loud Fan

16GB of RAM, 12GB of JSON, and One Very Loud Fan

Comments
5 min read
How Apache Iceberg's Metadata Architecture Enables ACID at Scale

How Apache Iceberg's Metadata Architecture Enables ACID at Scale

Comments
7 min read
Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines

Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines

Comments
7 min read
Apache Spark in Plain English: The Engine Behind Databricks

Apache Spark in Plain English: The Engine Behind Databricks

Comments
5 min read
The Modern Data Stack Has a Coherence Problem

The Modern Data Stack Has a Coherence Problem

1
Comments
7 min read
How I built a MilliSeconds data quality firewall on Cloudflare Workers

How I built a MilliSeconds data quality firewall on Cloudflare Workers

2
Comments 1
7 min read
ETL vs ELT: Which One Should You Use and Why?

ETL vs ELT: Which One Should You Use and Why?

2
Comments
3 min read
How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

1
Comments
2 min read
Delta Lake Patterns Library: Delta Lake Best Practices

Delta Lake Patterns Library: Delta Lake Best Practices

Comments
3 min read
I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

1
Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.