Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Alex Merced

Apr 13

What is Apache Parquet? Columns, Encoding, and Performance

#database #dataengineering #opensource #performance

4 min read

Alex Merced

Apr 13

What is Apache Iceberg? The Table Format Revolution

#architecture #database #dataengineering #opensource

4 min read

Alex Merced

Apr 13

Assembling the Apache Lakehouse: The Modular Architecture

#architecture #data #dataengineering #opensource

3 min read

Francisco Jaime da Silva

Mar 11

Otimizando Escrita e Performance em Ambientes com Delta Lake, MinIO e Spark

#database #dataengineering #performance #tutorial

3 min read

Beck_Moulton

Mar 11

Quantified Self: Syncing Whoop and Garmin Metrics with InfluxDB and Grafana

#python #opensource #quantifiedself #dataengineering

3 min read

Alexander Smirnoff

Apr 13

Amazon S3 Files: from Kafka to S3 via NFS

#architecture #aws #dataengineering #tutorial

11 min read

Velk

Apr 13

16GB of RAM, 12GB of JSON, and One Very Loud Fan

#python #postgres #dataengineering #seo

5 min read

Prithvi S

Apr 13

How Apache Iceberg's Metadata Architecture Enables ACID at Scale

#architecture #database #dataengineering #distributedsystems

7 min read

Vinicius Fagundes

Apr 13

Apache Spark in Plain English: The Engine Behind Databricks

#ai #dataengineering #spark

5 min read

Martin Tuncaydin

Mar 23

Data Quality at Scale: Building Trust in Airline Schedule Data Pipelines

#dataquality #airlinetechnology #traveldatapipelines #dataengineering

7 min read

Angela Zhao

Mar 10

The Modern Data Stack Has a Coherence Problem

#dataengineering #ai #architecture #database

7 min read

Vignesh

Apr 1

How I built a MilliSeconds data quality firewall on Cloudflare Workers

#python #dataengineering #cloudflarechallenge #opensource

7 min read

Anthony Gicheru

Apr 12

The Real Difference Between ETL and ELT

#dataengineering #etl #elt

5 min read

Naveen Badiger

Mar 7

How I built a 39x compression pipeline with AES-256-GCM in Python (and why the dictionary is everything)

#python #machinelearning #security #dataengineering

2 min read

TheLinuxMan

Mar 9

I Built a Corrupt Archive Recovery Engine in Rust — Because Every Tool I Tried Just Gave Up

#rust #dataengineering

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.