DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Preparing Clean Data for a DWH

Preparing Clean Data for a DWH

Comments
21 min read
PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts

PySpark Caching on Azure Databricks: cache() vs persist() vs checkpoint(), the Disk Cache, and When Caching Hurts

1
Comments
6 min read
How to Architect Real-Time Replication with Mirrored Azure SQL Databases

How to Architect Real-Time Replication with Mirrored Azure SQL Databases

1
Comments 1
4 min read
AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive

AI-Driven Dynamic Pricing in Hotels: A Data Engineer's Deep Dive

Comments
7 min read
Your Fuel Plan Uses One Diesel Price. Europe Publishes 42,323.

Your Fuel Plan Uses One Diesel Price. Europe Publishes 42,323.

Comments 1
11 min read
A vendor bar for a day nothing traded - why our completeness check was 97% wrong

A vendor bar for a day nothing traded - why our completeness check was 97% wrong

Comments 1
3 min read
Building an End-to-End Spatial Data Pipeline with AWS S3 Express & Athena Iceberg

Building an End-to-End Spatial Data Pipeline with AWS S3 Express & Athena Iceberg

1
Comments
2 min read
Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison

Best Cron Service for Scheduled Data Cleanup: A Delivery Guarantee Comparison

Comments
6 min read
Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução

Como aprendi Apache Spark — Parte 5: Joins — Shuffle, Broadcast e estratégias de execução

Comments
14 min read
## Load balancing for system design interviews, explained

## Load balancing for system design interviews, explained

Comments
14 min read
Designing a parking lot: the low-level design interview, explained

Designing a parking lot: the low-level design interview, explained

Comments
15 min read
Your salary coverage can fall before employers change

Your salary coverage can fall before employers change

Comments
7 min read
Message queues and pub/sub for system design interviews, explained

Message queues and pub/sub for system design interviews, explained

Comments
15 min read
Microservices architecture interview questions, answered

Microservices architecture interview questions, answered

Comments
16 min read
Kafka Consumers on EKS: Designing for a Platform That Restarts Your Consumer Group

Kafka Consumers on EKS: Designing for a Platform That Restarts Your Consumer Group

1
Comments 1
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.