DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
MongoDB to Snowflake with Change Streams: A Hands-On Tutorial Without Kafka

MongoDB to Snowflake with Change Streams: A Hands-On Tutorial Without Kafka

Comments
13 min read
Blank is not zero: adding FCS football to a stats site without pretending the data is complete

Blank is not zero: adding FCS football to a stats site without pretending the data is complete

Comments
3 min read
Pull every table out of a pile of PDFs into one Excel file (Python, free way and lazy way)

Pull every table out of a pile of PDFs into one Excel file (Python, free way and lazy way)

Comments
3 min read
Nightly CSV from an SFTP server into Salesforce: 7 things that break

Nightly CSV from an SFTP server into Salesforce: 7 things that break

Comments 1
3 min read
Where Was Pole Actually Won? Aligning Asynchronous F1 Telemetry Streams in Go

Where Was Pole Actually Won? Aligning Asynchronous F1 Telemetry Streams in Go

1
Comments
7 min read
How I Automated 10M+ Network KPI Records a Day with Python and Apache Airflow

How I Automated 10M+ Network KPI Records a Day with Python and Apache Airflow

Comments
2 min read
Design a live video comments system: the system design interview walkthrough

Design a live video comments system: the system design interview walkthrough

Comments
18 min read
ACID properties for system design interviews, explained

ACID properties for system design interviews, explained

Comments
13 min read
Design Spotify: the music streaming system design interview walkthrough

Design Spotify: the music streaming system design interview walkthrough

Comments
17 min read
API gateways for system design interviews, explained

API gateways for system design interviews, explained

Comments
13 min read
SQL Interview Question: Why Do Three Dashboards Disagree?

SQL Interview Question: Why Do Three Dashboards Disagree?

1
Comments
6 min read
What Changes in Apache Iceberg v4? Some Thoughts After Reading the Spec

What Changes in Apache Iceberg v4? Some Thoughts After Reading the Spec

7
Comments 1
7 min read
MySQL to DuckDB: A Binlog CDC Walkthrough Where the Last Step Is ATTACH

MySQL to DuckDB: A Binlog CDC Walkthrough Where the Last Step Is ATTACH

Comments
10 min read
eMondrian now speaks JSON: a REST API on your semantic model

eMondrian now speaks JSON: a REST API on your semantic model

Comments
5 min read
10 Azure Data Factory and ADLS Gen2 Interview Questions (2027), with Answers

10 Azure Data Factory and ADLS Gen2 Interview Questions (2027), with Answers

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.