DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Design a distributed message queue: the system design interview walkthrough

Design a distributed message queue: the system design interview walkthrough

Comments
15 min read
Design Uber: the ride-sharing system design interview walkthrough

Design Uber: the ride-sharing system design interview walkthrough

Comments
16 min read
DuckLess: serverless DuckDB on Google Cloud, in your own project

DuckLess: serverless DuckDB on Google Cloud, in your own project

11
Comments 1
10 min read
Building Indonesia's Industrial Data Layer: From Power BI to DuckDB Lakehouses and Multi-Agent AI

Building Indonesia's Industrial Data Layer: From Power BI to DuckDB Lakehouses and Multi-Agent AI

Comments
4 min read
Design a news feed: the social media feed design interview walkthrough

Design a news feed: the social media feed design interview walkthrough

Comments
15 min read
Design a web crawler: the system design interview walkthrough

Design a web crawler: the system design interview walkthrough

Comments
15 min read
Design Netflix: the video streaming system design interview walkthrough

Design Netflix: the video streaming system design interview walkthrough

Comments
15 min read
How to Design an IoT Data Pipeline for Multi-Frequency Measurements

How to Design an IoT Data Pipeline for Multi-Frequency Measurements

5
Comments
5 min read
Design a distributed cache: the system design interview guide

Design a distributed cache: the system design interview guide

Comments 1
16 min read
Treat product assortment as a data problem, not a catalog spreadsheet

Treat product assortment as a data problem, not a catalog spreadsheet

Comments
5 min read
Entry-Level Data Engineer Jobs: Stanford's 19% Gap vs BLS's 35%

Entry-Level Data Engineer Jobs: Stanford's 19% Gap vs BLS's 35%

Comments
8 min read
Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline

Amazon Aurora PostgreSQL: Query Remote Data Without Building an ETL Pipeline

Comments
5 min read
Extracting data from hundreds of PDFs into Excel (and why a converter is not enough)

Extracting data from hundreds of PDFs into Excel (and why a converter is not enough)

Comments 1
5 min read
Why Access Control Cannot Enforce Purpose Limitation in Data Pipelines

Why Access Control Cannot Enforce Purpose Limitation in Data Pipelines

1
Comments
4 min read
Airflow 3 quietly changed what your cron schedule means

Airflow 3 quietly changed what your cron schedule means

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.