DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Why 'FINAL' in ClickHouse Is Usually a Design Smell

Why 'FINAL' in ClickHouse Is Usually a Design Smell

2
Comments
3 min read
Optimizing Continuous Aggregate Performance for Large Datasets

Optimizing Continuous Aggregate Performance for Large Datasets

Comments
4 min read
How to Build a Real-Time DynamoDB to S3 Analytics Pipeline with Apache Iceberg

How to Build a Real-Time DynamoDB to S3 Analytics Pipeline with Apache Iceberg

2
Comments
8 min read
How Netflix Turns 2 Trillion Daily Events Into Architectural Decisions (And How You Can Too)

How Netflix Turns 2 Trillion Daily Events Into Architectural Decisions (And How You Can Too)

1
Comments
14 min read
S&OP Engineering II: Demand Planning from Guessing to Probability

S&OP Engineering II: Demand Planning from Guessing to Probability

3
Comments
4 min read
Debugging & Refactoring Spaghetti Code - The A.I Special 🤖

Debugging & Refactoring Spaghetti Code - The A.I Special 🤖

1
Comments
5 min read
Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

3
Comments
4 min read
Why Travel Technology is the Next Frontier for AI Investment

Why Travel Technology is the Next Frontier for AI Investment

Comments
7 min read
Mastering Joins and Window Functions in SQL for Data Engineers

Mastering Joins and Window Functions in SQL for Data Engineers

Comments
4 min read
Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

14
Comments
5 min read
From APIs to Warehouses: AI-Assisted Data Ingestion with dlt

From APIs to Warehouses: AI-Assisted Data Ingestion with dlt

1
Comments
1 min read
Data Pipeline Architecture: From Messy CSVs to Clean Database

Data Pipeline Architecture: From Messy CSVs to Clean Database

Comments
5 min read
Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

1
Comments
7 min read
Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

1
Comments
3 min read
Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

Shopify Automation: How I Managed an 80,000-Product Catalog with Python & Pandas

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.