DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Optimizing Continuous Aggregate Performance for Large Datasets

Optimizing Continuous Aggregate Performance for Large Datasets

Comments
4 min read
Data Engineer's Guide to Linux: Why It Is Your Secret Weapon

Data Engineer's Guide to Linux: Why It Is Your Secret Weapon

3
Comments
5 min read
How to Build a Real-Time DynamoDB to S3 Analytics Pipeline with Apache Iceberg

How to Build a Real-Time DynamoDB to S3 Analytics Pipeline with Apache Iceberg

2
Comments
8 min read
S&OP Engineering II: Demand Planning from Guessing to Probability

S&OP Engineering II: Demand Planning from Guessing to Probability

3
Comments
4 min read
dcvpg — Data Contract Validator & Pipeline Guardian 🛡️

dcvpg — Data Contract Validator & Pipeline Guardian 🛡️

Comments 1
1 min read
Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

Mastering SQL Joins and Window Functions: A Practical Guide with Example Data

3
Comments
4 min read
Why Travel Technology is the Next Frontier for AI Investment

Why Travel Technology is the Next Frontier for AI Investment

Comments
7 min read
Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

Building a Production-Ready Serverless App on Google Cloud (Part 1: Architecture)

14
Comments
5 min read
Data Pipeline Architecture: From Messy CSVs to Clean Database

Data Pipeline Architecture: From Messy CSVs to Clean Database

Comments
5 min read
Why NodeDB Might Be a Better Multi-Model Database

Why NodeDB Might Be a Better Multi-Model Database

Comments
5 min read
Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector

Lightweight ETL on AWS Lambda Using DuckDB and Snowflake Connector

6
Comments
6 min read
Epistemic Control Systems: Anchoring on Kafka

Epistemic Control Systems: Anchoring on Kafka

Comments
4 min read
Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

Building an Incremental Zoho Desk to BigQuery Pipeline: Lessons from the Trenches

1
Comments
7 min read
The hidden system behind Tesla autonomy

The hidden system behind Tesla autonomy

Comments
3 min read
Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

Stop Manually Entering Medical Data: How to Automate PDF Lab Reports with LayoutParser & OCR

1
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.