DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

🎯 The Challenge: Processing TBs of S3 Data Without Breaking the Bank

Comments
5 min read
Why Apache Iceberg is needed?

Why Apache Iceberg is needed?

1
Comments
6 min read
Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Comments
5 min read
Automating NASA’s Astronomy Picture of the Day with Airflow

Automating NASA’s Astronomy Picture of the Day with Airflow

Comments
6 min read
10 Best Platforms to Learn Data Analytics in 2026

10 Best Platforms to Learn Data Analytics in 2026

4
Comments 1
4 min read
📘 Foundation Phase Completed - Starting Phase 2 of My Journey

📘 Foundation Phase Completed - Starting Phase 2 of My Journey

Comments
3 min read
Streams de Dados: Processamento de Informações em Tempo Real

Streams de Dados: Processamento de Informações em Tempo Real

Comments
3 min read
Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound

Paralelismo em Python para Engenharia de Dados: O Segredo das Tarefas I/O-Bound

Comments 1
6 min read
Skip the Database: Building Analytics Dashboards Directly from S3 Files

Skip the Database: Building Analytics Dashboards Directly from S3 Files

17
Comments 3
9 min read
From smog to streams: how data engineering helps us breathe easier.

From smog to streams: how data engineering helps us breathe easier.

1
Comments 1
4 min read
Apache Iceberg dev list digest (Sept 8–12, 2025)

Apache Iceberg dev list digest (Sept 8–12, 2025)

1
Comments
5 min read
How to Stream OLTP Data to MotherDuck in Real Time with Estuary

How to Stream OLTP Data to MotherDuck in Real Time with Estuary

1
Comments
7 min read
The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

The Ultimate Guide to Open Table Formats: Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

3
Comments
16 min read
How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

How to Pass the AWS Certified Data Engineer – Associate (DEA-C01) Exam2025

3
Comments 4
5 min read
Interesting links - August 2025

Interesting links - August 2025

Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.