DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
⏰ If You Haven’t Shifted to Data Engineering Yet… Wake Up!

⏰ If You Haven’t Shifted to Data Engineering Yet… Wake Up!

Comments
2 min read
Data Modeling: From Basics to Advanced Techniques for Business Impact

Data Modeling: From Basics to Advanced Techniques for Business Impact

2
Comments
13 min read
Building a Resilient Exception Strategy with Apache Beam and DLQ

Building a Resilient Exception Strategy with Apache Beam and DLQ

Comments
3 min read
Well-formed, Valid, Canonical, and Correct

Well-formed, Valid, Canonical, and Correct

1
Comments
4 min read
Why we use Apache Airflow for Data Engineering

Why we use Apache Airflow for Data Engineering

Comments
2 min read
Building ML Infrastructure in TypeScript - Part 1: The Vision

Building ML Infrastructure in TypeScript - Part 1: The Vision

5
Comments
3 min read
Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

4
Comments
5 min read
Building a News Sentiment Analysis Pipeline with Apache Airflow and Snowflake

Building a News Sentiment Analysis Pipeline with Apache Airflow and Snowflake

11
Comments
3 min read
SQL CASE Statements: The Order Matters!

SQL CASE Statements: The Order Matters!

Comments
2 min read
Interesting links - July 2025

Interesting links - July 2025

Comments
6 min read
Why Data Cleaning is 80% of Data Science

Why Data Cleaning is 80% of Data Science

Comments
2 min read
Data Mesh vs. Data Fabric: The Future of Data Management

Data Mesh vs. Data Fabric: The Future of Data Management

1
Comments
6 min read
AI Agents and Autonomous ETL: Making Data Work Smarter

AI Agents and Autonomous ETL: Making Data Work Smarter

1
Comments
3 min read
The @dataclass Decorator In Python

The @dataclass Decorator In Python

Comments
1 min read
Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

5
Comments
4 min read
Tableau Sales Dashboard Performance (Updated for 2025)

Tableau Sales Dashboard Performance (Updated for 2025)

1
Comments
4 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

1
Comments
6 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

2
Comments
4 min read
Big Data Fundamentals: data pipeline with python

Big Data Fundamentals: data pipeline with python

Comments
6 min read
Big Data Fundamentals: data pipeline tutorial

Big Data Fundamentals: data pipeline tutorial

Comments
6 min read
🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management

🧊 Snowflake RBAC 101 – Episode 3: Ongoing Access Management

Comments
1 min read
Big Data Fundamentals: data pipeline example

Big Data Fundamentals: data pipeline example

Comments
6 min read
Big Data Fundamentals: data pipeline

Big Data Fundamentals: data pipeline

Comments
6 min read
What Is Change Data Capture (CDC) and How It Works on Google Cloud

What Is Change Data Capture (CDC) and How It Works on Google Cloud

Comments
2 min read
💾 Parquet or Avro? CSV or JSON?

💾 Parquet or Avro? CSV or JSON?

Comments
1 min read
loading...