DEV Community

#etl

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Understanding ETL: A Chaotic Introduction

Understanding ETL: A Chaotic Introduction

Comments
4 min read
schema drift를 fail이 아니라 warn으로 둔 이유

schema drift를 fail이 아니라 warn으로 둔 이유

Comments
2 min read
skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

Comments
3 min read
wide CSV 여러 개를 EAV로 모아 gold mart 만들기

wide CSV 여러 개를 EAV로 모아 gold mart 만들기

Comments
2 min read
source_hash로 같은 입력 재처리를 안전하게 skip하기

source_hash로 같은 입력 재처리를 안전하게 skip하기

Comments
1 min read
AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

Comments
6 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Comments
2 min read
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Comments
2 min read
From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase

From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase

1
Comments
9 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit

# go-intake: Go-Native Streaming Data Ingestion Toolkit

Comments
3 min read
From Data Quality Checks to Analytics-Ready Parquet with Python

From Data Quality Checks to Analytics-Ready Parquet with Python

1
Comments
8 min read
Extract data from Databases into DuckLake

Extract data from Databases into DuckLake

Comments
4 min read
ETL Pipeline: Fetching Real-Time News Data with Python and Postgres

ETL Pipeline: Fetching Real-Time News Data with Python and Postgres

1
Comments
4 min read
How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises

How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises

Comments
2 min read
gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기

gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.