Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
etl
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Understanding ETL: A Chaotic Introduction
Abdi Omari
Abdi Omari
Abdi Omari
Follow
Jun 25
Understanding ETL: A Chaotic Introduction
#
etl
#
python
#
api
Comments
Add Comment
4 min read
schema drift를 fail이 아니라 warn으로 둔 이유
박준현
박준현
박준현
Follow
Jul 12
schema drift를 fail이 아니라 warn으로 둔 이유
#
dataengineering
#
python
#
etl
#
learning
Comments
Add Comment
2 min read
skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기
박준현
박준현
박준현
Follow
Jul 12
skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기
#
dataengineering
#
python
#
etl
#
learning
Comments
Add Comment
3 min read
wide CSV 여러 개를 EAV로 모아 gold mart 만들기
박준현
박준현
박준현
Follow
Jul 12
wide CSV 여러 개를 EAV로 모아 gold mart 만들기
#
dataengineering
#
python
#
etl
#
learning
Comments
Add Comment
2 min read
source_hash로 같은 입력 재처리를 안전하게 skip하기
박준현
박준현
박준현
Follow
Jul 12
source_hash로 같은 입력 재처리를 안전하게 skip하기
#
dataengineering
#
python
#
etl
#
learning
Comments
Add Comment
1 min read
AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran
Storm Son
Storm Son
Storm Son
Follow
Jun 17
AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran
#
devtools
#
datapipelines
#
etl
#
ai
Comments
Add Comment
6 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker
Tanmay
Tanmay
Tanmay
Follow
Jun 13
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker
#
dataengineering
#
googlecloud
#
etl
#
sql
Comments
Add Comment
2 min read
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't
Jaldeep Patel
Jaldeep Patel
Jaldeep Patel
Follow
Jun 13
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't
#
dataengineering
#
etl
#
sqlserver
#
dataarchitecture
Comments
Add Comment
2 min read
From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase
Bob Oner
Bob Oner
Bob Oner
Follow
Jun 11
From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase
#
python
#
etl
#
postgres
#
docker
1
reaction
Comments
Add Comment
9 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit
Firat Celik
Firat Celik
Firat Celik
Follow
Jun 9
# go-intake: Go-Native Streaming Data Ingestion Toolkit
#
etl
#
dataengineering
#
go
#
opensource
Comments
Add Comment
3 min read
From Data Quality Checks to Analytics-Ready Parquet with Python
Bob Oner
Bob Oner
Bob Oner
Follow
Jun 9
From Data Quality Checks to Analytics-Ready Parquet with Python
#
python
#
etl
#
dataengineering
#
docker
1
reaction
Comments
Add Comment
8 min read
Extract data from Databases into DuckLake
Fritz Larco
Fritz Larco
Fritz Larco
Follow
Jun 8
Extract data from Databases into DuckLake
#
duckdb
#
ducklake
#
dataengineering
#
etl
Comments
Add Comment
4 min read
ETL Pipeline: Fetching Real-Time News Data with Python and Postgres
Gathuru_M
Gathuru_M
Gathuru_M
Follow
Jun 7
ETL Pipeline: Fetching Real-Time News Data with Python and Postgres
#
dataengineering
#
api
#
etl
#
beginners
1
reaction
Comments
Add Comment
4 min read
How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises
Tanmay
Tanmay
Tanmay
Follow
Jun 6
How I Broke Down My ETL Pipeline Project Into Smaller Engineering Exercises
#
dataengineering
#
database
#
etl
#
sql
Comments
Add Comment
2 min read
gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기
박준현
박준현
박준현
Follow
Jul 10
gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기
#
dataengineering
#
python
#
etl
#
learning
Comments
Add Comment
2 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account