DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Apache Data Lakehouse Weekly: May 7–13, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: May 7–13, 2026

#news #data #dataengineering #opensource
Comments
17 min read
Entity Resolution at Scale: Matching Products Across Amazon, Reddit, and RTINGS
danie_rozin profile

Entity Resolution at Scale: Matching Products Across Amazon, Reddit, and RTINGS

#ai #webdev #dataengineering #tutorial
Comments
4 min read
Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026
datastackx profile

Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026

#dataengineering #python #airflow #dagster
Comments
6 min read
Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform
nerdbossstm profile

Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform

#dataengineering #apachespark #kafka #deltalake
3
Comments
8 min read
Bölüm 1 - Kafka ile Event Driven Architecture (EDA): Event ve Channel Tasarımını Doğru Yapmak
tayfun_yalcinkaya_9c29444 profile

Bölüm 1 - Kafka ile Event Driven Architecture (EDA): Event ve Channel Tasarımını Doğru Yapmak

#kafka #streaming #dataengineering #turkish
Comments
10 min read
Part 1 - Event Driven Architecture (EDA) with Kafka: Designing Events and Channels the Right Way
tayfun_yalcinkaya_9c29444 profile

Part 1 - Event Driven Architecture (EDA) with Kafka: Designing Events and Channels the Right Way

#kafka #architecture #streaming #dataengineering
Comments
9 min read
PostgreSQL Foreign Data Wrappers: Cross-Database Queries Explained
philip_mcclarence_2ef9475 profile

PostgreSQL Foreign Data Wrappers: Cross-Database Queries Explained

#database #dataengineering #postgres #sql
Comments
4 min read
Engineering the Sentinel: Architecting a 10M-Record Fraud Detection System
dattasable profile

Engineering the Sentinel: Architecting a 10M-Record Fraud Detection System

#dataengineering #fintech #architecture #security
Comments
1 min read
ETL vs ELT: Two Paradigms, One Goal
edmund_eryuba profile

ETL vs ELT: Two Paradigms, One Goal

#dataengineering #datascience #database #cicd
Comments
5 min read
Dev Perspective: Overcoming Dirty K-Line Data in Stock Backtesting Pipelines
kaihang_ho_2ad23569cdb965 profile

Dev Perspective: Overcoming Dirty K-Line Data in Stock Backtesting Pipelines

#data #dataengineering #python #tutorial
1
Comments
3 min read
Why PostgreSQL and ClickHouse Work So Well Together
mohhddhassan profile

Why PostgreSQL and ClickHouse Work So Well Together

#dataengineering #postgres #clickhouse #systemarchitecture
3
Comments 9
3 min read
Building Market Data Pipelines Without REST Boilerplate
infoway_api profile

Building Market Data Pipelines Without REST Boilerplate

#api #architecture #backend #dataengineering
1
Comments 1
4 min read
From Tables to Tides: Navigating Databases, Warehouses, Marts, Lakes, and the Lakehouse Revolution
lawrence_murithi profile

From Tables to Tides: Navigating Databases, Warehouses, Marts, Lakes, and the Lakehouse Revolution

#datawarehousing #luxdev #dataengineering #database
1
Comments
7 min read
Junior Data Engineers Are Getting Wiped Out. Seniors Are Thriving.
datadriven profile

Junior Data Engineers Are Getting Wiped Out. Seniors Are Thriving.

#dataengineering #career #beginners #python
Comments
7 min read
You Didn't Escape Airflow's Complexity — You Just Distributed It
andrew_tan_layline profile

You Didn't Escape Airflow's Complexity — You Just Distributed It

#architecture #automation #dataengineering #systemdesign
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.