DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Real-Time Weather Streaming Pipeline with Kafka, Docker & Python
damaac profile

Building a Real-Time Weather Streaming Pipeline with Kafka, Docker & Python

#luxdev #dataengineering #kafka #docker
2
Comments
4 min read
Engineering the Sentinel: Architecting a 10M-Record Fraud Detection System
dattasable profile

Engineering the Sentinel: Architecting a 10M-Record Fraud Detection System

#dataengineering #fintech #architecture #security
Comments
1 min read
DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow
slotix profile

DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow

#database #duckdb #postgres #dataengineering
Comments
4 min read
Naskah BI
ariscandra profile

Naskah BI

#analytics #data #dataengineering #webdev
Comments
3 min read
What's the Best Way to Enrich Lead Data in 2026? A Technical Look at Waterfall Enrichment
nikita_st profile

What's the Best Way to Enrich Lead Data in 2026? A Technical Look at Waterfall Enrichment

#api #b2b #sales #dataengineering
Comments
7 min read
A Simple Python Approach to MongoDB-to-PostgreSQL Migration
zaylee90 profile
Zaylee

A Simple Python Approach to MongoDB-to-PostgreSQL Migration

#dataengineering #mongodb #postgres #python
2
Comments 1
1 min read
Debug Log #2 — The Off-By-One That Didn’t Crash (It Just Lied)
thompson_jovann_4fae7e88d profile

Debug Log #2 — The Off-By-One That Didn’t Crash (It Just Lied)

#invariants #dataengineering #testing #debugging
1
Comments
4 min read
You Didn't Escape Airflow's Complexity — You Just Distributed It
andrew_tan_layline profile

You Didn't Escape Airflow's Complexity — You Just Distributed It

#architecture #automation #dataengineering #systemdesign
Comments
5 min read
Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling
james_gen_61355323ef5348a profile

Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling

#architecture #backend #dataengineering #systemdesign
Comments
5 min read
I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data
hajirufai profile

I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data

#python #dataengineering #distributedsystems #backend
1
Comments 1
5 min read
# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines
pranith_m_05c4bc7561a6ffd profile

# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

#dataengineering #mysql #dba #python
Comments
15 min read
Vectorizing Real-Time Kafka Events
pedrop3 profile

Vectorizing Real-Time Kafka Events

#dataengineering #java #postgres #rag
Comments
4 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON
arunkatherashala profile

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

#kore #dataengineering #rust #performance
Comments
5 min read
Dive Into Containerization, Docker & Docker Compose
edmund_eryuba profile

Dive Into Containerization, Docker & Docker Compose

#dataengineering #containers #docker #containerapps
2
Comments 1
7 min read
Docker for Data Professionals: From Zero to Containerizing Your First Project
lawrence_murithi profile

Docker for Data Professionals: From Zero to Containerizing Your First Project

#docker #dataengineering #luxdev
Comments
11 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.