DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow

DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow

Comments
4 min read
Naskah BI

Naskah BI

Comments
3 min read
# From Metadata to Knowledge Discovery: Why I Am Not Starting With a Chatbot

# From Metadata to Knowledge Discovery: Why I Am Not Starting With a Chatbot

Comments
3 min read
What's the Best Way to Enrich Lead Data in 2026? A Technical Look at Waterfall Enrichment

What's the Best Way to Enrich Lead Data in 2026? A Technical Look at Waterfall Enrichment

Comments
7 min read
A Simple Python Approach to MongoDB-to-PostgreSQL Migration

A Simple Python Approach to MongoDB-to-PostgreSQL Migration

2
Comments 1
1 min read
Debug Log #2 — The Off-By-One That Didn’t Crash (It Just Lied)

Debug Log #2 — The Off-By-One That Didn’t Crash (It Just Lied)

1
Comments
4 min read
Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling

Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling

Comments
5 min read
I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data

I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data

1
Comments 1
5 min read
We Built a Kafka Proxy. Here's Everything It Ended Up Doing.

We Built a Kafka Proxy. Here's Everything It Ended Up Doing.

Comments
4 min read
# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

Comments
15 min read
Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)

Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)

1
Comments
1 min read
Vectorizing Real-Time Kafka Events

Vectorizing Real-Time Kafka Events

Comments
4 min read
Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins

Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins

1
Comments 2
5 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

Comments
5 min read
Dive Into Containerization, Docker & Docker Compose

Dive Into Containerization, Docker & Docker Compose

2
Comments 1
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.