DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Real-Time Weather Streaming Pipeline with Kafka, Docker & Python
damaac profile

Building a Real-Time Weather Streaming Pipeline with Kafka, Docker & Python

#luxdev #dataengineering #kafka #docker
2
Comments
4 min read
DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow
slotix profile

DuckDB, Postgres, and Parquet: when one SQL query becomes a workflow

#database #duckdb #postgres #dataengineering
Comments
4 min read
Naskah BI
ariscandra profile

Naskah BI

#analytics #data #dataengineering #webdev
Comments
3 min read
# From Metadata to Knowledge Discovery: Why I Am Not Starting With a Chatbot
amising6 profile

# From Metadata to Knowledge Discovery: Why I Am Not Starting With a Chatbot

#rag #dataengineering #ai #metadata
Comments
3 min read
A Simple Python Approach to MongoDB-to-PostgreSQL Migration
zaylee90 profile
Zaylee

A Simple Python Approach to MongoDB-to-PostgreSQL Migration

#dataengineering #mongodb #postgres #python
2
Comments 1
1 min read
Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling
james_gen_61355323ef5348a profile

Architectural Blueprints for Enterprise Sports Data Ingestion: REST, Streaming, and Predictive Modeling

#architecture #backend #dataengineering #systemdesign
Comments
5 min read
I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data
hajirufai profile

I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data

#python #dataengineering #distributedsystems #backend
1
Comments 1
5 min read
We Built a Kafka Proxy. Here's Everything It Ended Up Doing.
sderosiaux profile

We Built a Kafka Proxy. Here's Everything It Ended Up Doing.

#kafka #architecture #dataengineering #devops
Comments
4 min read
# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines
pranith_m_05c4bc7561a6ffd profile

# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

#dataengineering #mysql #dba #python
Comments
15 min read
Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)
pfabricius profile

Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)

#showdev #dataengineering #learning #opensource
1
Comments
1 min read
Vectorizing Real-Time Kafka Events
pedrop3 profile

Vectorizing Real-Time Kafka Events

#dataengineering #java #postgres #rag
Comments
4 min read
Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins
justsoftlab_x01 profile

Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins

#dataengineering #ai #mlops #datascience
1
Comments 2
5 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON
arunkatherashala profile

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

#kore #dataengineering #rust #performance
Comments
5 min read
The Data Engineer Roadmap for 2026 (in an AI-Native World)
petascalelabs profile

The Data Engineer Roadmap for 2026 (in an AI-Native World)

#dataengineering #career #roadmap #ai
Comments 1
7 min read
Dive Into Containerization, Docker & Docker Compose
edmund_eryuba profile

Dive Into Containerization, Docker & Docker Compose

#dataengineering #containers #docker #containerapps
2
Comments 1
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.