DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data
hajirufai profile

I Built a Consistent Hashing Ring in Pure Python and Finally Understood How Cassandra Distributes Data

#python #dataengineering #distributedsystems #backend
1
Comments 1
5 min read
We Built a Kafka Proxy. Here's Everything It Ended Up Doing.
sderosiaux profile

We Built a Kafka Proxy. Here's Everything It Ended Up Doing.

#kafka #architecture #dataengineering #devops
Comments
4 min read
# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines
pranith_m_05c4bc7561a6ffd profile

# From DBA to Data Engineer: Leveraging Database Expertise for Robust Data Pipelines

#dataengineering #mysql #dba #python
Comments
15 min read
Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)
pfabricius profile

Iceduck: A Local Data Lakehouse Stack for Learning (No Cloud Needed)

#showdev #dataengineering #learning #opensource
1
Comments
1 min read
Vectorizing Real-Time Kafka Events
pedrop3 profile

Vectorizing Real-Time Kafka Events

#dataengineering #java #postgres #rag
Comments
4 min read
Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins
justsoftlab_x01 profile

Self-Healing Data Pipelines: Where the Marketing Ends and the Engineering Begins

#dataengineering #ai #mlops #datascience
1
Comments 2
5 min read
Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON
arunkatherashala profile

Introducing KORE: 50x Faster Than Parquet, 10x Smaller Than JSON

#kore #dataengineering #rust #performance
Comments
5 min read
Dive Into Containerization, Docker & Docker Compose
edmund_eryuba profile

Dive Into Containerization, Docker & Docker Compose

#dataengineering #containers #docker #containerapps
2
Comments 1
7 min read
Docker for Data Professionals: From Zero to Containerizing Your First Project
lawrence_murithi profile

Docker for Data Professionals: From Zero to Containerizing Your First Project

#docker #dataengineering #luxdev
Comments
11 min read
The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog
spkibe profile

The Silent Bug That Exposed All Tenant Data in Databricks Unity Catalog

#databricks #datamasking #dataengineering #unitycatalog
Comments
6 min read
Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap
lee_yao_cfeb14fb9b141b8c5 profile

Debugging a Multi-Container Airflow Pipeline: Kafka Network Isolation and the YAML Indentation Trap

#dataengineering #devops #docker #networking
Comments
7 min read
Data Lake Architecture for Data Engineering Interviews
gowthampotureddi profile

Data Lake Architecture for Data Engineering Interviews

#python #sql #interview #dataengineering
Comments
44 min read
Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow
karen_langat_299784e2c330 profile

Building a Dockerized Cryptocurrency ETL Pipeline with Apache Airflow

#cryptocurrency #dataengineering #docker #postgres
1
Comments
4 min read
Python 101
renee_mumbi_w profile

Python 101

#ai #python #datascience #dataengineering
Comments
7 min read
A Beginners guide to Real-time Data Streaming with Apache Kafka
geraldm profile

A Beginners guide to Real-time Data Streaming with Apache Kafka

#beginners #kafka #datascience #dataengineering
2
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.