DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Fix Slow Query: A Developer's Guide to Data Warehouse Performance
zenithai profile

Fix Slow Query: A Developer's Guide to Data Warehouse Performance

#dataengineering #duckdb #performance #data
5
Comments
14 min read
🧠 Real-Time Comment Ranking with Kafka and Sentiment Analysis
dantethebrave profile

🧠 Real-Time Comment Ranking with Kafka and Sentiment Analysis

#dataengineering #architecture #ai #machinelearning
Comments
3 min read
How I Used AWS Glue and Athena for Serverless Data Analytics
nidhi_0105 profile

How I Used AWS Glue and Athena for Serverless Data Analytics

#dataengineering #analytics #serverless #aws
Comments
2 min read
How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month
goodiegoody profile

How I Streamed Live Binance L2 Order Book Data on AWS for ~$10/Month

#aws #fintech #infrastructure #dataengineering
2
Comments 5
14 min read
Auto-Detecting CSV Schemas for Lightning-Fast ClickHouse Ingestion with Parquet
darkedges profile

Auto-Detecting CSV Schemas for Lightning-Fast ClickHouse Ingestion with Parquet

#node #dataengineering #database #automation
1
Comments
5 min read
# Data Ingestion & Vector Store #llmszoomcamp
abdelrahman_adnan profile

# Data Ingestion & Vector Store #llmszoomcamp

#python #dataengineering #rag #llm
Comments
2 min read
Database Fundamentals
gilbert_korir profile

Database Fundamentals

#postgressql #sql #nosql #dataengineering
Comments
3 min read
Distributed Media Inferencing with Kafka
jayash_tripathy_921c22d37 profile

Distributed Media Inferencing with Kafka

#ai #dataengineering #architecture #python
Comments 1
5 min read
Building Custom MCP Servers with Python: A Data Engineer's Guide 🛠️
fagundesv profile

Building Custom MCP Servers with Python: A Data Engineer's Guide 🛠️

#dataengineering #software #python #ai
Comments 1
5 min read
🧑‍💻 Apache Kafka CLI – Detailed Course
nk_sk_6f24fdd730188b284bf profile

🧑‍💻 Apache Kafka CLI – Detailed Course

#cli #dataengineering #tutorial
Comments
2 min read
🌍 Automating Africa’s Energy Data Collection Using Python, Playwright(+Why Playwright ?), and MongoDB (2000–2024)
john_analytics profile

🌍 Automating Africa’s Energy Data Collection Using Python, Playwright(+Why Playwright ?), and MongoDB (2000–2024)

#dataengineering #mongodb #python #automation
5
Comments
5 min read
The State of Apache Iceberg, Polaris, and Arrow: October–November 2025
alexmercedcoder profile

The State of Apache Iceberg, Polaris, and Arrow: October–November 2025

#news #dataengineering #database #opensource
2
Comments
7 min read
From 8 Minutes to 40 Seconds: Solving Data Pipeline Deployment Bottlenecks with Git Sparse Checkout
hantedyou_0106 profile

From 8 Minutes to 40 Seconds: Solving Data Pipeline Deployment Bottlenecks with Git Sparse Checkout

#git #devops #dataengineering #azure
Comments
5 min read
Core Concepts of Kafka
farhan_khan_41ec7ff11ac1d profile

Core Concepts of Kafka

#architecture #beginners #dataengineering
Comments
8 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.
elisha_lukalia_f382f081a0 profile

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

#dataengineering #automation #tutorial #sql
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.