Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Ankit malik

Jan 25

What is Amazon Kinesis Data Streams

#aws #dataengineering #devops

4 min read

Alexander Alten

Jan 24

What Breaks When Kafka Meets Iceberg at Scale

#kafka #dataengineering #iceberg #devops

4 min read

David MARTIN

Jan 23

"Shannon Was Right, But We Can Be Smarter: How ALEC Achieves 22x Compression on IoT Data"

#iot #rust #dataengineering #shannon

3 min read

Alex Merced

Jan 23

Apache Data Lakehouse Weekly: January 15–22, 2026

#news #architecture #dataengineering #opensource

5 min read

Alex Merced

Feb 25

Batch vs. Streaming: Choose the Right Processing Model

#architecture #data #dataengineering #systemdesign

4 min read

Alex Merced

Feb 25

Data Engineering Best Practices: The Complete Checklist

#architecture #data #dataengineering #productivity

4 min read

Karen Langat

Jan 23

Introduction to Linux for Data Engineers, Including Practical Use of Vi and Nano.

#beginners #dataengineering #linux #tutorial

3 min read

Alex Merced

Feb 25

Testing Data Pipelines: What to Validate and When

#data #dataengineering #softwareengineering #testing

4 min read

Harris Bashir

Feb 5

From AI Visibility to AI Governance: Building a Local-First LLM Cost & Risk Optimizer

#ai #dataengineering #opensource #governance

4 min read

Abdelrahman Adnan

Jan 27

Data Engineering ZoomCamp Module 1 Notes Part 1

#beginners #dataengineering #docker #tutorial

3 min read

J M

Jan 22

Streaming Crypto Changes: A Practical Guide to Real-Time Data Pipelines with Debezium CDC

#dataengineering #data #docker

3 min read

Siyana Hristova

Feb 25

Fuzzy-match millions of rows in Databricks (2026)

#datascience #dataengineering #databricks #bigdata

5 min read

Adeloop

Feb 25

AI Agents in Data Analytics: How Adeloop Bridges Autonomous Intelligence and Users

#ai #dataengineering #architecture #agents

2 min read

Judy

Jan 22

Lakehouse? More Like a Lake + Warehouse Parking Lot

#architecture #data #database #dataengineering

10 min read

Naanhe Gujral

Jan 22

Why AI Models Fail in Production — Even When Accuracy Looks High

#ai #machinelearning #devops #dataengineering

1 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

What is Amazon Kinesis Data Streams

What Breaks When Kafka Meets Iceberg at Scale

"Shannon Was Right, But We Can Be Smarter: How ALEC Achieves 22x Compression on IoT Data"

Apache Data Lakehouse Weekly: January 15–22, 2026

Batch vs. Streaming: Choose the Right Processing Model

Data Engineering Best Practices: The Complete Checklist

Introduction to Linux for Data Engineers, Including Practical Use of Vi and Nano.

Testing Data Pipelines: What to Validate and When

From AI Visibility to AI Governance: Building a Local-First LLM Cost & Risk Optimizer

Data Engineering ZoomCamp Module 1 Notes Part 1

Streaming Crypto Changes: A Practical Guide to Real-Time Data Pipelines with Debezium CDC

Fuzzy-match millions of rows in Databricks (2026)

AI Agents in Data Analytics: How Adeloop Bridges Autonomous Intelligence and Users

Lakehouse? More Like a Lake + Warehouse Parking Lot

Why AI Models Fail in Production — Even When Accuracy Looks High