Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Chetan Gupta

Dec 14 '25

Why Idempotence Is So Important in Data Engineering

#architecture #dataengineering #systemdesign #etl

6 min read

Aineah Simiyu

Nov 10 '25

Reducing Consumer Lag in Apache Kafka

#kafka #dataengineering #python #eventdriven

3 min read

Mohamed Hussain S

Dec 13 '25

Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

#dataengineering #etl #clickhouse #python

3 min read

Sandeep

Dec 1 '25

🚀 Day 1: Introduction to Apache Spark

#spark #python #dataengineering #bigdata

2 min read

Alberto Cardenas

Dec 13 '25

Shine in Your Next Data Engineering Interview with Pandas

#interview #dataengineering #performance #python

10 min read

Celeste Horgan

Nov 6 '25

Writes, 3 ways: Postgres, Apache Kafka® and Apache Iceberg™

#postgres #dataengineering #learning #database

10 min read

Vinicius Fagundes

Nov 6 '25

Building Custom MCP Servers with Python: A Data Engineer's Guide 🛠️

#dataengineering #software #python #ai

5 min read

Logic Verse

Nov 6 '25

The Next Era of Databases: When Queries Write Themselves

#dataengineering #naturallanguagequery #dataanalytics #machinelearning

4 min read

Pradeep Kalluri

Dec 8 '25

Why 71,000 Data Engineers Read My Article: What I Learned About Technical Writing

#dataengineering #writing #programming #career

6 min read

Dipti Moryani

Nov 7 '25

Transforming Tableau Performance: How Optimized Data Logic Cut Dashboard Load Time by 98.9%

#analytics #dataengineering #performance #sql

8 min read

Query Filter

Nov 6 '25

rec

#tooling #dataengineering #automation #linux

2 min read

YK Sugi

Nov 10 '25

How We Cut LLM Batch Inference Time in Half with Dynamic Prefix Bucketing

#dataengineering #aiops #distributedsystems #machinelearning

13 min read

nafisah badmos

Dec 9 '25

Automating EL pipeline using Azure Functions(Python)

#dataengineering #azurefunctions #eventgrid #python

4 min read

Falguni Bhatt

Dec 10 '25

Top Open-Source Data Engineering Tools- Unravelling the Best in 2026

#dataengineering #opensource #dataengineeringtool

10 min read

David Kershaw

Nov 27 '25

Let's say you have a data lake

#dataengineering #data #csvpath #csv

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

Why Idempotence Is So Important in Data Engineering

Reducing Consumer Lag in Apache Kafka

Analyzing and Optimizing a Parquet ClickHouse Ingestion Pipeline

🚀 Day 1: Introduction to Apache Spark

Shine in Your Next Data Engineering Interview with Pandas

Writes, 3 ways: Postgres, Apache Kafka® and Apache Iceberg™

Building Custom MCP Servers with Python: A Data Engineer's Guide 🛠️

The Next Era of Databases: When Queries Write Themselves

Why 71,000 Data Engineers Read My Article: What I Learned About Technical Writing

Transforming Tableau Performance: How Optimized Data Logic Cut Dashboard Load Time by 98.9%

rec

How We Cut LLM Batch Inference Time in Half with Dynamic Prefix Bucketing

Automating EL pipeline using Azure Functions(Python)

Top Open-Source Data Engineering Tools- Unravelling the Best in 2026

Let's say you have a data lake