DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Chinese DBA's Story: Sui Haifeng - Grasp the two most important five-year periods of your career

Chinese DBA's Story: Sui Haifeng - Grasp the two most important five-year periods of your career

Comments
5 min read
Kafka

Kafka

3
Comments
10 min read
A Modern Data Governance Framework for Google Cloud: Implementing Just-Enough and Just-in-Time Access

A Modern Data Governance Framework for Google Cloud: Implementing Just-Enough and Just-in-Time Access

3
Comments
8 min read
Scaling Customer Analytics: Designing ML Pipelines for Millions of Users

Scaling Customer Analytics: Designing ML Pipelines for Millions of Users

Comments
7 min read
Temperature, Tokens, and Context Windows: The Three Pillars of LLM Control

Temperature, Tokens, and Context Windows: The Three Pillars of LLM Control

6
Comments
13 min read
Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)

Apache Dev Mail Digest: Iceberg & Polaris (Nov 12–17, 2025)

Comments
4 min read
Building Intelligent, Metadata-Driven Pipelines with Azure Data Factory

Building Intelligent, Metadata-Driven Pipelines with Azure Data Factory

2
Comments
6 min read
Why Your Enterprise Data Platform Is No Longer Just for Analytics

Why Your Enterprise Data Platform Is No Longer Just for Analytics

2
Comments 1
11 min read
Realtime Data Streaming Platform: Building a Unified Monitoring Stack

Realtime Data Streaming Platform: Building a Unified Monitoring Stack

3
Comments
8 min read
Real-Time Streaming Platform with Pulsar, Flink & ClickHouse

Real-Time Streaming Platform with Pulsar, Flink & ClickHouse

1
Comments
6 min read
Why Parquet Is Everywhere - And What Makes It Actually Fast?

Why Parquet Is Everywhere - And What Makes It Actually Fast?

3
Comments
3 min read
Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

4
Comments
4 min read
Big Data Processing (Hadoop, Spark)

Big Data Processing (Hadoop, Spark)

2
Comments
5 min read
Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)

Building a clean Energy Data Pipeline for Africa( from raw CSVs to MongoDB)

Comments
1 min read
Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach

Why Your Snowflake Bill is High and How to Fix It with a Hybrid Approach

5
Comments
14 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.