DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Understanding the Basics of Linux Operating System

Understanding the Basics of Linux Operating System

Comments
1 min read
Why you need to learn Apache Airflow - right now

Why you need to learn Apache Airflow - right now

Comments
3 min read
Lessons Learned from Building Product Dashboards That Drive Real Decisions

Lessons Learned from Building Product Dashboards That Drive Real Decisions

19
Comments 1
4 min read
Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

1
Comments
8 min read
Apache Kafka Deep Dive: Concepts, Applications, and Production

Apache Kafka Deep Dive: Concepts, Applications, and Production

Comments
4 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

1
Comments
4 min read
A Dive into Apache Iceberg™'s Metadata

A Dive into Apache Iceberg™'s Metadata

Comments
4 min read
Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

7
Comments
5 min read
Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

1
Comments
3 min read
When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

1
Comments
4 min read
⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

2
Comments 1
3 min read
📊 Understanding 6 Common Data Formats in Data Analytics

📊 Understanding 6 Common Data Formats in Data Analytics

Comments
4 min read
Introduction to Apache Kafka for Beginners

Introduction to Apache Kafka for Beginners

1
Comments
5 min read
Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

1
Comments
4 min read
Apache Iceberg Dev List Digest August 25-29

Apache Iceberg Dev List Digest August 25-29

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.