Dataengineering

Taro.Matsui

Oct 13

Part 2: Snowflake's Autonomous Future

#dataengineering #ai #snowflake

8 min read

Evalyn Njagi

Oct 12

Collecting Africa’s Energy Insights:

#dataengineering #data #automation #python

3

4 min read

mahmoudabbasi

Sep 23

Real-Time Fraud Detection Using Apache Flink

#architecture #dataengineering #security #java

1 min read

kodomonocch1

Oct 12

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

#dataengineering #finops #cloud #compression

1

2 min read

Eric Kahindi

Oct 13

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

#dataengineering #containers #tutorial #docker

5 min read

Alex Merced

Sep 22

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

#dataengineering #data #opensource #learning

3 min read

Aineah Simiyu

Oct 12

Data Engineering with Docker: A Hands-On Guide to Containerization

#docker #containers #dataengineering #automation

7

2

3 min read

Andrey

Sep 9

Mastering MLflow: Managing the Full ML Lifecycle

#dataengineering #datascience #machinelearning #devops

2

9 min read

Kepha Mwandiki

Oct 1

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

#dataengineering #automation #tutorial #sql

3

1

10 min read

Eden Wetende

Oct 11

Understanding the Basics of Linux Operating System

#linux #dataengineering #basic

1 min read

Eric Kahindi

Sep 8

Why you need to learn Apache Airflow - right now

#dataengineering #airflow #python

3 min read

Gurudev Prasad Teketi

Oct 10

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

#dataengineering #analytics #architecture #aws

1

8 min read

Walter Ndung'u

Sep 8

Apache Kafka Deep Dive: Concepts, Applications, and Production

#kafka #eventdriven #zookeeper #dataengineering

4 min read

Oliver Samuel

Sep 29

Automating NASA’s Astronomy Picture of the Day with Airflow

#postgres #dataengineering #tutorial #architecture

6 min read

Dev Cookies

Oct 7

Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT

#architecture #dataengineering #systemdesign

2

11 min read

Danica Fine

Oct 8

A Dive into Apache Iceberg™'s Metadata

#dataengineering #iceberg #database #architecture

4 min read

Oliver Samuel

Oct 7

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

#dataengineering #analytics #architecture #python

7

5 min read

Alex Merced

Sep 17

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

#dataengineering #analytics #architecture #ai

1

3 min read

Vinicius Fagundes

Oct 6

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

#datascience #dataengineering #ai

1

4 min read

Sunkanmi Otitolaye

Oct 6

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

#dataengineering #webscraping #python #webdev

2

1

3 min read

Rethan Kumar cv

Oct 7

📊 Understanding 6 Common Data Formats in Data Analytics

#dataengineering #analytics #datascience #database

4 min read

John Kioko

Oct 6

Introduction to Apache Kafka for Beginners

#kafka #dataengineering #tutorial #beginners

1

5 min read

Kemboijebby

Sep 25

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

#dataengineering #programming #ai

1

4 min read

Alex Merced

Sep 2

Apache Iceberg Dev List Digest August 25-29

#database #datascience #dataengineering

5 min read

Andrey

Sep 2

The Blueprint of a Data Team: Roles, Responsibilities, and Specializations

#datamanagement #dataengineering #bigdata #datagovernance

2

10 min read

DEV Community

# dataengineering

Part 2: Snowflake's Autonomous Future

Collecting Africa’s Energy Insights:

Real-Time Fraud Detection Using Apache Flink

Making JSON Compression Searchable — SEE (Schema-Aware Encoding)

Containerization for Data Engineering: A Practical Guide with Docker and Docker Compose

Apache Iceberg Dev List Digest (Sept 15–19, 2025)

Data Engineering with Docker: A Hands-On Guide to Containerization

Mastering MLflow: Managing the Full ML Lifecycle

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks

Understanding the Basics of Linux Operating System

Why you need to learn Apache Airflow - right now

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

Apache Kafka Deep Dive: Concepts, Applications, and Production

Automating NASA’s Astronomy Picture of the Day with Airflow

Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT

A Dive into Apache Iceberg™'s Metadata

Building an Automated YouTube Analytics Dashboard with Airflow, PySpark, MinIO, PostgreSQL & Grafana

Composable Analytics with Agents: Leveraging Virtual Datasets and the Semantic Layer

When to Choose Scala Over Python for Apache Spark: A Performance-Driven Analysis

⚽ The Data XI: Building a Modern Football Data Platform — Chapter 1: Taming the Data Beast

📊 Understanding 6 Common Data Formats in Data Analytics

Introduction to Apache Kafka for Beginners

Apache Kafka — Deep Dive: Core Concepts, Data-Engineering Applications, and Real-World Production Practices

Apache Iceberg Dev List Digest August 25-29

The Blueprint of a Data Team: Roles, Responsibilities, and Specializations