DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How I Used AWS Glue and Athena for Serverless Data Analytics

How I Used AWS Glue and Athena for Serverless Data Analytics

2
Comments
2 min read
Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

Dockerized Spark and Kafka: YouTube Data Pipeline Implementation

Comments
7 min read
# Data Ingestion & Vector Store #llmszoomcamp

# Data Ingestion & Vector Store #llmszoomcamp

Comments
2 min read
Database Fundamentals

Database Fundamentals

Comments
3 min read
Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT

Building Modern Data Systems: Event-Driven Architecture, Messaging Queues, Batch Processing, ETL & ELT

1
Comments
11 min read
🧑‍💻 Apache Kafka CLI – Detailed Course

🧑‍💻 Apache Kafka CLI – Detailed Course

Comments
2 min read
Create a Microsoft Fabric Lakehouse

Create a Microsoft Fabric Lakehouse

5
Comments
6 min read
Core Concepts of Kafka

Core Concepts of Kafka

Comments
8 min read
From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

From Kafka to Clean Tables: Building a Confluent Snowflake Pipeline with Streams & Tasks.

Comments
9 min read
Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches

Apache Kafka: ZooKeeper vs. KRaft — A Complete Comparison of Approaches

Comments
6 min read
Introduction to Apache Airflow

Introduction to Apache Airflow

1
Comments
4 min read
Personal Picks: Data Product News (October 1, 2025)

Personal Picks: Data Product News (October 1, 2025)

Comments
7 min read
Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC

Building Real-Time Data Pipelines from PostgreSQL Using Flink CDC

Comments
5 min read
Git Integration in Microsoft Fabric

Git Integration in Microsoft Fabric

3
Comments
3 min read
YouTube Data Processing Pipeline

YouTube Data Processing Pipeline

1
Comments
4 min read
Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Get Started with Fastest SQL Query Engine - Presto C++ (Prestissimo): Beginner Friendly Setup Guide with Docker.

Comments
5 min read
10 Best Platforms to Learn Data Analytics in 2026

10 Best Platforms to Learn Data Analytics in 2026

1
Comments
4 min read
Apache Zookeeper: O coordenador de sistemas distribuídos

Apache Zookeeper: O coordenador de sistemas distribuídos

Comments
8 min read
Debezium: Capturando mudanças de dados em tempo real

Debezium: Capturando mudanças de dados em tempo real

Comments
3 min read
Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

Building a True Dual-Destination Analytics Pipeline: Real-Time Streaming with S3 Backup and Recovery

1
Comments
8 min read
Change Data Capture (CDC): Capturando mudanças em tempo real

Change Data Capture (CDC): Capturando mudanças em tempo real

Comments
4 min read
Streams de Dados: Processamento de Informações em Tempo Real

Streams de Dados: Processamento de Informações em Tempo Real

Comments
3 min read
Big Data Analytics with PySpark: A Beginner-Friendly Guide

Big Data Analytics with PySpark: A Beginner-Friendly Guide

1
Comments
4 min read
Usando Funções de Ordem Superior (Higher-Order Functions - HOFs)

Usando Funções de Ordem Superior (Higher-Order Functions - HOFs)

Comments
4 min read
Change Data Capture (CDC) in Data Engineering: Concepts, Tools, and Real-World Implementation Strategies

Change Data Capture (CDC) in Data Engineering: Concepts, Tools, and Real-World Implementation Strategies

1
Comments
5 min read
loading...