DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Kafka Consumers Explained: Pull, Offsets, and Parallelism

Kafka Consumers Explained: Pull, Offsets, and Parallelism

1
Comments
4 min read
How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

2
Comments
6 min read
The 5 Most Common ETL Patterns — When and Why to Use Them

The 5 Most Common ETL Patterns — When and Why to Use Them

Comments
3 min read
🛠️ Copying and Moving Data Between Tables in ClickHouse (with Different Engines)

🛠️ Copying and Moving Data Between Tables in ClickHouse (with Different Engines)

7
Comments
2 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

2
Comments 2
10 min read
A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra

A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra

6
Comments 3
4 min read
Databricks Asset Bundle: A Template to Make Life Easier

Databricks Asset Bundle: A Template to Make Life Easier

5
Comments
6 min read
Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025

Create, Read, Update, Delete (CRUD) | MongoDB Tutorial 2025

10
Comments
7 min read
Learn Python Basics for Data Engineering (with Mini Project)

Learn Python Basics for Data Engineering (with Mini Project)

6
Comments 2
6 min read
SQL for Beginners - A Complete Guide.

SQL for Beginners - A Complete Guide.

6
Comments
4 min read
Building an End-to-End Data Pipeline for NYC Citi Bike 2024: A DE Zoomcamp Journey

Building an End-to-End Data Pipeline for NYC Citi Bike 2024: A DE Zoomcamp Journey

4
Comments
6 min read
We're back and better than ever!

We're back and better than ever!

1
Comments
1 min read
Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

Databricks Platform: Unlocking Big Data Analytics and Machine Learning at Scale

1
Comments
4 min read
InsightFlow Part 1: Building an Integrated Retail & Economic Data Pipeline - Project Introduction

InsightFlow Part 1: Building an Integrated Retail & Economic Data Pipeline - Project Introduction

1
Comments
4 min read
Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

Building an Automated Weather Data Pipeline with Apache Kafka and Cassandra

12
Comments
10 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.