DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
NoSQL Fighters Arena: The Battle of Data Titans

NoSQL Fighters Arena: The Battle of Data Titans

Comments
3 min read
TDengine to MySQL in Real Time: A Complete Integration Guide

TDengine to MySQL in Real Time: A Complete Integration Guide

1
Comments
4 min read
Kafka Consumers Explained: Pull, Offsets, and Parallelism

Kafka Consumers Explained: Pull, Offsets, and Parallelism

1
Comments
4 min read
Big Data Processing - Case Study 1 (Spark) 01:32

Big Data Processing - Case Study 1 (Spark)

Comments
1 min read
Why Pi-Shaped Teams Matter in This AI Era

Why Pi-Shaped Teams Matter in This AI Era

Comments
5 min read
How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

2
Comments
6 min read
The 5 Most Common ETL Patterns — When and Why to Use Them

The 5 Most Common ETL Patterns — When and Why to Use Them

Comments
3 min read
Data architecture stack

Data architecture stack

Comments
1 min read
Study Notes 6.11-12: Kafka ksqlDB, Connect & Schema Registry

Study Notes 6.11-12: Kafka ksqlDB, Connect & Schema Registry

Comments
7 min read
Study Notes 6.15: Kafka & Flink Streaming

Study Notes 6.15: Kafka & Flink Streaming

Comments
5 min read
Study Notes 6.7-10: Kafka Stream Basics, JOIN, Testing & Windowing

Study Notes 6.7-10: Kafka Stream Basics, JOIN, Testing & Windowing

Comments
13 min read
Study Notes 6.3-4: What is Kafka & Confluent Cloud

Study Notes 6.3-4: What is Kafka & Confluent Cloud

Comments
6 min read
Study Notes 6.1-2: Introduction to Stream Processing

Study Notes 6.1-2: Introduction to Stream Processing

Comments
3 min read
Real-Time Data Processing with PyFlink and Redpanda

Real-Time Data Processing with PyFlink and Redpanda

Comments
1 min read
From DWH to Data Mesh: How Data Architectures Evolved to Meet Business Demands

From DWH to Data Mesh: How Data Architectures Evolved to Meet Business Demands

Comments
1 min read
🚀 SQL Query Optimization in 2025: 7 Techniques for Faster Performance

🚀 SQL Query Optimization in 2025: 7 Techniques for Faster Performance

Comments
1 min read
Star Schema: The Data Warehouse Hack So Simple, Experts Hate It

Star Schema: The Data Warehouse Hack So Simple, Experts Hate It

Comments
2 min read
Unlocking 10x Revenue Growth with Data Analytics in Gaming

Unlocking 10x Revenue Growth with Data Analytics in Gaming

1
Comments
16 min read
Data Analytics Tools: A Comprehensive Guide to Choosing the Right Solution

Data Analytics Tools: A Comprehensive Guide to Choosing the Right Solution

1
Comments
4 min read
The Future of Data Engineering: Leveraging Cloud Technology for Scalable Solutions

The Future of Data Engineering: Leveraging Cloud Technology for Scalable Solutions

Comments
2 min read
🛠️ Copying and Moving Data Between Tables in ClickHouse (with Different Engines)

🛠️ Copying and Moving Data Between Tables in ClickHouse (with Different Engines)

7
Comments
2 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

1
Comments 2
10 min read
A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra

A Step-by-Step Guide to Streaming Live Weather Data Using Apache Kafka and Apache Cassandra

6
Comments 2
4 min read
Databricks Asset Bundle: A Template to Make Life Easier

Databricks Asset Bundle: A Template to Make Life Easier

1
Comments
6 min read
"Data Warehouses: The Silent Powerhouse Your Boss Doesn’t Understand"

"Data Warehouses: The Silent Powerhouse Your Boss Doesn’t Understand"

Comments
2 min read
loading...