DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Personal Picks: Data Product News (April 30, 2025)

Personal Picks: Data Product News (April 30, 2025)

Comments
6 min read
#34 50 Advanced SQL Queries Every Developer Should Know

#34 50 Advanced SQL Queries Every Developer Should Know

2
Comments
7 min read
InsightFlow Part 9: Workflow Orchestration with Kestra

InsightFlow Part 9: Workflow Orchestration with Kestra

Comments
4 min read
InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

InsightFlow Part 8: Setting Up AWS Athena for Data Analysis in InsightFlow

Comments
3 min read
InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

InsightFlow Part 7: Data Quality Implementation & Best Practices for InsightFlow

Comments
3 min read
InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

InsightFlow Part 6: Implementing ETL Processes with AWS Glue for InsightFlow

Comments
3 min read
InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

InsightFlow Part 5: Designing the Data Model & Schema with dbt for InsightFlow

Comments
3 min read
InsightFlow Part 4: Data Exploration & Understanding the Datasets

InsightFlow Part 4: Data Exploration & Understanding the Datasets

Comments
3 min read
InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

InsightFlow Part 3: Building the Data Ingestion Layer with AWS Batch

Comments
4 min read
Weather Monitoring System Using IoT

Weather Monitoring System Using IoT

Comments
2 min read
Understanding AWS Regions and Availability Zones: A Guide for Beginners

Understanding AWS Regions and Availability Zones: A Guide for Beginners

Comments
5 min read
Big Data Processing - Case Study 3 (Hadoop) 03:02

Big Data Processing - Case Study 3 (Hadoop)

Comments
1 min read
Big Data Processing - Case Study 3 (Spark) 02:35

Big Data Processing - Case Study 3 (Spark)

Comments
1 min read
Introduction to Presto: Open Source SQL Query Engine that's changing Big Data Analytics

Introduction to Presto: Open Source SQL Query Engine that's changing Big Data Analytics

Comments
2 min read
Big Data Processing - Case Study 2 (Databricks) 01:42

Big Data Processing - Case Study 2 (Databricks)

Comments
1 min read
Big Data Processing - Case Study 2 (Hadoop) 04:26

Big Data Processing - Case Study 2 (Hadoop)

Comments
1 min read
InsightFlow Part 2: Setting Up the Cloud Infrastructure with Terraform

InsightFlow Part 2: Setting Up the Cloud Infrastructure with Terraform

Comments
3 min read
TDengine to MySQL in Real Time: A Complete Integration Guide

TDengine to MySQL in Real Time: A Complete Integration Guide

Comments
4 min read
Big Data Processing - Case Study 2 (Spark) 01:52

Big Data Processing - Case Study 2 (Spark)

Comments
1 min read
Big Data Processing - Case Study 1 (Hadoop) 02:01

Big Data Processing - Case Study 1 (Hadoop)

Comments
1 min read
Big Data Processing - Case Study 1 (Spark) 01:32

Big Data Processing - Case Study 1 (Spark)

Comments
1 min read
Kafka Consumers Explained: Pull, Offsets, and Parallelism

Kafka Consumers Explained: Pull, Offsets, and Parallelism

Comments
4 min read
The 5 Most Common ETL Patterns — When and Why to Use Them

The 5 Most Common ETL Patterns — When and Why to Use Them

Comments
3 min read
How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

How to Integrate AWS Lambda With TimescaleDB for Scalable IoT Data Pipelines

2
Comments
6 min read
Event Sourcing as a creative tool for engineers

Event Sourcing as a creative tool for engineers

1
Comments
5 min read
loading...