DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Study Note 3.2.1: BigQuery Best Practices

Study Note 3.2.1: BigQuery Best Practices

Comments
3 min read
Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Comments
3 min read
Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

Using Apache Parquet to Optimize Data Handling in a Real-Time Ad Exchange Platform

2
Comments
3 min read
Understanding Slowly Changing Dimensions (SCDs)

Understanding Slowly Changing Dimensions (SCDs)

Comments
2 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Comments
4 min read
HackerRank 'Occupations' MySQL

HackerRank 'Occupations' MySQL

6
Comments
3 min read
What is Snowflake’s Architecture? How is it Different from Traditional Databases?

What is Snowflake’s Architecture? How is it Different from Traditional Databases?

1
Comments
3 min read
Optimizing Data Pipelines for Fiix Dating App

Optimizing Data Pipelines for Fiix Dating App

2
Comments
3 min read
Serverless MapReduce for Excel: Scale Your Marketing Data with AWS

Serverless MapReduce for Excel: Scale Your Marketing Data with AWS

1
Comments
3 min read
Azure Data Factory

Azure Data Factory

1
Comments
6 min read
What kind of Data Team should I join?

What kind of Data Team should I join?

Comments
1 min read
Beyond the Code: The Non-Technical Superpowers Every Data Analyst Needs to Succeed.

Beyond the Code: The Non-Technical Superpowers Every Data Analyst Needs to Succeed.

2
Comments
2 min read
𝗗𝗮𝘁𝗮 𝗦𝗰𝗶𝗲𝗻𝘁𝗶𝘀𝘁 𝘃𝘀. 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 𝘃𝘀. 𝗗𝗮𝘁𝗮 𝗔𝗻𝗮𝗹𝘆𝘀𝘁 𝘃𝘀. 𝗠𝗟 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿

𝗗𝗮𝘁𝗮 𝗦𝗰𝗶𝗲𝗻𝘁𝗶𝘀𝘁 𝘃𝘀. 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿 𝘃𝘀. 𝗗𝗮𝘁𝗮 𝗔𝗻𝗮𝗹𝘆𝘀𝘁 𝘃𝘀. 𝗠𝗟 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿

4
Comments
1 min read
Declarative Data Pipelines: Moving from Code to Configuration

Declarative Data Pipelines: Moving from Code to Configuration

3
Comments 4
13 min read
5 Best Database GUI Clients That Have Git for Teamwork in 2025

5 Best Database GUI Clients That Have Git for Teamwork in 2025

4
Comments 1
4 min read
Study Note 2.2.5: Orchestrate dbt Models with Postgres in Kestra

Study Note 2.2.5: Orchestrate dbt Models with Postgres in Kestra

2
Comments
2 min read
Study Notes 2.2.4: Managing Scheduling and Backfills with Postgres in Kestra

Study Notes 2.2.4: Managing Scheduling and Backfills with Postgres in Kestra

Comments
2 min read
Study Note 2.2.6: ETL Pipelines in Kestra on Google Cloud Platform

Study Note 2.2.6: ETL Pipelines in Kestra on Google Cloud Platform

Comments
2 min read
Study Notes 2.2.3: Setting Up an ETL Pipeline with Kestra and Postgres

Study Notes 2.2.3: Setting Up an ETL Pipeline with Kestra and Postgres

2
Comments
2 min read
Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

Comments
2 min read
Study Notes 2.2.1: Workflow Orchestration with Kestra

Study Notes 2.2.1: Workflow Orchestration with Kestra

Comments
2 min read
Study Notes 2.2.2: Learning Kestra

Study Notes 2.2.2: Learning Kestra

Comments
2 min read
Study Notes 1.3.3: Terraform Variables

Study Notes 1.3.3: Terraform Variables

Comments
2 min read
Study Notes 1.3.2: Terraform Basics with GCP

Study Notes 1.3.2: Terraform Basics with GCP

Comments
2 min read
Study Notes 1.3.1: Terraform Primer

Study Notes 1.3.1: Terraform Primer

Comments
2 min read
loading...