DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Study Notes: Data Query on S3 Bucket Using Athena

Study Notes: Data Query on S3 Bucket Using Athena

Comments
3 min read
Study Notes 3.3.1: BigQuery Machine Learning (BQML)

Study Notes 3.3.1: BigQuery Machine Learning (BQML)

Comments
4 min read
Study Note 3.3.2: BigQuery Machine Learning Model Deployment using Docker

Study Note 3.3.2: BigQuery Machine Learning Model Deployment using Docker

Comments
4 min read
Study Notes 3.2.2: BigQuery Internal Architecture

Study Notes 3.2.2: BigQuery Internal Architecture

Comments
2 min read
Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Study Notes 3.1.2: Partitioning and Clustering in BigQuery

Comments
3 min read
Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

Study Note DE Zoomcamp 3.1.1 - Data Warehouse and BigQuery

Comments
3 min read
Study Note 3.2.1: BigQuery Best Practices

Study Note 3.2.1: BigQuery Best Practices

Comments
3 min read
The Role of Data Engineering in Driving AI and Advanced Analytics

The Role of Data Engineering in Driving AI and Advanced Analytics

Comments
3 min read
Building Scalable Data Pipelines with Python – A Complete Guide

Building Scalable Data Pipelines with Python – A Complete Guide

Comments
2 min read
Implementing Real-Time Data Processing Using Apache Flink

Implementing Real-Time Data Processing Using Apache Flink

Comments
3 min read
JSON, CSV, and Parquet: Guardians of Data

JSON, CSV, and Parquet: Guardians of Data

Comments
5 min read
Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Mastering SQL for Data Engineering: Advanced Queries, Optimization, and Data Modeling Best Practices

Comments
4 min read
Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Optimizing Data Lake Storage Architectures for High-Volume, High-Velocity Data

Comments
4 min read
Azure Data Factory

Azure Data Factory

Comments
6 min read
My First Post on DEV

My First Post on DEV

Comments
1 min read
Tenant Based Filtering: Apache Superset

Tenant Based Filtering: Apache Superset

1
Comments 1
3 min read
The Future of Big Data: Key Trends Shaping 2025

The Future of Big Data: Key Trends Shaping 2025

Comments
1 min read
DataEngineering Bootcamp Module 2

DataEngineering Bootcamp Module 2

Comments
1 min read
Study Note 2.2.5: Orchestrate dbt Models with Postgres in Kestra

Study Note 2.2.5: Orchestrate dbt Models with Postgres in Kestra

Comments
2 min read
Study Notes 2.2.4: Managing Scheduling and Backfills with Postgres in Kestra

Study Notes 2.2.4: Managing Scheduling and Backfills with Postgres in Kestra

Comments
2 min read
Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

Study Notes 2.2.7: Managing Schedules and Backfills with BigQuery in Kestra

Comments
2 min read
Study Note 2.2.6: ETL Pipelines in Kestra on Google Cloud Platform

Study Note 2.2.6: ETL Pipelines in Kestra on Google Cloud Platform

Comments
2 min read
Study Notes 2.2.1: Workflow Orchestration with Kestra

Study Notes 2.2.1: Workflow Orchestration with Kestra

Comments
2 min read
Study Notes 2.2.2: Learning Kestra

Study Notes 2.2.2: Learning Kestra

Comments
2 min read
Study Notes 1.3.2: Terraform Basics with GCP

Study Notes 1.3.2: Terraform Basics with GCP

Comments
2 min read
loading...