Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Mohamed Hussain S

Apr 20

greatCircleDistance in ClickHouse: Avoiding Full Table Scans

#clickhouse #sql #dataengineering #performance

2 min read

Rose1845

Apr 9

ETL vs ELT: Which One Should You Use and Why?

#dataengineering #etl #datapipeline

4 min read

Juliana Albertyn

Mar 30

My first Python project: Excel to SQL pipeline (feedback welcome)

#python #codequality #opensource #dataengineering

1 min read

ayoabass777

Apr 18

# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt

#dataengineering #kafka #dbt #postgres

6 min read

Sandeep Bhatia

Mar 16

Snowflake Cost Optimization Starts With Workload Design, Not Auto-Suspend

#architecture #database #dataengineering #performance

5 min read

Baris Terzioglu

Mar 15

Materialization strategies: how Bruin and dbt turn SELECT queries into tables

#dataengineering #sql #dbt #datapipeline

11 min read

Baris Terzioglu

Mar 15

How Bruin turns a SELECT query into 9 different materialization strategies across 14 databases

#dataengineering #go #sql #programming

10 min read

Baris Terzioglu

Mar 15

Data quality testing: how Bruin and dbt take different paths to the same goal

#dataengineering #sql #dataquality #devops

7 min read

soy

Mar 28

SQLite, Go/Postgres, & Petabytes: Database Patterns for Builders

#database #sql #dataengineering

4 min read

Murad Aghamirzayev

Mar 15

Creating a Cross-platform Data Sandbox that makes Working with Data Easier and Faster

#dataengineering #python #datascience #sql

3 min read

DataDriven

Apr 7

Data Engineering Interviews Are Broken (Here's Proof)

#dataengineering #career #interview #python

6 min read

Budi Widhiyanto

Apr 17

Fixing 168K Failed FHIR Conversions with Parallel AI Agents and Git Worktrees

#healthinformatics #ai #dataengineering #fhir

10 min read

Anthony Gicheru

Apr 17

Data Pipelines Explained Simply (and How to Build Them with Python)

#etl #python #datapipeline #dataengineering

2 min read

Ranjan Majumdar

Mar 18

How to Build a Secure Azure Data Platform with Terraform & Data Factory (Step-by-Step)

#adf #terraform #azure #dataengineering

3 min read

Vignesh

Apr 17

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

#dataengineering #airflow #etl #programming

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

greatCircleDistance in ClickHouse: Avoiding Full Table Scans

ETL vs ELT: Which One Should You Use and Why?

My first Python project: Excel to SQL pipeline (feedback welcome)

# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt

Snowflake Cost Optimization Starts With Workload Design, Not Auto-Suspend

Materialization strategies: how Bruin and dbt turn SELECT queries into tables

How Bruin turns a SELECT query into 9 different materialization strategies across 14 databases

Data quality testing: how Bruin and dbt take different paths to the same goal

SQLite, Go/Postgres, & Petabytes: Database Patterns for Builders

Creating a Cross-platform Data Sandbox that makes Working with Data Easier and Faster

Data Engineering Interviews Are Broken (Here's Proof)

Fixing 168K Failed FHIR Conversions with Parallel AI Agents and Git Worktrees

Data Pipelines Explained Simply (and How to Build Them with Python)

How to Build a Secure Azure Data Platform with Terraform & Data Factory (Step-by-Step)

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes