DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Linux Fundamentals for Data Engineering

Linux Fundamentals for Data Engineering

Comments
6 min read
Day 13 of #100DaysOfClickHouse: Understanding Partitions vs Sorting Keys

Day 13 of #100DaysOfClickHouse: Understanding Partitions vs Sorting Keys

1
Comments
1 min read
Cleaning messy CSVs without pandas: 3 tiny no-install scripts

Cleaning messy CSVs without pandas: 3 tiny no-install scripts

Comments
2 min read
Day 11 of #100DaysOfClickHouse: Exporting Data from ClickHouse® - Formats, Methods, and Best Practices

Day 11 of #100DaysOfClickHouse: Exporting Data from ClickHouse® - Formats, Methods, and Best Practices

1
Comments
3 min read
day 01 of learning data engineering (step1: sql joins and set operators)

day 01 of learning data engineering (step1: sql joins and set operators)

1
Comments
3 min read
Why Historical Troubleshooting Is Harder Than It Should Be

Why Historical Troubleshooting Is Harder Than It Should Be

1
Comments
1 min read
I Just Wanted dbt State Without Another Account

I Just Wanted dbt State Without Another Account

2
Comments
2 min read
The Data Ingestion Pipeline Nobody Designs Well Until Production Breaks It

The Data Ingestion Pipeline Nobody Designs Well Until Production Breaks It

Comments
5 min read
Modern Data Stack Migration — Day 1: Scaling to 8+ Companies with DRY Architecture and Chasing a $2M Discrepancy

Modern Data Stack Migration — Day 1: Scaling to 8+ Companies with DRY Architecture and Chasing a $2M Discrepancy

Comments
2 min read
I Built a Token-Bucket Rate Limiter in Pure Python and Finally Understood How APIs Protect Themselves

I Built a Token-Bucket Rate Limiter in Pure Python and Finally Understood How APIs Protect Themselves

Comments
6 min read
I built a feature store in pure Python to finally understand the point-in-time join

I built a feature store in pure Python to finally understand the point-in-time join

Comments
6 min read
I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data

I Built a Bloom Filter from Scratch in Pure Python and Finally Understood How Databases Skip Reading Data

Comments
6 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit

# go-intake: Go-Native Streaming Data Ingestion Toolkit

Comments
3 min read
QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric

QN : Ingest Data with Dataflows Gen2 in Microsoft Fabric

Comments
2 min read
From Data Quality Checks to Analytics-Ready Parquet with Python

From Data Quality Checks to Analytics-Ready Parquet with Python

1
Comments
8 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.