DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Data Contracts: Ending the "Someone Changed a Field Upstream" Outage

Data Contracts: Ending the "Someone Changed a Field Upstream" Outage

Comments
2 min read
Your scraper isn't broken. The site changed, and it didn't tell you.

Your scraper isn't broken. The site changed, and it didn't tell you.

Comments 1
4 min read
Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables

Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables

5
Comments 2
9 min read
dbt Semantic Layer vs Cube vs AtScale: Choosing an Enterprise Semantic Layer

dbt Semantic Layer vs Cube vs AtScale: Choosing an Enterprise Semantic Layer

2
Comments
2 min read
Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.

Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.

Comments 1
3 min read
I built a free, interactive SQL practice tool for data engineering interviews

I built a free, interactive SQL practice tool for data engineering interviews

Comments 1
1 min read
SQL Execution Order Internals: Why WHERE Fails on Aliases but ORDER BY Succeeds

SQL Execution Order Internals: Why WHERE Fails on Aliases but ORDER BY Succeeds

1
Comments 2
1 min read
ClickHouse 26.8 LTS: 57 Breaking Changes Since 26.3

ClickHouse 26.8 LTS: 57 Breaking Changes Since 26.3

3
Comments
17 min read
The pipeline passed. The data still needs proof.

The pipeline passed. The data still needs proof.

Comments 2
3 min read
Databricks Changed One Permission Rule. Grants You Forgot About Are Now Live.

Databricks Changed One Permission Rule. Grants You Forgot About Are Now Live.

Comments 3
7 min read
Consent-First AI: Build Systems You Trust

Consent-First AI: Build Systems You Trust

Comments
6 min read
Why SQL Is Still the Most Important Skill for Data Engineers

Why SQL Is Still the Most Important Skill for Data Engineers

Comments
3 min read
AI Data Lake and Lakehouse

AI Data Lake and Lakehouse

Comments
18 min read
Partitioning, clustering, and BI Engine: measuring what each one saves in BigQuery

Partitioning, clustering, and BI Engine: measuring what each one saves in BigQuery

Comments
7 min read
Writing a native Polars plugin in Rust: PII masking with no per-row Python

Writing a native Polars plugin in Rust: PII masking with no per-row Python

Comments 1
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.