DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a School Database with PostgreSQL: My SQL Week 2 Journey

Building a School Database with PostgreSQL: My SQL Week 2 Journey

1
Comments
4 min read
SQL Execution Order Internals: Why WHERE Fails on Aliases but ORDER BY Succeeds

SQL Execution Order Internals: Why WHERE Fails on Aliases but ORDER BY Succeeds

1
Comments 2
1 min read
The pipeline passed. The data still needs proof.

The pipeline passed. The data still needs proof.

Comments 2
3 min read
Databricks Changed One Permission Rule. Grants You Forgot About Are Now Live.

Databricks Changed One Permission Rule. Grants You Forgot About Are Now Live.

Comments 3
7 min read
Consent-First AI: Build Systems You Trust

Consent-First AI: Build Systems You Trust

Comments
6 min read
Why SQL Is Still the Most Important Skill for Data Engineers

Why SQL Is Still the Most Important Skill for Data Engineers

Comments
3 min read
AI Data Lake and Lakehouse

AI Data Lake and Lakehouse

Comments
18 min read
Partitioning, clustering, and BI Engine: measuring what each one saves in BigQuery

Partitioning, clustering, and BI Engine: measuring what each one saves in BigQuery

Comments
7 min read
Writing a native Polars plugin in Rust: PII masking with no per-row Python

Writing a native Polars plugin in Rust: PII masking with no per-row Python

Comments 1
6 min read
One Copy, Two Engines: Architecting a Governed Lakehouse Across Fabric and Azure Databricks

One Copy, Two Engines: Architecting a Governed Lakehouse Across Fabric and Azure Databricks

Comments
6 min read
🔐 Storage Credentials in Databricks Unity Catalog (AWS) — The Security Backbone You Can't Ignore

🔐 Storage Credentials in Databricks Unity Catalog (AWS) — The Security Backbone You Can't Ignore

Comments
3 min read
They Gave Me a 20-Hour Take-Home. I Did It. I Got Ghosted.

They Gave Me a 20-Hour Take-Home. I Did It. I Got Ghosted.

Comments
7 min read
How Old Is My Data? The Missing OpenTelemetry Signal

How Old Is My Data? The Missing OpenTelemetry Signal

Comments
5 min read
I Thought My Virtual Environment Was Broken... It Wasn't.

I Thought My Virtual Environment Was Broken... It Wasn't.

Comments
1 min read
RAG Isn’t an AI Problem It’s a Data Pipeline Problem in Disguise

RAG Isn’t an AI Problem It’s a Data Pipeline Problem in Disguise

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.