DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

Comments
2 min read
The Most Underused Prompt in Data Engineering

The Most Underused Prompt in Data Engineering

Comments
4 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing

Confident Is Not Correct: Three Signs That Claude Is Guessing

Comments
5 min read
Databricks Lakeflow Feature

Databricks Lakeflow Feature

Comments
2 min read
Testing a data pipeline against the spreadsheets it replaced

Testing a data pipeline against the spreadsheets it replaced

Comments
7 min read
Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.

Bad Retrieval Doesn't Show Up on the AI Bill. It Shows Up on the Review Queue.

Comments
3 min read
Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness

Designing a Community Skill for AWS Transform Custom: AWS Glue 5.0 Upgrade Readiness

Comments
6 min read
Entry-Level Data Engineering Is Gone. Here's the Proof.

Entry-Level Data Engineering Is Gone. Here's the Proof.

Comments
6 min read
Choose the Reporting Grain Before You Choose the Chart

Choose the Reporting Grain Before You Choose the Chart

Comments 1
3 min read
SnowLens: Free Snowflake Observability — 9 Detectors, Zero Data Egress

SnowLens: Free Snowflake Observability — 9 Detectors, Zero Data Egress

Comments
2 min read
The query succeeded. Which table state did it read?

The query succeeded. Which table state did it read?

Comments
5 min read
You Deleted BM25 the Day You Bought a Vector Database. Your Fraud Queue Noticed

You Deleted BM25 the Day You Bought a Vector Database. Your Fraud Queue Noticed

1
Comments
3 min read
Feed Your AI Agents Clean Data

Feed Your AI Agents Clean Data

Comments 4
6 min read
Apache Iceberg Query Performance: A Practical Guide

Apache Iceberg Query Performance: A Practical Guide

Comments 1
14 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.