DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Athena/Iceberg Tends to Make Code the Spec

Why Athena/Iceberg Tends to Make Code the Spec

1
Comments
9 min read
Your AI Bill Is a Routing Problem, Not a Model Problem

Your AI Bill Is a Routing Problem, Not a Model Problem

Comments
3 min read
Maternity HL7-to-FHIR Pipeline: Bridging Legacy Hospital Messages to Modern Healthcare APIs

Maternity HL7-to-FHIR Pipeline: Bridging Legacy Hospital Messages to Modern Healthcare APIs

Comments
12 min read
Data Is the Real Model: Governance, Lineage, and Provenance

Data Is the Real Model: Governance, Lineage, and Provenance

Comments 4
5 min read
Creating a QuantifiedSelf Dashboard - Part 1

Creating a QuantifiedSelf Dashboard - Part 1

Comments
8 min read
Common Mistakes New Data Engineers Make (And How to Avoid Them)

Common Mistakes New Data Engineers Make (And How to Avoid Them)

Comments
3 min read
Pytest pt3 - Writing Cleaner Tests with Parametrization and Temporary Files

Pytest pt3 - Writing Cleaner Tests with Parametrization and Temporary Files

Comments
4 min read
Building a right-click 'query this file' workflow in VS Code with DuckDB

Building a right-click 'query this file' workflow in VS Code with DuckDB

Comments
2 min read
The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production

The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production

Comments
6 min read
Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.

Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.

1
Comments
4 min read
Python batch를 Spark로 옮겼더니 802.675가 달라졌다

Python batch를 Spark로 옮겼더니 802.675가 달라졌다

Comments
3 min read
A CSV quality report should not echo the data it rejects

A CSV quality report should not echo the data it rejects

Comments 1
2 min read
Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

Comments
19 min read
Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory

Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory

2
Comments 2
4 min read
Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Why Fraud Rings Are a Graph Problem (And Your SQL Database Can't See Them)

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.