DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Building a Data Audit Workbench That Holds Up in an Assessment

Building a Data Audit Workbench That Holds Up in an Assessment

Comments 1
3 min read
How to Build an Open Lakehouse on Your Laptop

How to Build an Open Lakehouse on Your Laptop

Comments
42 min read
Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows

Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows

Comments
13 min read
The Crash That Never Happened: Cleaning Price Data Before You Trust It

The Crash That Never Happened: Cleaning Price Data Before You Trust It

1
Comments 9
5 min read
What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

1
Comments
42 min read
An Analytics Agent's Permissions Should Survive a Bad Prompt

An Analytics Agent's Permissions Should Survive a Bad Prompt

Comments
2 min read
Building a Quote Monitoring Pipeline for Insurance Pricing

Building a Quote Monitoring Pipeline for Insurance Pricing

Comments
4 min read
The decisions in my entity resolution pipeline that I still make myself

The decisions in my entity resolution pipeline that I still make myself

1
Comments 2
2 min read
Why LLMs Fall for Manipulation? - Victor Amit

Why LLMs Fall for Manipulation? - Victor Amit

1
Comments 1
22 min read
Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew

Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew

2
Comments 1
8 min read
What Should a Real Data Engineer Assessment Actually Test?

What Should a Real Data Engineer Assessment Actually Test?

Comments
3 min read
Graph RAG: where it actually breaks

Graph RAG: where it actually breaks

2
Comments 7
3 min read
Thin-Film Measurement Data: What to Check Before Building a Dashboard

Thin-Film Measurement Data: What to Check Before Building a Dashboard

Comments 1
5 min read
Stop Re-Receiving the Advice You Already Rejected

Stop Re-Receiving the Advice You Already Rejected

1
Comments
4 min read
Data Engineers Now Out-Earn Data Scientists. AI Engineers Beat Both.

Data Engineers Now Out-Earn Data Scientists. AI Engineers Beat Both.

Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.