DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Context, Not Models: What Actually Made AI BI Reliable

Context, Not Models: What Actually Made AI BI Reliable

Comments
25 min read
Building a Data Audit Workbench That Holds Up in an Assessment

Building a Data Audit Workbench That Holds Up in an Assessment

Comments
3 min read
Building a Data Audit Workbench That Holds Up in an Assessment

Building a Data Audit Workbench That Holds Up in an Assessment

Comments
3 min read
What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

Comments
42 min read
An Analytics Agent's Permissions Should Survive a Bad Prompt

An Analytics Agent's Permissions Should Survive a Bad Prompt

Comments
2 min read
Building a Data Audit Workbench That Holds Up in an Assessment

Building a Data Audit Workbench That Holds Up in an Assessment

Comments
3 min read
How to Build an Open Lakehouse on Your Laptop

How to Build an Open Lakehouse on Your Laptop

Comments
42 min read
A bad batch loaded with zero errors. One row added $4.5 million.

A bad batch loaded with zero errors. One row added $4.5 million.

Comments
5 min read
Best Snowflake Data Modeling Tools: SQLDBM, erwin, Hackolade & Vertabelo for Reverse Engineering and DDL Generation

Best Snowflake Data Modeling Tools: SQLDBM, erwin, Hackolade & Vertabelo for Reverse Engineering and DDL Generation

Comments
11 min read
Data Engineering Failures Cost Enterprises $3M a Month

Data Engineering Failures Cost Enterprises $3M a Month

Comments
8 min read
Counting a phrase across the King James Bible — and why "fear not" is not 365 times

Counting a phrase across the King James Bible — and why "fear not" is not 365 times

Comments
3 min read
The Distributed Compute Playground: Everything You Can Plug In and Tune in an Apache Spark Job

The Distributed Compute Playground: Everything You Can Plug In and Tune in an Apache Spark Job

2
Comments 1
50 min read
Why LLMs Fall for Manipulation? - Victor Amit

Why LLMs Fall for Manipulation? - Victor Amit

1
Comments 1
22 min read
Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew

Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew

1
Comments
8 min read
The decisions in my entity resolution pipeline that I still make myself

The decisions in my entity resolution pipeline that I still make myself

Comments 2
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.