DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One
xbill profile

One Iceberg MCP Server, Seven Catalogs: What It Takes to Reach Each One

#mcp #iceberg #python #dataengineering
Comments 2
7 min read
Building a Data Audit Workbench That Holds Up in an Assessment
maref profile

Building a Data Audit Workbench That Holds Up in an Assessment

#compliance #dataengineering #audit
Comments 1
3 min read
How to Build an Open Lakehouse on Your Laptop
lisancao profile
lnc

How to Build an Open Lakehouse on Your Laptop

#opensource #dataengineering #architecture #infrastructure
Comments
42 min read
Your ERP says the job was profitable. Your machines disagree.
trcollinson profile

Your ERP says the job was profitable. Your machines disagree.

#aws #manufacturing #dataengineering #athena
Comments 1
16 min read
Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows
tigerdata_dev profile

Time-Series Cardinality: Why One More Indexed Column Costs More Than a Million More Rows

#timeseriesdata #postgres #dataengineering
Comments
13 min read
The Crash That Never Happened: Cleaning Price Data Before You Trust It
jaroslav_marda_9f25d4d9c profile

The Crash That Never Happened: Cleaning Price Data Before You Trust It

#python #datascience #finance #dataengineering
1
Comments 9
5 min read
An Analytics Agent's Permissions Should Survive a Bad Prompt
lingikaushikreddy profile

An Analytics Agent's Permissions Should Survive a Bad Prompt

#ai #security #database #dataengineering
Comments
2 min read
Building a Quote Monitoring Pipeline for Insurance Pricing
anakin_writers profile

Building a Quote Monitoring Pipeline for Insurance Pricing

#python #dataengineering #webscraping #analytics
Comments
4 min read
The decisions in my entity resolution pipeline that I still make myself
hannune profile

The decisions in my entity resolution pipeline that I still make myself

#entityresolution #dataengineering #python #machinelearning
1
Comments 2
2 min read
Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew
firfircelik profile

Two PySpark contracts Staff DEs learn on a bad Tuesday: foreachBatch restarts and applyInPandas skew

#databricks #pyspark #python #dataengineering
2
Comments 1
8 min read
What Should a Real Data Engineer Assessment Actually Test?
bobby_ray_581732c715283b2 profile

What Should a Real Data Engineer Assessment Actually Test?

#anzibloom #dataengineering #career #interviewing
Comments
3 min read
Graph RAG: where it actually breaks
hannune profile

Graph RAG: where it actually breaks

#graphrag #neo4j #dataengineering #entityresolution
2
Comments 7
3 min read
Thin-Film Measurement Data: What to Check Before Building a Dashboard
chesky0418 profile
ches

Thin-Film Measurement Data: What to Check Before Building a Dashboard

#python #iot #dataengineering #tutorial
Comments 1
5 min read
Stop Re-Receiving the Advice You Already Rejected
raghavsharma_ profile

Stop Re-Receiving the Advice You Already Rejected

#ai #dataengineering #productivity #learning
1
Comments
4 min read
Data Engineers Now Out-Earn Data Scientists. AI Engineers Beat Both.
datadriven profile

Data Engineers Now Out-Earn Data Scientists. AI Engineers Beat Both.

#dataengineering #career #interview #beginners
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.