DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production
dcmerritt profile

The Day I Realized "It Ran Successfully" Means Nothing in Databricks Production

#databricks #dataengineering #spark #career
Comments
6 min read
Managed Data Lake: A Guide for 2027
jonisar profile

Managed Data Lake: A Guide for 2027

#datalake #iceberg #dataengineering #lakehouse
Comments 1
24 min read
Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.
fagundesv profile

Cloud Bills Took a Decade to Get FinOps. AI Bills Won't Get That Long.

#ai #data #dataengineering #python
1
Comments
4 min read
Python batch를 Spark로 옮겼더니 802.675가 달라졌다
junhyun-dev profile

Python batch를 Spark로 옮겼더니 802.675가 달라졌다

#dataengineering #spark #apacheiceberg #airflow
Comments
3 min read
You Review AI Code Less Carefully Than Human Code. That Is Backwards.
raghavsharma_ profile

You Review AI Code Less Carefully Than Human Code. That Is Backwards.

#ai #codequality #codereview #dataengineering
Comments 1
5 min read
A CSV quality report should not echo the data it rejects
square12_82a85fc8609fdd1f profile

A CSV quality report should not echo the data it rejects

#python #dataengineering #privacy #tooling
Comments 1
2 min read
Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory
wondadav profile

Architecting lean LLM caching: how to drop a 20M-row table without losing your AI memory

#ai #dataengineering #agents #llm
2
Comments 2
4 min read
Data Pipelines Explained: The Heart of Data Engineering 🚀
aadeshg26 profile

Data Pipelines Explained: The Heart of Data Engineering 🚀

#dataengineering #kafka #dataarchitecture #apachespark
1
Comments
3 min read
Understanding the ORC File Format: Why Is It So Fast
mohhddhassan profile

Understanding the ORC File Format: Why Is It So Fast

#dataengineering #bigdata #database #python
3
Comments
8 min read
Model an Evidence Chain, Not a Bag of Citations
kun_shen_eedb57cc827955f5 profile

Model an Evidence Chain, Not a Bag of Citations

#ai #architecture #database #dataengineering
Comments
5 min read
What I Learned Contributing to Prefect, dbt, and Airflow (An Honest OSS Retrospective)
bobby_ray_581732c715283b2 profile

What I Learned Contributing to Prefect, dbt, and Airflow (An Honest OSS Retrospective)

#dataengineering #opensource #career #airflow
Comments
4 min read
Why AI Projects Fail Even with Great Models
akonagalla28 profile

Why AI Projects Fail Even with Great Models

#ai #machinelearning #dataengineering #softwareengineering
Comments
3 min read
One Histogram, Four Engines: Fixing the Statistics Silo Problem
aiexplore369zoho profile

One Histogram, Four Engines: Fixing the Statistics Silo Problem

#rust #sql #dataengineering #iceberg
1
Comments
5 min read
Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)
vbc_risk_analytics profile

Engineering a Defensible Suspect-Condition Pipeline (Identify Validate Capture)

#architecture #dataengineering #python #softwareengineering
Comments
2 min read
World Cup Data Pipeline
banh profile

World Cup Data Pipeline

#showdev #database #dataengineering #postgres
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.