DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
A Fair Coin Isn't Enough: When a Perfectly Randomized Experiment Is Impossible to Analyze
hexisteme profile
John

A Fair Coin Isn't Enough: When a Perfectly Randomized Experiment Is Impossible to Analyze

#analytics #data #dataengineering #datascience
1
Comments 2
6 min read
gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기
junhyun-dev profile

gold 숫자가 이상할 때 source_hash, quality, lineage로 원인 좁히기

#dataengineering #python #etl #learning
Comments
2 min read
How do I answer "what did my data look like last month" in Postgres?
wondadav profile

How do I answer "what did my data look like last month" in Postgres?

#ai #dataengineering #sql #temporalqueries
2
Comments 2
4 min read
Day 9 of 100 Days of ClickHouse®: Mastering Data Aggregation from GROUP BY to CUBE
kanishga_subramani_49ad73 profile

Day 9 of 100 Days of ClickHouse®: Mastering Data Aggregation from GROUP BY to CUBE

#analytics #database #dataengineering #sql
1
Comments
4 min read
The Search Engine Renaissance: How Apache Lucene and Elasticsearch Are Reclaiming the AI-Native Future
vigneshh profile

The Search Engine Renaissance: How Apache Lucene and Elasticsearch Are Reclaiming the AI-Native Future

#dataengineering #lucene #elasticsearch #serverless
1
Comments
8 min read
bronze, silver, and gold standard data vault 2.0
shrouwoods profile

bronze, silver, and gold standard data vault 2.0

#datavault #dataengineering #modeling #architecture
1
Comments
8 min read
If the warehouse already has the data, why are we copying it elsewhere?
gazerro profile

If the warehouse already has the data, why are we copying it elsewhere?

#architecture #data #dataengineering #systemdesign
Comments
5 min read
The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse
alexmercedcoder profile

The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse

#news #database #dataengineering #opensource
Comments 1
22 min read
The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter
alexmercedcoder profile

The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter

#news #database #dataengineering #opensource
Comments 1
22 min read
Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data
alexmercedcoder profile

Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data

#architecture #database #dataengineering #performance
Comments 1
22 min read
What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders
labyrinthanalytics profile

What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders

#ai #machinelearning #dataengineering #llm
Comments
7 min read
The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade
alexmercedcoder profile

The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

#news #data #dataengineering #opensource
Comments
21 min read
Using Microsoft Fabric Shortcuts to Avoid Duplicate Data Copies
ravikiranpagidi profile

Using Microsoft Fabric Shortcuts to Avoid Duplicate Data Copies

#microsoftfabric #dataengineering #lakehouse #azure
Comments
7 min read
Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse
tayfun_yalcinkaya_9c29444 profile

Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse

#kafka #architecture #streaming #dataengineering
Comments
13 min read
Linux Fundamentals for Data Engineering
tony-kamande profile

Linux Fundamentals for Data Engineering

#beginners #dataengineering #linux #tutorial
4
Comments 2
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.