DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How do I answer "what did my data look like last month" in Postgres?
wondadav profile

How do I answer "what did my data look like last month" in Postgres?

#ai #dataengineering #sql #temporalqueries
2
Comments 2
4 min read
Day 9 of 100 Days of ClickHouse®: Mastering Data Aggregation from GROUP BY to CUBE
kanishga_subramani_49ad73 profile

Day 9 of 100 Days of ClickHouse®: Mastering Data Aggregation from GROUP BY to CUBE

#analytics #database #dataengineering #sql
1
Comments
4 min read
The Search Engine Renaissance: How Apache Lucene and Elasticsearch Are Reclaiming the AI-Native Future
vigneshh profile

The Search Engine Renaissance: How Apache Lucene and Elasticsearch Are Reclaiming the AI-Native Future

#dataengineering #lucene #elasticsearch #serverless
1
Comments
8 min read
If the warehouse already has the data, why are we copying it elsewhere?
gazerro profile

If the warehouse already has the data, why are we copying it elsewhere?

#architecture #data #dataengineering #systemdesign
Comments
5 min read
bronze, silver, and gold standard data vault 2.0
shrouwoods profile

bronze, silver, and gold standard data vault 2.0

#datavault #dataengineering #modeling #architecture
1
Comments
8 min read
The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse
alexmercedcoder profile

The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse

#news #database #dataengineering #opensource
Comments 1
22 min read
Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data
alexmercedcoder profile

Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data

#architecture #database #dataengineering #performance
Comments 1
22 min read
The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter
alexmercedcoder profile

The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter

#news #database #dataengineering #opensource
Comments 1
22 min read
What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders
labyrinthanalytics profile

What Is Agentic Workflow Consulting? A Practical Guide for Data Leaders

#ai #machinelearning #dataengineering #llm
Comments
7 min read
The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade
alexmercedcoder profile

The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

#news #data #dataengineering #opensource
Comments
21 min read
Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse
tayfun_yalcinkaya_9c29444 profile

Part 2: Event Pipeline Design: The Real-Time Data Lifecycle from Kafka to Lakehouse

#kafka #architecture #streaming #dataengineering
Comments
13 min read
Linux Fundamentals for Data Engineering
tony-kamande profile

Linux Fundamentals for Data Engineering

#beginners #dataengineering #linux #tutorial
4
Comments 2
5 min read
Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü
tayfun_yalcinkaya_9c29444 profile

Bölüm 2: Event Pipeline Tasarımı: Kafka’dan Lakehouse’a Gerçek Zamanlı Veri Yaşam Döngüsü

#kafka #streaming #dataengineering #turkish
Comments
14 min read
The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere
alexmercedcoder profile

The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere

#architecture #data #dataengineering #opensource
Comments
21 min read
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
alexmercedcoder profile

The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough

#architecture #dataengineering #performance #streaming
Comments
22 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.