DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
The Time Our Pipeline Processed the Same Day’s Data 47 Times
pradeep_kaalluri profile

The Time Our Pipeline Processed the Same Day’s Data 47 Times

#dataengineering #airflow #python #programming
Comments
5 min read
Building Production-Grade Data Analytics Pipelines: A Real-World Case Study in Government Data
rosewabere profile

Building Production-Grade Data Analytics Pipelines: A Real-World Case Study in Government Data

#analytics #dataengineering #datascience #privacy
2
Comments
9 min read
Day 16: Delta Lake Explained - How Spark Finally Became Reliable for Production ETL
sandeepk27 profile

Day 16: Delta Lake Explained - How Spark Finally Became Reliable for Production ETL

#python #dataengineering #spark #bigdata
Comments
2 min read
Apache Iceberg Explained: From Data Lakes to Metadata, Snapshots, and Real-World Usage
mohhddhassan profile

Apache Iceberg Explained: From Data Lakes to Metadata, Snapshots, and Real-World Usage

#datalake #apacheiceberg #dataengineering #bigdata
2
Comments 2
4 min read
Data Engineering Uncovered: What It Is and Why It Matters
fagundesv profile

Data Engineering Uncovered: What It Is and Why It Matters

#dataengineering #beginners #data #career
3
Comments 1
3 min read
SQL - PostgreSQL: Execution Order
yurilbrok profile

SQL - PostgreSQL: Execution Order

#sql #postgres #dataengineering #database
4
Comments
5 min read
Migrate the legacy Greenplum to Apache Cloudberry with cbcopy
maya_sun_29e7bf629e5dd7b3 profile

Migrate the legacy Greenplum to Apache Cloudberry with cbcopy

#database #dataengineering #postgres #opensource
Comments
7 min read
Google's LEGO tribute 🧩
jigyasagrover profile

Google's LEGO tribute 🧩

#computerscience #dataengineering #google #systemdesign
27
Comments 8
1 min read
Day 15: Running Spark in the Cloud - Dataproc vs Databricks
sandeepk27 profile

Day 15: Running Spark in the Cloud - Dataproc vs Databricks

#python #dataengineering #spark #bigdata
Comments
2 min read
Rethinking Stream-Batch Unification: Real-Time Processing with Incremental Materialized Views in Apache Cloudberry
maya_sun_29e7bf629e5dd7b3 profile

Rethinking Stream-Batch Unification: Real-Time Processing with Incremental Materialized Views in Apache Cloudberry

#database #dataengineering #postgres
Comments
5 min read
Interesting links - December 2025
rmoff profile

Interesting links - December 2025

#data #dataengineering #kafka #flink
Comments
13 min read
Data Engineering Processes: From Raw Data to Cleaned, Processed, Analytics-Ready Data.
giridharan_devops profile

Data Engineering Processes: From Raw Data to Cleaned, Processed, Analytics-Ready Data.

#dataengineering #python #devops #datascience
Comments
5 min read
Navigating the Future: Top Data Engineering Trends Shaping 2024 and Beyond
dataformathub profile

Navigating the Future: Top Data Engineering Trends Shaping 2024 and Beyond

#news #dataengineering #etl #trends
Comments
4 min read
Tableau + Databricks at Scale: A Technical Guide for Managing 10,000+ Databases
ridwan_sassman_3d07 profile

Tableau + Databricks at Scale: A Technical Guide for Managing 10,000+ Databases

#analytics #architecture #database #dataengineering
1
Comments
5 min read
Day 14: Building a Real Retail Analytics Pipeline Using Spark Window Functions
sandeepk27 profile

Day 14: Building a Real Retail Analytics Pipeline Using Spark Window Functions

#python #dataengineering #spark #bigdata
Comments
1 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.