DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Day 15: Running Spark in the Cloud - Dataproc vs Databricks
sandeepk27 profile

Day 15: Running Spark in the Cloud - Dataproc vs Databricks

#python #dataengineering #spark #bigdata
Comments
2 min read
Rethinking Stream-Batch Unification: Real-Time Processing with Incremental Materialized Views in Apache Cloudberry
maya_sun_29e7bf629e5dd7b3 profile

Rethinking Stream-Batch Unification: Real-Time Processing with Incremental Materialized Views in Apache Cloudberry

#database #dataengineering #postgres
Comments
5 min read
Interesting links - December 2025
rmoff profile

Interesting links - December 2025

#data #dataengineering #kafka #flink
Comments
13 min read
Data Engineering Processes: From Raw Data to Cleaned, Processed, Analytics-Ready Data.
giridharan_devops profile

Data Engineering Processes: From Raw Data to Cleaned, Processed, Analytics-Ready Data.

#dataengineering #python #devops #datascience
Comments
5 min read
Navigating the Future: Top Data Engineering Trends Shaping 2024 and Beyond
dataformathub profile

Navigating the Future: Top Data Engineering Trends Shaping 2024 and Beyond

#news #dataengineering #etl #trends
Comments
4 min read
Apache Airflow: Complete Guide for Basic to Advanced Developers
datatechbridge profile

Apache Airflow: Complete Guide for Basic to Advanced Developers

#dataengineering #devops #python #airflow
1
Comments
22 min read
Day 14: Building a Real Retail Analytics Pipeline Using Spark Window Functions
sandeepk27 profile

Day 14: Building a Real Retail Analytics Pipeline Using Spark Window Functions

#python #dataengineering #spark #bigdata
Comments
1 min read
LET'S GIT IT—A Beginner's Guide to Version Control.
brianm profile

LET'S GIT IT—A Beginner's Guide to Version Control.

#git #github #datascience #dataengineering
4
Comments 1
3 min read
Day 13: Window Functions in PySpark
sandeepk27 profile

Day 13: Window Functions in PySpark

#python #dataengineering #spark #bigdata
Comments
2 min read
Introduction to Version Control with Git and GitHub
motanga profile

Introduction to Version Control with Git and GitHub

#programming #dataengineering #beginners #git
1
Comments 2
3 min read
Is CsvPath an easy or hard language?
david_kershaw_b6916404da6 profile

Is CsvPath an easy or hard language?

#datascience #dataengineering #datastructures #programming
Comments
16 min read
Day 17: Building a Real ETL Pipeline in Spark Using Bronze-Silver-Gold Architecture
sandeepk27 profile

Day 17: Building a Real ETL Pipeline in Spark Using Bronze-Silver-Gold Architecture

#dataengineering #spark #bigdata #python
Comments
1 min read
Understanding Salesforce Data 360 Objects: The Core of the Unified Customer Profile
sunil_1303 profile

Understanding Salesforce Data 360 Objects: The Core of the Unified Customer Profile

#architecture #aws #dataengineering
Comments
3 min read
Apache Gravitino Introduction
datastrato-yue profile

Apache Gravitino Introduction

#architecture #dataengineering #opensource #gravitino101
2
Comments
5 min read
S3-Native Kafka Alternatives: What's Actually Different
novatechflow profile

S3-Native Kafka Alternatives: What's Actually Different

#kafka #dataengineering #opensource #devops
Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.