DEV Community

#dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Is CsvPath an easy or hard language?
david_kershaw_b6916404da6 profile

Is CsvPath an easy or hard language?

#datascience #dataengineering #datastructures #programming
Comments
16 min read
Day 17: Building a Real ETL Pipeline in Spark Using Bronze-Silver-Gold Architecture
sandeepk27 profile

Day 17: Building a Real ETL Pipeline in Spark Using Bronze-Silver-Gold Architecture

#dataengineering #spark #bigdata #python
Comments
1 min read
Understanding Salesforce Data 360 Objects: The Core of the Unified Customer Profile
sunil_1303 profile

Understanding Salesforce Data 360 Objects: The Core of the Unified Customer Profile

#architecture #aws #dataengineering
Comments
3 min read
Apache Gravitino Introduction
yueguo profile

Apache Gravitino Introduction

#architecture #dataengineering #opensource #gravitino101
3
Comments
5 min read
S3-Native Kafka Alternatives: What's Actually Different
novatechflow profile

S3-Native Kafka Alternatives: What's Actually Different

#kafka #dataengineering #opensource #devops
Comments
3 min read
Day 12: UDF vs Pandas UDF
sandeepk27 profile

Day 12: UDF vs Pandas UDF

#python #dataengineering #spark #bigdata
Comments
2 min read
Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL
kienly profile

Building a Near Real-Time Analytics Pipeline with AWS Zero-ETL

#analytics #aws #database #dataengineering
Comments
4 min read
Dev List Digest for Apache Iceberg, Parquet, Polaris and Arrow: January 6–14, 2026
alexmercedcoder profile

Dev List Digest for Apache Iceberg, Parquet, Polaris and Arrow: January 6–14, 2026

#news #dataengineering #opensource
Comments
4 min read
The Data Engineers Descent Into Datetime Hell
taylor_coleman_4efe265a3d profile

The Data Engineers Descent Into Datetime Hell

#data #datascience #dataengineering #python
1
Comments
5 min read
We're Manufacturing Dashboards & Data Nobody Uses (And the Data Proves It)
analyticspitfalls profile

We're Manufacturing Dashboards & Data Nobody Uses (And the Data Proves It)

#data #ai #dataengineering #dataops
Comments 1
4 min read
Day 11: Choosing the Right File Format in Spark
sandeepk27 profile

Day 11: Choosing the Right File Format in Spark

#python #dataengineering #spark #bigdata
Comments
2 min read
Navigating the Future: Key Data Engineering Trends for 2024 and Beyond
dataformathub profile

Navigating the Future: Key Data Engineering Trends for 2024 and Beyond

#news #dataengineering #etl #trends
Comments
6 min read
How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)
saurabhmahawar profile

How to Build Presto from Source - OSS Contribution Guide (Step by Step Tutorial)

#opensource #presto #dataengineering #dataanalytics
Comments
7 min read
Day 7: Mastering Joins, Unions, and GroupBy in PySpark - The Core ETL Operations
sandeepk27 profile

Day 7: Mastering Joins, Unions, and GroupBy in PySpark - The Core ETL Operations

#dataengineering #python #spark #bigdata
Comments
2 min read
Engineer’s Diary: Leaving Windows Behind and Building the ETL Engine I Always Dreamed Of, PardoX v0.1
betoalien profile

Engineer’s Diary: Leaving Windows Behind and Building the ETL Engine I Always Dreamed Of, PardoX v0.1

#showdev #dataengineering #devjournal #linux
Comments
21 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.