Skip to content

DEV Community

# bigdata

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Marine for Taipy

Nov 29 '23

🏆How to master 📊 Big Data pipelines with Taipy and PySpark 🐍

#python #opensource #bigdata #tutorial

9 min read

Marine for Taipy

Nov 23 '23

Big data models 📊 vs. Computer memory 💾

#bigdata #pipeline #dataengineering #dask

11 min read

Mohamed Hussain S

Nov 15 '25

Why Parquet Is Everywhere - And What Makes It Actually Fast?

#dataengineering #parquet #bigdata #dataarchitecture

3 min read

Pradeep Kalluri

Nov 24 '25

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

#dataengineering #dataquality #bigdata #python

8 min read

Oct 14 '25

Code for a Better Planet: Hacking UN SDGs 7-12 with Big Data

#bigdata #datascience #sustainability

7 min read

Laetitia Perraut

Oct 13 '25

Drips to Data Streams: Hacking Water Scarcity with IoT & Big Data

#iot #bigdata #sustainability

6 min read

Sandeep

Dec 5 '25

🔥 Day 5: Introduction to DataFrames - The Most Importantce of Spark API

#dataengineering #python #spark #bigdata

2 min read

Oct 13 '25

Fueling Climate Action with Code: A Dev's Guide to First, Second, and Third-Party Data

#data #climatechange #bigdata

7 min read

Mahendran

Dec 22 '25

Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms

#dataengineering #finops #bigdata #costoptimization

9 min read

Pradeep Kalluri

Nov 22 '25

From Raw to Refined: Data Pipeline Architecture at Scale

#dataengineering #bigdata #python #dataquality

12 min read

Sandeep

Dec 11 '25

Day 12: UDF vs Pandas UDF

#python #dataengineering #spark #bigdata

2 min read

Sandeep

Dec 9 '25

Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers

#python #dataengineering #spark #bigdata

2 min read

Nov 20 '25

10x Query Performance Improvement: The Design and Implementation of the New Unique Key

#bigdata #olap #database #apachedoris

30 min read

Daniel Elegberun

Jul 30 '21

Unboxing a Database-How Databases Work Internally

#database #bigdata #distributedsystems

11 min read

Oct 23 '25

Blockchain Analytics: Exploring Ethereum Data with BigQuery, RAG, and AI

#programming #ai #rag #bigdata

1 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.