DEV Community

# bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Parquet Is Everywhere - And What Makes It Actually Fast?
mohhddhassan profile

Why Parquet Is Everywhere - And What Makes It Actually Fast?

#dataengineering #parquet #bigdata #dataarchitecture
2
Comments
3 min read
Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks
pradeep_kaalluri profile

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

#dataengineering #dataquality #bigdata #python
Comments
8 min read
Code for a Better Planet: Hacking UN SDGs 7-12 with Big Data
vitalisorenko profile

Code for a Better Planet: Hacking UN SDGs 7-12 with Big Data

#bigdata #datascience #sustainability
4
Comments
7 min read
Drips to Data Streams: Hacking Water Scarcity with IoT & Big Data
laetitiaperraut profile

Drips to Data Streams: Hacking Water Scarcity with IoT & Big Data

#iot #bigdata #sustainability
Comments
6 min read
đŸ”„ Day 5: Introduction to DataFrames - The Most Importantce of Spark API
sandeepk27 profile

đŸ”„ Day 5: Introduction to DataFrames - The Most Importantce of Spark API

#dataengineering #python #spark #bigdata
Comments
2 min read
Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms
mahendran_a3347c2dfcca93e profile

Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms

#dataengineering #finops #bigdata #costoptimization
Comments
9 min read
From Raw to Refined: Data Pipeline Architecture at Scale
pradeep_kaalluri profile

From Raw to Refined: Data Pipeline Architecture at Scale

#dataengineering #bigdata #python #dataquality
Comments
12 min read
Fueling Climate Action with Code: A Dev's Guide to First, Second, and Third-Party Data
bobcars profile

Fueling Climate Action with Code: A Dev's Guide to First, Second, and Third-Party Data

#data #climatechange #bigdata
Comments
7 min read
Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers
sandeepk27 profile

Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers

#python #dataengineering #spark #bigdata
Comments
2 min read
Day 12: UDF vs Pandas UDF
sandeepk27 profile

Day 12: UDF vs Pandas UDF

#python #dataengineering #spark #bigdata
Comments
2 min read
10x Query Performance Improvement: The Design and Implementation of the New Unique Key
apachedoris profile

10x Query Performance Improvement: The Design and Implementation of the New Unique Key

#bigdata #olap #database #apachedoris
Comments
30 min read
Blockchain Analytics: Exploring Ethereum Data with BigQuery, RAG, and AI
gary_zavaleta_ee17bce787f profile

Blockchain Analytics: Exploring Ethereum Data with BigQuery, RAG, and AI

#programming #ai #rag #bigdata
1
Comments 1
1 min read
Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB
apachedoris profile

Overview of Real-Time Data Synchronization from PostgreSQL to VeloDB

#bigdata #postgressql #apachedoris #database
Comments
6 min read
Spark & Scala Cache Lessons from ETL Project
krlz profile

Spark & Scala Cache Lessons from ETL Project

#scala #programming #bigdata #spark
2
Comments 1
3 min read
How to build real-time user-facing analytics with Kafka + Flink + Doris
apachedoris profile

How to build real-time user-facing analytics with Kafka + Flink + Doris

#bigdata #olap #kafka #doris
4
Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.