DEV Community

#bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Spring Batch: Processing Large Data Volumes Efficiently (2026-09-03 17:31)
said_olano profile

Spring Batch: Processing Large Data Volumes Efficiently (2026-09-03 17:31)

#springbatch #java #bigdata #batchprocessing
Comments
2 min read
Apache Data Lakehouse Weekly: July 29 to August 5, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: July 29 to August 5, 2026

#bigdata #data #database #opensource
Comments
27 min read
Apache Spark & PySpark, Explained Without a PhD
ramkumar-m-n profile

Apache Spark & PySpark, Explained Without a PhD

#spark #bigdata #dataengineering #beginners
7
Comments
7 min read
The pipeline passed. The data still needs proof.
jerry_king_d0ee94a9bca82f profile

The pipeline passed. The data still needs proof.

#dataengineering #database #bigdata #lakehouse
Comments 2
3 min read
Understanding the ORC File Format: Why Is It So Fast
mohhddhassan profile

Understanding the ORC File Format: Why Is It So Fast

#dataengineering #bigdata #database #python
3
Comments
8 min read
Managing Hadoop Without the Headache: Introducing Hadoop Handler
adityapidurkar profile

Managing Hadoop Without the Headache: Introducing Hadoop Handler

#hadoop #bigdata #automation
2
Comments
3 min read
[EN] Data Driven Series #1: Apache Kafka and Elastic Stack Big Data Use Cases
cedon profile

[EN] Data Driven Series #1: Apache Kafka and Elastic Stack Big Data Use Cases

#bigdata #datadrivendesign #stream #search
2
Comments
4 min read
Apache Data Lakehouse Weekly: July 21 to July 29, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: July 21 to July 29, 2026

#bigdata #data #database #opensource
1
Comments
26 min read
Top 12 Spark Interview Problems for Data Engineers, With Answers
datadriven profile

Top 12 Spark Interview Problems for Data Engineers, With Answers

#spark #bigdata #dataengineering #interview
Comments
10 min read
Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends
remi_foures_036456c35af85 profile

Does Early Dragon Control Help Scaling Compositions? A Big Data Analysis of League of Legends

#bigdata #leagueoflegende #python #karmincorp
9
Comments 4
4 min read
Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action
sciforce profile

Predictive Maintenance in 2026: How AI, Edge Computing, and Agentic Systems Turn Detection Into Action

#ai #manufacturing #bigdata #datascience
Comments
14 min read
How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency
dinhphu2k1gif profile

How Uber Built Its Big Data System — From a Few TBs to 350 Petabytes with Sub-Hour Latency

#bigdata #dataengineering #apachehudi #architecture
Comments
9 min read
Your warehouse isn't expensive. Your full table scans are.
fagundesv profile

Your warehouse isn't expensive. Your full table scans are.

#bigdata #bigquery #redshift #aws
1
Comments 1
5 min read
Migrating a ScyllaDB Cluster the “Brain Transplant” Way
sadoyan profile
Ara

Migrating a ScyllaDB Cluster the “Brain Transplant” Way

#scylladb #bigdata #database
Comments
6 min read
"We Have DevOps, So Why Not DataOps?"
sezin_oztekin profile

"We Have DevOps, So Why Not DataOps?"

#datascience #bigdata #dataops #devops
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.