DEV Community

# spark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Exploring the Netflix TV Shows and Movies Dataset with Spark
jackson_freitas_42cbeaf74 profile

Exploring the Netflix TV Shows and Movies Dataset with Spark

#analytics #netflix #spark #databricks
Comments
2 min read
Gravitino 0.5.0: Expanding the horizon to Apache Spark, non-tabular data, and more!
alex_yan_163de34c186edd87 profile

Gravitino 0.5.0: Expanding the horizon to Apache Spark, non-tabular data, and more!

#gravatino #spark #nontabulardata #messagingcatalog
1
Comments
7 min read
Spark & Scala Cache Lessons from ETL Project
krlz profile
krlz

Spark & Scala Cache Lessons from ETL Project

#scala #programming #bigdata #spark
2
Comments 1
3 min read
Adaptive Partition Estimation in Distributed Dataflows: A Machine Learning Approach for Spark
etloss profile
Kirill

Adaptive Partition Estimation in Distributed Dataflows: A Machine Learning Approach for Spark

#spark #programming #machinelearning #datascience
Comments
4 min read
Big Data Fundamentals: spark
devops_fundamental profile

Big Data Fundamentals: spark

#bigdata #dataengineering #data #spark
Comments
6 min read
Building a Real-Time Healthcare Data Pipeline with Apache Spark: From SQS to Parquet (Part 2)
jayantineu profile

Building a Real-Time Healthcare Data Pipeline with Apache Spark: From SQS to Parquet (Part 2)

#spark #dataengineering #healthcare #python
Comments
8 min read
Use DolphinScheduler to schedule Spark jobs
chen_debra_3060b21d12b1b0 profile

Use DolphinScheduler to schedule Spark jobs

#apachedolphinscheduler #spark #opensource #programming
1
Comments
6 min read
🚀 Docker + Spark on Kubernetes: Build Tiny Custom Executors in Minutes (2025)
aleksei_aleinikov profile

🚀 Docker + Spark on Kubernetes: Build Tiny Custom Executors in Minutes (2025)

#docker #kubernetes #spark #devops
Comments
1 min read
Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark
jverhoeks profile

Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark

#iomete #spark #kubernetes
1
Comments 1
6 min read
Building a YouTube Channel Analytics Dashboard with Airflow, Spark, and Grafana
katumo profile

Building a YouTube Channel Analytics Dashboard with Airflow, Spark, and Grafana

#postgres #spark #airflow
Comments
8 min read
Big Data Processing - Case Study 2 (Spark) 01:52
mmafrar profile

Big Data Processing - Case Study 2 (Spark)

#bigdata #spark #dataengineering
Comments
1 min read
Complete Beginner's Guide: Building a Weather ETL Pipeline with PySpark
navashub profile

Complete Beginner's Guide: Building a Weather ETL Pipeline with PySpark

#programming #dataengineering #spark #etl
2
Comments 1
5 min read
Spark On Kubernetes
keyvan_soleimani profile

Spark On Kubernetes

#kubernetes #spark #docker #bigdata
1
Comments
4 min read
Big Data Processing - Case Study 4 (Spark) 02:36
mmafrar profile

Big Data Processing - Case Study 4 (Spark)

#bigdata #spark #dataengineering #datascience
Comments
1 min read
Big Data Processing - Case Study 3 (Spark) 02:35
mmafrar profile

Big Data Processing - Case Study 3 (Spark)

#bigdata #spark #dataengineering #tutorial
Comments
1 min read
Big Data Processing - Case Study 1 (Spark) 01:32
mmafrar profile

Big Data Processing - Case Study 1 (Spark)

#bigdata #programming #spark #dataengineering
Comments
1 min read
How to treat secure data on lakehouse
kination profile

How to treat secure data on lakehouse

#dataengineering #python #spark
1
Comments
3 min read
Tiny URL Design
blacviking profile

Tiny URL Design

#mysql #redis #kafka #spark
Comments
10 min read
Automatizando a Qualidade de Dados com DQX: Performance e praticidade
airton_lirajunior_2ddebd profile

Automatizando a Qualidade de Dados com DQX: Performance e praticidade

#dqx #spark #databricks #python
Comments
5 min read
Azure Data Engineering Books from #Techtter YT Channel
techtter profile

Azure Data Engineering Books from #Techtter YT Channel

#azure #dataengineering #spark
Comments
1 min read
AWS Glue vs AWS Lambda: Comparativa Serverless para Ingeniería de Datos en AWS
jlarizar profile

AWS Glue vs AWS Lambda: Comparativa Serverless para Ingeniería de Datos en AWS

#awsglue #lambda #serverless #spark
1
Comments
4 min read
Big Boost for Flink & Spark SQL: Both Tools Just Got Updated!
dogeking profile

Big Boost for Flink & Spark SQL: Both Tools Just Got Updated!

#sql #sparksql #spark #flinksql
Comments
1 min read
Designing a Scalable Shuffle Service for Big Data on AWS
chat_r profile

Designing a Scalable Shuffle Service for Big Data on AWS

#aws #spark #bigdata #cloudnative
Comments
3 min read
Study Notes 5.1.1-2 Introduction to Batch Processing & spark
pizofreude profile

Study Notes 5.1.1-2 Introduction to Batch Processing & spark

#dataengineering #dezoomcamp #batchprocessing #spark
1
Comments
6 min read
Study Notes 5.6.1-2 Spark on cloud & local
pizofreude profile

Study Notes 5.6.1-2 Spark on cloud & local

#dataengineering #dezoomcamp #spark #cloud
1
Comments
7 min read
loading...