Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
spark
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Why I Built a Spark-Native LLM Evaluation Framework
Subhadip Mitra
Subhadip Mitra
Subhadip Mitra
Follow
Dec 16 '25
Why I Built a Spark-Native LLM Evaluation Framework
#
llm
#
mlops
#
spark
#
python
Comments
Add Comment
9 min read
🔥 Day 5: Introduction to DataFrames - The Most Importantce of Spark API
Sandeep
Sandeep
Sandeep
Follow
Dec 5 '25
🔥 Day 5: Introduction to DataFrames - The Most Importantce of Spark API
#
dataengineering
#
python
#
spark
#
bigdata
Comments
Add Comment
2 min read
Fixing PySpark on Windows: Downgrading from Python 3.13 to 3.11 (Complete Guide)
Rachit Avasthi
Rachit Avasthi
Rachit Avasthi
Follow
Dec 19 '25
Fixing PySpark on Windows: Downgrading from Python 3.13 to 3.11 (Complete Guide)
#
pyspark
#
python
#
programming
#
spark
Comments
Add Comment
3 min read
Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study
Rose Wabere
Rose Wabere
Rose Wabere
Follow
Nov 13 '25
Building a Modern Data Platform to Track Kenya’s Food Prices — A Data Engineering Case Study
#
spark
#
pyspark
#
grafana
#
dataengineering
Comments
Add Comment
5 min read
Node4J — Call Java Code Natively from Node.js
Shantanu Sharma
Shantanu Sharma
Shantanu Sharma
Follow
Dec 24 '25
Node4J — Call Java Code Natively from Node.js
#
spark
#
java
#
node
1
 reaction
Comments
Add Comment
3 min read
Day 12: UDF vs Pandas UDF
Sandeep
Sandeep
Sandeep
Follow
Dec 11 '25
Day 12: UDF vs Pandas UDF
#
python
#
dataengineering
#
spark
#
bigdata
Comments
Add Comment
2 min read
Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers
Sandeep
Sandeep
Sandeep
Follow
Dec 9 '25
Day 9: Spark SQL Deep Dive - Temp Views, Query Execution & Optimization Tips for Data Engineers
#
python
#
dataengineering
#
spark
#
bigdata
Comments
Add Comment
2 min read
Exploring Brazilian E-commerce with Spark on Databricks Free Edition
Jackson Freitas
Jackson Freitas
Jackson Freitas
Follow
Oct 15 '25
Exploring Brazilian E-commerce with Spark on Databricks Free Edition
#
spark
#
databricks
#
analytics
#
kaggle
2
 reactions
Comments
Add Comment
4 min read
Spark & Scala Cache Lessons from ETL Project
krlz
krlz
krlz
Follow
Sep 3 '25
Spark & Scala Cache Lessons from ETL Project
#
scala
#
programming
#
bigdata
#
spark
2
 reactions
Comments
1
 comment
3 min read
Exploring the Netflix TV Shows and Movies Dataset with Spark
Jackson Freitas
Jackson Freitas
Jackson Freitas
Follow
Oct 13 '25
Exploring the Netflix TV Shows and Movies Dataset with Spark
#
analytics
#
netflix
#
spark
#
databricks
Comments
Add Comment
2 min read
Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data
Tech Croc
Tech Croc
Tech Croc
Follow
Dec 25 '25
Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data
#
kafka
#
spark
#
webdev
#
programming
5
 reactions
Comments
Add Comment
3 min read
Fixing PySpark “Cannot run program python3” Error on Windows
Rachit Avasthi
Rachit Avasthi
Rachit Avasthi
Follow
Dec 19 '25
Fixing PySpark “Cannot run program python3” Error on Windows
#
programming
#
python
#
pyspark
#
spark
Comments
Add Comment
3 min read
End-to-End Real-Time Data Engineering on Databricks Using Spark Structured Streaming and Delta Lake
Nithyalakshmi Kamalakkannan
Nithyalakshmi Kamalakkannan
Nithyalakshmi Kamalakkannan
Follow
Jan 2
End-to-End Real-Time Data Engineering on Databricks Using Spark Structured Streaming and Delta Lake
#
dataengineering
#
handson
#
realtimeproject
#
spark
1
 reaction
Comments
Add Comment
1 min read
🚀 Day 1: Introduction to Apache Spark
Sandeep
Sandeep
Sandeep
Follow
Dec 1 '25
🚀 Day 1: Introduction to Apache Spark
#
spark
#
python
#
dataengineering
#
bigdata
1
 reaction
Comments
Add Comment
2 min read
🔥 Day 6: Essential PySpark DataFrame Transformations
Sandeep
Sandeep
Sandeep
Follow
Dec 6 '25
🔥 Day 6: Essential PySpark DataFrame Transformations
#
dataengineering
#
python
#
spark
#
bigdata
Comments
Add Comment
2 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account