DEV Community

# spark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to recover from a deleted _spark_metadata folder in Spark Structured Streaming

How to recover from a deleted _spark_metadata folder in Spark Structured Streaming

10
Comments 3
5 min read
Spark and Docker: Your Spark development cycle just got 10x faster !

Spark and Docker: Your Spark development cycle just got 10x faster !

15
Comments
7 min read
How-to guide: Set up, Manage & Monitor Spark on Kubernetes

How-to guide: Set up, Manage & Monitor Spark on Kubernetes

20
Comments
10 min read
Apache Spark Java Tutorial: Simplest Guide to Get Started

Apache Spark Java Tutorial: Simplest Guide to Get Started

11
Comments
3 min read
Is Structured Streaming Exactly-Once? Well, it depends...

Is Structured Streaming Exactly-Once? Well, it depends...

10
Comments
4 min read
can a map function be executed on multiple executors for an item in RDD.

can a map function be executed on multiple executors for an item in RDD.

3
Comments
1 min read
Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

9
Comments
10 min read
Using Aerospike Connect For Spark

Using Aerospike Connect For Spark

6
Comments
5 min read
Migrating from a plain Spark Application to ZIO with ZparkIO

Migrating from a plain Spark Application to ZIO with ZparkIO

9
Comments
6 min read
Spark: unit, integration and end-to-end tests.

Spark: unit, integration and end-to-end tests.

20
Comments
5 min read
Spark Journey begins...

Spark Journey begins...

8
Comments
3 min read
Working with nested structures in Spark

Working with nested structures in Spark

7
Comments 1
3 min read
Intoduction to Apache Spark

Intoduction to Apache Spark

10
Comments
6 min read
Spark Side Menu Micro-Interactions Deconstruction

Spark Side Menu Micro-Interactions Deconstruction

3
Comments
2 min read
Unit Testing Apache Spark Structured Streaming using MemoryStream

Unit Testing Apache Spark Structured Streaming using MemoryStream

7
Comments
4 min read
Setting up IntelliJ IDEA for Apache Spark and Scala development

Setting up IntelliJ IDEA for Apache Spark and Scala development

6
Comments
2 min read
Exploiting Schema Inference in Apache Spark

Exploiting Schema Inference in Apache Spark

2
Comments
3 min read
How to create a low-cost Apache Spark cluster on Microsoft Azure

How to create a low-cost Apache Spark cluster on Microsoft Azure

7
Comments
4 min read
How to make a column non-nullable in Spark Structured Streaming

How to make a column non-nullable in Spark Structured Streaming

5
Comments
2 min read
Hadoop vs Spark: Which is a better framework to select for processing Big Data?

Hadoop vs Spark: Which is a better framework to select for processing Big Data?

6
Comments
5 min read
Why are we building DevOps platform for Big Data?

Why are we building DevOps platform for Big Data?

3
Comments
3 min read
The Big Data Bravura: Introducing Apache Spark

The Big Data Bravura: Introducing Apache Spark

21
Comments 2
3 min read
Spark NLP: State of the art natural language processing at scale

Spark NLP: State of the art natural language processing at scale

4
Comments
2 min read
Install Apache Spark (and Apache Hadoop) smoothly

Install Apache Spark (and Apache Hadoop) smoothly

8
Comments
1 min read
Apache Spark and Databricks 101 pt. II - Some DataFrames

Apache Spark and Databricks 101 pt. II - Some DataFrames

2
Comments
1 min read
loading...