DEV Community

Ambarish Ganguly
Ambarish Ganguly

Posted on

Apache Spark architecture

apachespark #spark #sparkarchitecture

01 - Spark Architecture Basics in 6 mins. Concepts explained
πŸ““ Application
πŸ““ Driver
πŸ““ Executor
πŸ““ Partition
πŸ““ Job
πŸ““ Stage
πŸ““ Tasks
πŸ““ Slots
πŸ““ Lazy evaluation
πŸ““ Narrow and wide Transformations
πŸ““ Actions

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

πŸ‘‹ Kindness is contagious

Please leave a ❀️ or a friendly comment on this post if you found it helpful!

Okay