spark-submit command builder with live preview

twitter logo Updated on ・1 min read

As a spark developer, you might need to add numerous configuration parameters to run your Apache Spark application with optimal settings. If you look at the number of configuration options available in the spark-submit command, you would definitely appreciate, the kind of optimisations you could do.

There is a simple tool, just to build this spark-submit command at Gigahex. Gigahex is an upcoming platform for monitoring and receiving alerts for Spark based application.

Here's the video tutorial.

twitter logo DISCUSS
Classic DEV Post from Aug 29 '19

How can open source contributors and maintainers engage in a respectful ongoing relationship?

Shad Amez profile image
Distributed Systems engineer