DEV Community

Aleksei Aleinikov
Aleksei Aleinikov

Posted on

πŸš€ Kyuubi + Apache Spark: Big Data, Smarter Execution

Kyuubi supercharges Spark SQL with resource isolation, multi-user support, interactive performance, and high availability.

No more:

  • Cluster-wide slowdowns from one heavy query ☠️
  • Missing security controls πŸ”
  • Session crashes without recovery 🧨

Why Kyuubi > Spark Thrift Server?

  • 🧩 Isolates sessions & allocates resources per user
  • πŸ” Integrates with Apache Ranger for row/column-level security
  • ⚑️ Uses ZooKeeper for failover + session continuity
  • πŸš€ Pre-warms Spark sessions for blazing-fast interactive queries

Key Features:

  1. Multi-tenancy: Each user gets their own Spark instance
  2. JDBC/ODBC + REST API support
  3. Python, SQL, Scala compatibility
  4. HA with ZooKeeper
  5. Extensions (UDFs, auth, logging)
  6. Works great in Arenadata Hadoop (ADH) stacks

Try it out and bring efficiency, security, and scalability to your Spark environment!

https://medium.datadriveninvestor.com/kyuubi-spark-power-of-big-data-a51d385f2f19

Hostinger image

Get n8n VPS hosting 3x cheaper than a cloud solution

Get fast, easy, secure n8n VPS hosting from $4.99/mo at Hostinger. Automate any workflow using a pre-installed n8n application and no-code customization.

Start now

Top comments (0)

πŸ‘‹ Kindness is contagious

Engage with a wealth of insights in this thoughtful article, valued within the supportive DEV Community. Coders of every background are welcome to join in and add to our collective wisdom.

A sincere "thank you" often brightens someone’s day. Share your gratitude in the comments below!

On DEV, the act of sharing knowledge eases our journey and fortifies our community ties. Found value in this? A quick thank you to the author can make a significant impact.

Okay