DEV Community

Aleksei Aleinikov
Aleksei Aleinikov

Posted on

🚀 Kyuubi + Apache Spark: Big Data, Smarter Execution

Kyuubi supercharges Spark SQL with resource isolation, multi-user support, interactive performance, and high availability.

No more:

  • Cluster-wide slowdowns from one heavy query ☠️
  • Missing security controls 🔐
  • Session crashes without recovery 🧨

Why Kyuubi > Spark Thrift Server?

  • 🧩 Isolates sessions & allocates resources per user
  • 🔐 Integrates with Apache Ranger for row/column-level security
  • ⚡️ Uses ZooKeeper for failover + session continuity
  • 🚀 Pre-warms Spark sessions for blazing-fast interactive queries

Key Features:

  1. Multi-tenancy: Each user gets their own Spark instance
  2. JDBC/ODBC + REST API support
  3. Python, SQL, Scala compatibility
  4. HA with ZooKeeper
  5. Extensions (UDFs, auth, logging)
  6. Works great in Arenadata Hadoop (ADH) stacks

Try it out and bring efficiency, security, and scalability to your Spark environment!

https://medium.datadriveninvestor.com/kyuubi-spark-power-of-big-data-a51d385f2f19

Top comments (1)

Collapse
 
renqiang2020 profile image
Renqiang2020

如何在HUE中配置使用开启HA的kyuubi ?