Beyond Local LLM Merging: Why We Built MergeKit Cloud (And How to Contribute)

Mergekit Team — Tue, 29 Sep 2026 22:54:38 +0000

Model merging via MergeKit has completely changed open-source AI. It allows developers to build incredible, high-performing LLMs without the extreme costs of retraining or traditional fine-tuning.
But as models grow and merge recipes become more complex, doing this locally hits a massive bottleneck: compute constraints, massive tensor slicing execution limits, and complex storage pipeline setups.
That is why we built MergeKit Cloud—a scalable, cloud-native orchestration layer and visual dashboard designed to streamline weight-space optimizations at scale. The infrastructure is built, and now we are opening our doors to core contributors to help take it to the next level.
🛠️ What We Built So Far
• Automated Cloud Orchestration: A backend engine that handles heavy model-merging computational lifting in cloud environments.
• Recipe Blueprint UI: A streamlined interface to design, edit, and pass complex YAML files without getting lost in terminals.
🚀 Where We Need Help (Contributor Wishlist)
We want to keep this project community-driven and are actively seeking builders for:

MLOps Optimization: Helping us fine-tune out-of-core tensor chunking and lazy weight loading over cloud-bucket storage layers.
Automated Evaluation Loops: Integrating robust automated benchmarking suites (like LMSYS or AlpacaEval) directly into the completion workflow.
Frontend Architecture: Expanding our visual recipe block builder for non-technical enterprise users.

DEV Community: Mergekit Team

Beyond Local LLM Merging: Why We Built MergeKit Cloud (And How to Contribute)