Model merging via MergeKit has completely changed open-source AI. It allows developers to build incredible, high-performing LLMs without the extreme costs of retraining or traditional fine-tuning.
But as models grow and merge recipes become more complex, doing this locally hits a massive bottleneck: compute constraints, massive tensor slicing execution limits, and complex storage pipeline setups.
That is why we built MergeKit Cloud—a scalable, cloud-native orchestration layer and visual dashboard designed to streamline weight-space optimizations at scale. The infrastructure is built, and now we are opening our doors to core contributors to help take it to the next level.
🛠️ What We Built So Far
• Automated Cloud Orchestration: A backend engine that handles heavy model-merging computational lifting in cloud environments.
• Recipe Blueprint UI: A streamlined interface to design, edit, and pass complex YAML files without getting lost in terminals.
🚀 Where We Need Help (Contributor Wishlist)
We want to keep this project community-driven and are actively seeking builders for:
- MLOps Optimization: Helping us fine-tune out-of-core tensor chunking and lazy weight loading over cloud-bucket storage layers.
- Automated Evaluation Loops: Integrating robust automated benchmarking suites (like LMSYS or AlpacaEval) directly into the completion workflow.
- Frontend Architecture: Expanding our visual recipe block builder for non-technical enterprise users.
Top comments (0)