DEV Community

LocPilot
LocPilot

Posted on • Originally published at locpilot.com

Local. Private. Use KoboldCpp in Microsoft Word.

Looking for a Microsoft Copilot alternative without recurring inference costs? You might consider utilizing KoboldCpp in combination with LLMs directly within Microsoft Word. KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It’s a single self-contained distributable that builds off llama.cpp, and adds a versatile KoboldAI API endpoint.

Here’s a quick demonstration of how KoboldCpp can be integrated within Microsoft Word on your local machine without recurring inference fees. The demo is powered by GPTLocalhost, which offers the same core features for individual use. LocPilot for Word is the Intranet edition of GPTLocalhost designed for enterprise users and team collaboration.

For more creative uses of local and private LLMs in Microsoft Word, explore additional demos available on our channel at @LocPilot. We hope this demonstration sparks new ideas and encourages you to create further applications that equip your team with cutting-edge on-premise AI capabilities. If you have any particular suggestions or concepts, please feel free to reach out to us at info@locpilot.com. Our mission is to make local AI more accessible and affordable for teamwork.

Top comments (0)

The discussion has been locked. New comments can't be added.