DEV Community

Malachi
Malachi

Posted on

AnyModelBot: an open-source local AI bot that connects to 70 mainstream models with one key

Hi, I'm Malachi, a co-developer of AnyModelBot. I'd like to share what we've been building.

What it is

AnyModelBot is an AI bot that runs locally on your own computer. It's MIT-licensed, open source, and free to use.

Highlights

  • One key, 70 models: with a single Modelflare Key you can switch between 70 mainstream models from around the world. No separate sign-ups, top-ups, or key management for each provider. Pay-as-you-go, no monthly fee.
  • Runs locally, MIT open source: the app runs on your machine and all the code is public.
  • Computer use: let the AI perform actions on your computer (macOS only, currently in Beta).
  • Local long-term memory: memory is stored locally as Markdown files you can open and edit any time.
  • Easy install: installers for Windows, macOS, and Linux, plus Docker.
  • Chat app integrations: you can also connect it to WeChat by scanning a QR code, or chat with it in Feishu DMs.

Current limitations

  • No mobile app; it needs a computer that stays on to run.
  • Feishu supports direct messages only, not group chats.

Links

The project is still early. Feel free to try it, open an Issue or PR, or leave suggestions in the comments.

Top comments (0)