DEV Community

Cover image for Run Local AI Agents in Chat Apps - Open Source Tool
GitHubOpenSource
GitHubOpenSource

Posted on

Run Local AI Agents in Chat Apps - Open Source Tool

TL;DR: AnyModelBot is a local-first desktop application that runs AI agents with their own isolated workspaces, memory stores, and custom personas. It interfaces with an integrated Modelflare account or direct vendor API keys while executing local shell commands and file operations behind user-approved permission guardrails.
Best for: Developers who want self-hosted, multi-model AI assistants integrated directly into desktop files and chat apps.
Repository snapshot: ⭐ 2 737 stars · 🍴 44 forks · Python · MIT
Daily picks: Follow GitHub Open Source on Telegram


What it is

AnyModelBot is an open-source, Python-based desktop application designed to run local-first AI agents with isolated workspaces, persistent memory, and custom personas. It bridges local execution environments with external messaging platforms like WeChat, Feishu, Slack, and Telegram.

How it works

The application initializes a local runtime that manages agent state and connects to over 70 models across 13 providers using a single billing key. It executes shell commands and file operations behind user-approved permission guardrails, ensuring that background tasks and scheduled routines operate securely within designated workspace boundaries.

Key features

  • Connect 70+ models across 13 providers using a single billing key
  • Deploy multi-channel bots to WeChat, Feishu, Slack, and Discord alongside desktop chat
  • Enforce granular workspace permissions with read-only, workspace-bound, and full access tiers
  • Run background tasks and scheduled routines that ping you only when human decisions are needed
  • Import custom agent skills via packaged ZIP archives containing SKILL.md definitions

Getting started

Clone the repository from GitHub and install the dependencies locally:

git clone https://github.com/modelflare-ai/AnyModelBot.git
cd AnyModelBot
pip install -r requirements.txt
python main.py
Enter fullscreen mode Exit fullscreen mode

Ensure you configure your workspace permissions and supply your provider keys or billing key before executing shell-enabled workflows.

When not to use it

Avoid this tool if you require a zero-config cloud-hosted solution or if you are uncomfortable running local applications with shell execution privileges on your machine.


Discuss

Which chat channel would you deploy your first local agent to?

Curated from the repository README and metadata. No hands-on test is claimed; evaluate it in a sandbox before production use.

Top comments (0)