When building workflows with autonomous coding agents (like Claude Code, Cursor, or OpenCode), agent execution loops issue dozens of rapid LLM calls per minute. Standard Python-based proxies introduce 40ms–100ms of latency per hop, balloon to hundreds of megabytes in memory, and easily choke during parallel agent streaming.
To solve this, I built GoRoute (https://github.com/ziuus/goroute) — an ultra-lightweight, high-throughput AI gateway and dynamic LLM router written in Go.
Key Features
- Sub-0.8ms Local Routing: Baseline footprint <12MB RAM.
- Universal Protocol Translation: Translate OpenAI format to Anthropic messages format.
- Dynamic Failover Cascades: Automatic fallback from Claude 3.5 Sonnet to DeepSeek-V3 or GPT-4o.
- Multi-Account Token Pooling: Distribute requests round-robin across multiple API keys.
GitHub: https://github.com/ziuus/goroute
Demo: https://goroute-website.vercel.app
Top comments (0)