Dockerize Your LLM Proxy: One Container for Free Multi-Provider Access
Want free LLM access in a repeatable, portable way? Run it as a container.
Why Docker
- Single command to deploy anywhere
- Isolated environment with consistent deps
- Easy to put behind a reverse proxy
DAVIL Cod in Docker
DAVIL Cod ships a Dockerfile. Build and run with provider keys as env vars:
docker build -t davil-cod .
docker run -p 4000:4000 \
-e PROVIDER_GROQ_APIKEY=... \
-e PROVIDER_MISTRAL_APIKEY=... \
davil-cod
Features you get
- Provider rotation with circuit breaker
- Disk cache for repeated prompts
- Dashboard on port 4000
FAQ
Does it persist the cache? Yes — mount a volume for the cache directory.
Can I expose it to my team? Yes — it's a normal HTTP service with token auth.
Top comments (0)