DEV Community

Garage23auto
Garage23auto

Posted on

Dockerize Your LLM Proxy: One Container for Free Multi-Provider Access

Dockerize Your LLM Proxy: One Container for Free Multi-Provider Access

Want free LLM access in a repeatable, portable way? Run it as a container.

Why Docker

  • Single command to deploy anywhere
  • Isolated environment with consistent deps
  • Easy to put behind a reverse proxy

DAVIL Cod in Docker

DAVIL Cod ships a Dockerfile. Build and run with provider keys as env vars:

docker build -t davil-cod .
docker run -p 4000:4000 \
  -e PROVIDER_GROQ_APIKEY=... \
  -e PROVIDER_MISTRAL_APIKEY=... \
  davil-cod
Enter fullscreen mode Exit fullscreen mode

Features you get

  • Provider rotation with circuit breaker
  • Disk cache for repeated prompts
  • Dashboard on port 4000

FAQ

Does it persist the cache? Yes — mount a volume for the cache directory.

Can I expose it to my team? Yes — it's a normal HTTP service with token auth.

Top comments (0)