How I Set Up NanoGPT with SillyTavern (Private AI Chat)

I wanted to use SillyTavern with a private API backend. After trying a few options, I settled on NanoGPT. Here's how I set it up and what I learned.

Why NanoGPT for SillyTavern?

SillyTavern needs an API backend. Most people use OpenAI or Anthropic directly, but that means your conversations go to those companies' servers.

NanoGPT gives you:

• Access to 125+ models through one API
• No conversation storage
• Crypto payment option (Monero, Bitcoin)
• OpenAI-compatible API (works directly with SillyTavern)

Setup Steps

1. Get Your NanoGPT API Key

Go to nano-gpt.com and create an account. Then:

• Go to Settings → API Keys
• Generate a new key
• Copy it somewhere safe

2. Configure SillyTavern

In SillyTavern:

• Go to API Connections
• Select "OpenAI / OpenAI-compatible" as the API type
• Paste your NanoGPT API key
• Set the endpoint to the current NanoGPT API URL (check their docs)

3. Pick Your Model

For SillyTavern, I recommend:

• Claude 3.5 Sonnet — best for creative writing and roleplay
• GPT-4o — good all-rounder
• Llama 3 — budget option, decent quality

4. Test It

Send a simple message to verify the connection works. If you get a response, you're good to go.

Privacy Tips

• Use an email alias for your NanoGPT account
• Pay with Monero for maximum privacy
• Keep your chat history short (10-20 messages) to reduce context leakage
• Use a VPN when connecting

Cost

For SillyTavern usage, I spend about $5-10/month. That's way less than ChatGPT Plus, and I get to use Claude for writing.

Troubleshooting

"API Key Invalid" — Double-check the key, make sure there are no extra spaces.

"Model Not Found" — Check the model name spelling. NanoGPT uses specific model identifiers.

Slow responses — Switch to a faster model like GPT-4o-mini or Claude Haiku.

---

Originally published at ai-privacy-tools.vercel.app