DEV Community

Alex Spinov
Alex Spinov

Posted on

Jan Has a Free API You Should Know About

Jan is an open-source ChatGPT alternative that runs 100% offline on your computer. Download models, chat privately, and use an OpenAI-compatible API — all without internet.

Why Run AI Locally

A lawyer needed AI assistance for document review but couldn't use cloud AI due to attorney-client privilege. Jan runs completely offline — no data ever leaves the device.

Key Features:

  • 100% Offline — No internet required after model download
  • OpenAI-Compatible API — Drop-in replacement for OpenAI SDK
  • Model Hub — Download models from Hugging Face with one click
  • Cross-Platform — Windows, Mac, Linux
  • Extensions — Plugin system for custom functionality

Quick Start

Download from jan.ai, install, and start chatting. Download any model from the built-in model hub.

Local API Server

Jan starts an OpenAI-compatible server at http://localhost:1337:

from openai import OpenAI

client = OpenAI(base_url="http://localhost:1337/v1", api_key="not-needed")

response = client.chat.completions.create(
    model="llama3",
    messages=[{"role": "user", "content": "Explain quantum computing"}]
)
print(response.choices[0].message.content)
Enter fullscreen mode Exit fullscreen mode

Why Choose Jan

  1. Complete privacy — data never leaves your machine
  2. OpenAI compatible — switch from OpenAI with one line
  3. Free forever — no API costs, no subscriptions

Check out Jan docs to get started.


Building local AI? Check out my Apify actors or email spinov001@gmail.com for data extraction.

Top comments (0)