What Strata is
Strata is a free, open-source (MIT) app and engine for running AI
locally: you chat, write code and work with images, and nothing leaves
your machine. There is no account. It ships as a desktop app for
Windows, Linux and macOS, and a terminal app – install it, then run
strata launch. On first launch the app downloads the engine built for
your specific graphics card, so there is no compiling to babysit.
Picking a model that fits
Strata recommends ISTA-DASLab quantisation packs first, then Unsloth and
other providers where a compatible model fits. The headline model is
Qwen3.8-Flash-Next, offered across many quant sizes (Q2*0, IQ2*XS,
IQ3*XXS and IQ3*S on the recommended line; UD-IQ4*XS up to Q8*0 on
Unsloth), with Qwen3.6-35B-A3B as another documented choice. Not sure
what fits? The model guide lets you pick by available memory and
compares sizes, memory needs and compatibility file by file.
Hardware it runs on
The supported list is wide: NVIDIA GeForce RTX 20-50 series, AMD Radeon
RX 7000/9000 and the AI PRO R9700, RX 6800/6900 (experimental), Intel
Arc on Linux, Apple Silicon M1 and newer, AMD Strix Halo and NVIDIA DGX
Spark. Same app, one toolchain.
The point: your other tools, kept local
Strata exposes OpenAI- and Anthropic-compatible APIs, so coding agents –
Claude Code, Codex CLI, OpenCode, Hermes Agent and more – can talk to
your local model, and strata connect prints the setup for your tool.
It is also the base engine other projects fork into narrower builds.
We install and tune Strata on hardware you own across Perpinyà, Girona
and Barcelona. Ask: privatelocalai@proton.me. Source:
https://github.com/Niko1221/Strata
Top comments (0)