DEV Community

Cover image for Strata – a free app and engine that runs capable AI on the machine you already own
Private Local AI
Private Local AI

Posted on Originally published at blog.localai.hex7.com

Strata – a free app and engine that runs capable AI on the machine you already own

What Strata is

Strata is a free, open-source (MIT) app and engine for running AI
locally: you chat, write code and work with images, and nothing leaves
your machine. There is no account. It ships as a desktop app for
Windows, Linux and macOS, and a terminal app – install it, then run
strata launch. On first launch the app downloads the engine built for
your specific graphics card, so there is no compiling to babysit.

Picking a model that fits

Strata recommends ISTA-DASLab quantisation packs first, then Unsloth and
other providers where a compatible model fits. The headline model is
Qwen3.8-Flash-Next, offered across many quant sizes (Q2*0, IQ2*XS,
IQ3*XXS and IQ3*S on the recommended line; UD-IQ4*XS up to Q8*0 on
Unsloth), with Qwen3.6-35B-A3B as another documented choice. Not sure
what fits? The model guide lets you pick by available memory and
compares sizes, memory needs and compatibility file by file.

Hardware it runs on

The supported list is wide: NVIDIA GeForce RTX 20-50 series, AMD Radeon
RX 7000/9000 and the AI PRO R9700, RX 6800/6900 (experimental), Intel
Arc on Linux, Apple Silicon M1 and newer, AMD Strix Halo and NVIDIA DGX
Spark. Same app, one toolchain.

The point: your other tools, kept local

Strata exposes OpenAI- and Anthropic-compatible APIs, so coding agents –
Claude Code, Codex CLI, OpenCode, Hermes Agent and more – can talk to
your local model, and strata connect prints the setup for your tool.
It is also the base engine other projects fork into narrower builds.

We install and tune Strata on hardware you own across Perpinyà, Girona
and Barcelona. Ask: privatelocalai@proton.me. Source:
https://github.com/Niko1221/Strata

Top comments (0)