Mohammed Ali Chherawalla

Posted on Oct 27 Originally published at getoffgridai.co

How to Find AI Models Your iPhone Can Actually Run in 2026 (No Failed Downloads)

#ai #iphone #llm #privacy

You find a model on Hugging Face, wait for a 5 GB download on your iPhone, and then it will not load: too big for the phone's memory, or a format the app cannot run yet. Off Grid AI Mobile (OGAM) now removes those results before you tap download. Model search on your iPhone lists only models it can load, shows each model once instead of a page of copies, and marks the files that only just fit.

What you need

An iPhone on iOS 17 or later. What search shows depends on your iPhone's RAM, so a 6 GB iPhone and a 12 GB iPhone 17 Pro Max get different results.
OGAM 0.0.117 or later from the App Store. The search changes arrived in 0.0.116 and 0.0.117, and 0.0.117 reached the App Store on 2026-10-23. Download OGAM for iPhone.
Wi-Fi or mobile data while you search and download. After the download, the model runs on your iPhone's GPU through Metal, with no connection.
No account and no payment. Search is part of the free app.

How search decides what your iPhone can run

The app uses one rule everywhere it offers a model: the picks, the size list on a model's page, and the warning before a load.

iOS does not give one app all of the phone's memory, and a running model needs more than its file size: the weights, plus the cache that holds your conversation. The app's phone budget comes from a measurement on a 12 GB iPhone 17 Pro Max: Gemma 4 E4B, a 4.64 GB download, needed 6.4 GB at a 4K context, about 1.4 times its file size. From that, in OGAM 0.0.117:

A file under 36% of your iPhone's RAM runs well.
A file between 36% and 50% of your RAM is marked Tight.
A file over 50% of your RAM is not offered.

iPhone RAM	Runs well	Tight	Hidden
6 GB	under 2.2 GB	2.2 to 3 GB	over 3 GB
8 GB	under 2.9 GB	2.9 to 4 GB	over 4 GB
12 GB	under 4.3 GB	4.3 to 6 GB	over 6 GB

The app uses the RAM iOS reports, which is a little under the number on the box. A 12 GB iPhone 17 Pro Max reports 11.2 GB, so its limits sit slightly below the last row.

Hugging Face search results do not carry file sizes, so the list judges them by parameter count at 4-bit, about 0.6 GB per billion parameters. A 7B model works out at about 4.2 GB, so it does not appear on an 8 GB iPhone. A 9B model, at about 5.4 GB, does appear on a 12 GB iPhone.

Size is not the only check. Some new models need a newer llama.cpp engine than the one inside your version of the app, and every upload of those models is left out, so you do not download something that fails to load. Files that only speed up another model (draft and MTP files) are not offered as models. Image generators stay on the Image tab and do not show in chat search.

Step 1: Search

Open OGAM and tap Models in the tab bar.
Stay on the Text tab and tap the Search models field.
Type a model or maker, for example qwen, gemma or lfm. Results appear half a second after you stop typing, or when you tap search on the keyboard.

Matching models from the app's own catalog come first. Hugging Face results follow, up to 30 per search, and a model already in the curated list is not repeated.

Step 2: Read the cards

Each result is one model, not one upload. When several people uploaded the same model, you see it once, led by the most trusted upload, with a +N uploads chip that counts the others.

Beyond the name, maker and size, a card can show:

MoE · 3B active: a mixture-of-experts model. The active size sets its speed, so a large MoE model can reply like a much smaller one. It still needs memory for its full size.
Newer: [model name]: a newer model replaces this one. Older models are listed last.
Research licence: the model's licence does not allow commercial use.

Abliterated and uncensored uploads are not shown.

Step 3: Narrow the list

Next to the search field are three icons.

Tap the lightning icon to sort. Smart is the default. For You puts the best fit for your iPhone's RAM first. Size, Downloads and Newest do what they say.
Tap the sliders icon to open the filters:
- Org: the maker. The list is OpenBMB, Qwen, Llama, Google, Microsoft, Mistral, DeepSeek, HuggingFace, NVIDIA and Liquid AI. Pick a maker without typing anything and the app lists that maker's curated models, then its Hugging Face models.
- Type: Text, Vision or Code. Vision finds models that read photos and screenshots.
- Source: LM Studio, Official, Verified or Community, by who uploaded the files.
- Size: < 1B, 1-3B, 3-8B or 8B+ parameters.
- Quant: a quantization, such as Q4_K_M or Q8_0.
Tap Clear to remove all filters. A dot on an icon means a sort or filter is on.

The third icon, Import local file, opens the Files picker if you already have a GGUF file on your iPhone.

Step 4: Pick a size and download

Tap a result. Its page shows the description, downloads and likes, then Sizes.
Sizes shows up to three files in plain words: Recommended (the best file for your iPhone, listed first), Smaller and Best.
Tap All files to see every file your iPhone can run, and Fewer sizes to go back. Files over your iPhone's limit are in neither list.
A file marked Tight loads, but leaves little room for a long chat or other apps. Pick the next size down if you switch apps often.
Tap download. When it finishes, the app offers Chat now.

What this does not do

It does not measure speed. A model that fits can still be slow on an older chip. After the download, Use fastest settings on the model's settings screen tests the options your iPhone can run and keeps the fastest.
It does not check free storage while you search. The app checks space when the download starts and tells you how much it needs and how much is free.
The fit check uses total RAM, not what is free right now. If other apps hold a lot of memory, a Tight model can still fail to load. When that happens, your current model stays loaded.
Hugging Face results stop at 30 per search. Make the search more specific or add a filter to reach others.

FAQ

Why can't I find a model on my iPhone that I saw on Hugging Face?
It is over half of your iPhone's RAM, it needs a newer engine than your app version has, or it is an image generator, which lives on the Image tab. Abliterated and uncensored uploads are also hidden.

What is the biggest AI model an iPhone can run?
In OGAM 0.0.117, search offers files up to half of the RAM iOS reports: about 3 GB on a 6 GB iPhone, 4 GB on an 8 GB iPhone and just under 6 GB on a 12 GB iPhone 17 Pro Max. At 4-bit, that is up to about 4B, 6B and 9B parameters.

What does Tight mean in Off Grid AI on iPhone?
The file is between 36% and 50% of your iPhone's RAM. It loads, but there is little memory left, so a long conversation or switching apps can cause trouble. A smaller size is steadier.

What does "3B active" mean on an MoE model?
It is a mixture-of-experts model that uses 3 billion parameters per token, so it replies at about the speed of a 3B model. It still needs memory for all of its parameters.

Why does a model show "+3 uploads"?
Three other people uploaded the same model. The app shows the most trusted upload and counts the rest, so the list does not fill with copies.

Can I search for Liquid AI models on iPhone?
Yes. Open the filters, tap Org and pick Liquid AI, or type lfm in the search field.

DEV Community