Autonomous Self Hosted AI

Jonathan Parker — Wed, 23 Sep 2026 08:53:42 +0000

AI Safety

Given today's concerns about AI safety and data integrity I believe that locally hosted autonomous AI solutions will become more attractive to business.

Air Gapped AI Solutions

AI solutions that require no connection to the outside world offer many advantages over cloud based AI.

Security and Cost

An air gapped AI solution is secure from external influences (hacking). Having no API, or token usage costs it also has the benefit of being cheaper to run.

Hardware

The hardware required is proportional to the reasoning and cognitive effort required. My research suggests that 50%+ of everyday office admin and T1 support functions can be carried out by small open source models, 8B -> 26B. Given that these LLM's can run on GPU's with as little as 8GB of VRAM, we are talking about commercial AI solutions that can run on a mid to high end PC.

My Invitation

Based on the philosophies above, I've recently developed Dabnis AI and would like to create a group of Dev's to advance this work into the open source environment. If you have an interest then please feel free to contact me for more info.

Future Posts

Based on feedback I will add more detailed posts in the future.

Windows 11 does not support generate on

Jonathan Parker — Tue, 08 Oct 2024 15:39:28 +0000

I have tried these models so far and both give the same error when I try to run:
ollama run mxbai-embed-large
ollama run nomic-embed-text

Fairly new to this so I'm expecting that it's a NOOB issue :)

Thanks in advance

DEV Community: Jonathan Parker