AI Safety
Given today's concerns about AI safety and data integrity I believe that locally hosted autonomous AI solutions will become more attractive to business.
Air Gapped AI Solutions
AI solutions that require no connection to the outside world offer many advantages over cloud based AI.
Security and Cost
An air gapped AI solution is secure from external influences (hacking). Having no API, or token usage costs it also has the benefit of being cheaper to run.
Hardware
The hardware required is proportional to the reasoning and cognitive effort required. My research suggests that 50%+ of everyday office admin and T1 support functions can be carried out by small open source models, 8B -> 26B. Given that these LLM's can run on GPU's with as little as 8GB of VRAM, we are talking about commercial AI solutions that can run on a mid to high end PC.
My Invitation
Based on the philosophies above, I've recently developed Dabnis AI and would like to create a group of Dev's to advance this work into the open source environment. If you have an interest then please feel free to contact me for more info.
Future Posts
Based on feedback I will add more detailed posts in the future.
Top comments (0)