DEV Community

Cover image for ChatNONET (Offline/local AI Assistant) for Android
Michael Cobol Agan
Michael Cobol Agan

Posted on

ChatNONET (Offline/local AI Assistant) for Android

#ai #opensource #discuss #machinelearning

✨ Run Offline AI Chatbots on Android with ChatNONET – No Internet Needed!

🧠 ChatNONET is a fully offline Android app that uses quantized LLMs to answer your questions – fast, private, and without internet access.

🚀 What is ChatNONET?

ChatNONET is my open-source Android app that brings the power of local large language models (LLMs) to your device — no internet required. It's powered by my own fine-tuned models called NONET, built for fast, accurate, direct question answering.

Whether you're offline, privacy-conscious, or just love tinkering with AI, this app is for you.

🔧 How Does It Work?

ChatNONET uses:

  • 🔗 Fine-tuned LLMs (based on Smollm & LLaMA 3.2)
  • ⚙️ Quantized to .gguf format using llama.cpp
  • 📱 Integrated into a native Android app (built in Android Studio)
  • 🧠 Supports multiple model sizes from 135M to 3B parameters

📦 Download and Try

You can also run the model in Python using llama.cpp:

./llama-cli -m ./ChatNONET-300m-tuned-q8_0.gguf -p "You are ChatNONET AI assistant." -cnv
Enter fullscreen mode Exit fullscreen mode

🛠 Model Variants

Model Name Base Size
ChatNONET-135M Smollm 135M
ChatNONET-300M Smollm 300M
ChatNONET-1B LLaMA 3.2 1B
ChatNONET-3B LLaMA 3.2 3B

All models are quantized using q8_0 for smooth performance.

💡 Why Offline?

  • 🔐 Privacy – No data leaves your phone.
  • 🌍 Connectivity – Works even in remote areas.
  • 🚀 Speed – No server, no lag.
  • 📱 Control – You choose the model and usage.

💻 Open Source on GitHub

Want to build your own offline AI app?

👉 Check out the full ChatNONET Android source code on GitHub:
https://github.com/Mca-Tech/ChatNONET

🙋‍♂️ Who Is This For?

  • Android developers interested in AI
  • Hobbyists & privacy advocates
  • Students learning about local LLMs
  • Anyone who wants ChatGPT-like power without the cloud

I built ChatNONET to explore how far local AI can go — and the results are exciting! You don’t need powerful servers or always-on internet. You just need your curiosity, an Android phone, and a bit of model magic.

👏 Like this project?

  • Star the repo ⭐
  • Share your thoughts 💬
  • Try the app!

Thanks for reading!
— Michael Cobol Agan (McaTech)

Top comments (0)