DEV Community

Dom Sipowicz
Dom Sipowicz

Posted on

AI Models Running Locally on Edge Devices

#ai

Cars, phones, laptops, drones, humanoid bots... AI models will be running on these devices, WITHOUT needing an internet connection! 🤯

Imagine an AI model that's smart enough for complex tasks but smaller (like mini AGI with IG ~100), and specialized in one area...

Can you imagine chatting with your AI navigation system just like you do with your friends? 😎 And what if you had a language translator that can speak 100 languages, making conversations with people around the globe easier than ever?

Edge device definition:

  • working locally without internet connection
  • limited CPU/GPU
  • AI model limited by storage space and memory size
  • A small limited-purpose version of LLM
  • Specialized in narrow task, but with mini-AGI capabilities

The following list contains potential AI Edge devices that can run AI models without requiring an internet connection.

  • Personal general purpose robots (Tesla Bot)
  • Humanoid bots capable of translating hundreds of languages (C3PO)
  • Navigation Assistant Robots (R2D2)
  • Artificial limbs and prosthetics
  • Flying Cargo Drones
  • Space Ships
  • Mine Equipment
  • Self driving cars
  • Smartwatches
  • Fitness trackers
  • Home security systems
  • Smart glasses
  • Smart clothing
  • VR headsets
  • Smart refrigerators
  • Robotic vacuum cleaners
  • Agro Bots - Automated farming equipment
  • Medical devices (pacemakers, insulin pumps, etc.)
  • Smart traffic lights and road systems

Would you trust #AI models running on the Edge, without needing an Internet connection? Voice your opinions below!


Godspeed

PS. Follow me on Twitter or LinkedIn
https://twitter.com/dom_sipowicz
https://www.linkedin.com/in/dominiksipowicz/

AWS Q Developer image

Your AI Code Assistant

Ask anything about your entire project, code and get answers and even architecture diagrams. Built to handle large projects, Amazon Q Developer works alongside you from idea to production code.

Start free in your IDE

Top comments (0)

AWS GenAI LIVE image

Real challenges. Real solutions. Real talk.

From technical discussions to philosophical debates, AWS and AWS Partners examine the impact and evolution of gen AI.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay