DEV Community

Dom Sipowicz
Dom Sipowicz

Posted on

AI Models Running Locally on Edge Devices

#ai

Cars, phones, laptops, drones, humanoid bots... AI models will be running on these devices, WITHOUT needing an internet connection! 🤯

Imagine an AI model that's smart enough for complex tasks but smaller (like mini AGI with IG ~100), and specialized in one area...

Can you imagine chatting with your AI navigation system just like you do with your friends? 😎 And what if you had a language translator that can speak 100 languages, making conversations with people around the globe easier than ever?

Edge device definition:

  • working locally without internet connection
  • limited CPU/GPU
  • AI model limited by storage space and memory size
  • A small limited-purpose version of LLM
  • Specialized in narrow task, but with mini-AGI capabilities

The following list contains potential AI Edge devices that can run AI models without requiring an internet connection.

  • Personal general purpose robots (Tesla Bot)
  • Humanoid bots capable of translating hundreds of languages (C3PO)
  • Navigation Assistant Robots (R2D2)
  • Artificial limbs and prosthetics
  • Flying Cargo Drones
  • Space Ships
  • Mine Equipment
  • Self driving cars
  • Smartwatches
  • Fitness trackers
  • Home security systems
  • Smart glasses
  • Smart clothing
  • VR headsets
  • Smart refrigerators
  • Robotic vacuum cleaners
  • Agro Bots - Automated farming equipment
  • Medical devices (pacemakers, insulin pumps, etc.)
  • Smart traffic lights and road systems

Would you trust #AI models running on the Edge, without needing an Internet connection? Voice your opinions below!


Godspeed

PS. Follow me on Twitter or LinkedIn
https://twitter.com/dom_sipowicz
https://www.linkedin.com/in/dominiksipowicz/

AWS Q Developer image

Your AI Code Assistant

Automate your code reviews. Catch bugs before your coworkers. Fix security issues in your code. Built to handle large projects, Amazon Q Developer works alongside you from idea to production code.

Get started free in your IDE

Top comments (0)

A Workflow Copilot. Tailored to You.

Pieces.app image

Our desktop app, with its intelligent copilot, streamlines coding by generating snippets, extracting code from screenshots, and accelerating problem-solving.

Read the docs

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay