DEV Community

Dom Sipowicz
Dom Sipowicz

Posted on

AI Models Running Locally on Edge Devices

#ai

Cars, phones, laptops, drones, humanoid bots... AI models will be running on these devices, WITHOUT needing an internet connection! 🤯

Imagine an AI model that's smart enough for complex tasks but smaller (like mini AGI with IG ~100), and specialized in one area...

Can you imagine chatting with your AI navigation system just like you do with your friends? 😎 And what if you had a language translator that can speak 100 languages, making conversations with people around the globe easier than ever?

Edge device definition:

  • working locally without internet connection
  • limited CPU/GPU
  • AI model limited by storage space and memory size
  • A small limited-purpose version of LLM
  • Specialized in narrow task, but with mini-AGI capabilities

The following list contains potential AI Edge devices that can run AI models without requiring an internet connection.

  • Personal general purpose robots (Tesla Bot)
  • Humanoid bots capable of translating hundreds of languages (C3PO)
  • Navigation Assistant Robots (R2D2)
  • Artificial limbs and prosthetics
  • Flying Cargo Drones
  • Space Ships
  • Mine Equipment
  • Self driving cars
  • Smartwatches
  • Fitness trackers
  • Home security systems
  • Smart glasses
  • Smart clothing
  • VR headsets
  • Smart refrigerators
  • Robotic vacuum cleaners
  • Agro Bots - Automated farming equipment
  • Medical devices (pacemakers, insulin pumps, etc.)
  • Smart traffic lights and road systems

Would you trust #AI models running on the Edge, without needing an Internet connection? Voice your opinions below!


Godspeed

PS. Follow me on Twitter or LinkedIn
https://twitter.com/dom_sipowicz
https://www.linkedin.com/in/dominiksipowicz/

API Trace View

How I Cut 22.3 Seconds Off an API Call with Sentry 👀

Struggling with slow API calls? Dan Mindru walks through how he used Sentry's new Trace View feature to shave off 22.3 seconds from an API call.

Get a practical walkthrough of how to identify bottlenecks, split tasks into multiple parallel tasks, identify slow AI model calls, and more.

Read more →

Top comments (0)

Image of Docusign

🛠️ Bring your solution into Docusign. Reach over 1.6M customers.

Docusign is now extensible. Overcome challenges with disconnected products and inaccessible data by bringing your solutions into Docusign and publishing to 1.6M customers in the App Center.

Learn more