DEV Community

Cover image for NVIDIA's new Jetson Orin Nano Developer Kit
Jon Exume
Jon Exume

Posted on

NVIDIA's new Jetson Orin Nano Developer Kit

Yo, tech fam! NVIDIA just dropped a bomb on the AI world, and it's time to get hyped about the Jetson Orin Nano Super Developer Kit. This ain't your average upgrade - we're talking a serious power boost that's gonna change the game for edge AI.

The Glow Up

NVIDIA took their already dope Jetson Orin Nano and gave it superpowers:

  • Performance jumped up to 1.7x for generative AI models
  • Cranked up to 67 Sparse TOPs from 40
  • Memory bandwidth skyrocketed to 102 GB/s
  • CPU clock speed hit 1.7 GHz
  • And they slashed the price to $249!

All this without changing the hardware. It's like your ride got a nitrous boost for free.

AI Beast Mode

This little monster can now handle LLMs, VLMs, and ViTs like a champ. We're talking models with up to 8B parameters, like Llama-3.1-8B. It's packing the same frameworks as the big boys - HuggingFace, Ollama, TensorRT-LLM, you name it.

Benchmark Flex

NVIDIA ran the numbers, and the results are fire:

  • LLMs like Llama and Gemma are seeing up to 1.63x speedups
  • VLMs got a boost up to 2.04x faster
  • ViTs are flying with up to 1.69x performance gains

Get in the Game

Wanna unlock this power? It's easy:

  1. Grab the new SD Card image from the JetPack SDK page
  2. Follow the Getting Started Guide
  3. Once you're in, hit it with this command to unleash the beast:
   sudo nvpmodel -m 2
Enter fullscreen mode Exit fullscreen mode

Level Up Your AI Game

NVIDIA's hooking it up with tutorials and pre-built containers in the Jetson AI Lab. Whether you're into robotics or want to build your own AI chatbot, they've got you covered.

The Future is Now

This ain't just an upgrade, it's a revolution for edge AI. NVIDIA's extending support for Jetson Orin through 2032, so you know this tech is here to stay.

Don't sleep on this, fam. The Jetson Orin Nano Super Developer Kit is your ticket to the AI future. Whether you're a seasoned dev or just starting out, now's the time to jump in and start building the next big thing in edge AI.

References:
[1] https://ppl-ai-file-upload.s3.amazonaws.com/web/direct-files/28408123/92445b89-cdab-48a6-9e4e-6966567285fd/Investor-Showcase-Presentation-1.pdf
[2] https://developer.nvidia.com/blog/nvidia-jetson-orin-nano-developer-kit-gets-a-super-boost/
[3] https://developer.nvidia.com/blog/nvidia-jetson-orin-nano-developer-kit-gets-a-super-boost/

Top comments (0)