The latest articles on DEV Community by Tony Tran (@thanhtantran). https://dev.to/thanhtantran https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F735587%2Fa359bfa2-1218-44c8-bbdf-76abb9fa6ac1.jpeg https://dev.to/thanhtantran en Tony Tran Sun, 10 May 2026 10:28:56 +0000 https://dev.to/thanhtantran/run-gemma-4-models-on-embedded-devices-orange-pi-5-raspberry-pi-etc-using-litert-lm-with-a-3n09 https://dev.to/thanhtantran/run-gemma-4-models-on-embedded-devices-orange-pi-5-raspberry-pi-etc-using-litert-lm-with-a-3n09 <p><em>This is a submission for the <a href="https://dev.to/challenges/google-gemma-2026-05-06">Gemma 4 Challenge: Build with Gemma 4</a></em></p> <h2> What I Built </h2> <p>Run Gemma 4 models on embedded devices (Orange Pi 5, Raspberry Pi, etc.) using LiteRT-LM with a REST API and Web UI.</p> <h2> Demo </h2> <p> <iframe src="https://www.youtube.com/embed/TL6CGoP89j0"> </iframe> </p> <h2> Code </h2> <p><a href="https://git.ttcorp.net/orangepivietnam/litert-lm-orangepi" rel="noopener noreferrer">https://git.ttcorp.net/orangepivietnam/litert-lm-orangepi</a></p> <h2> How I Used Gemma 4 </h2> <p>I use Gemma 4 (E2B, E4B) as it really fit for the Single Board Computer like Orange PI</p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fsmbp10ymyl3yt4v6yeu1.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fsmbp10ymyl3yt4v6yeu1.png" alt=" " width="800" height="381"></a></p> <p>I am one-person-team :)</p> devchallenge gemmachallenge gemma