Run Gemma 4 models on embedded devices (Orange Pi 5, Raspberry Pi, etc.) using LiteRT-LM with a REST API and Web UI.

This is a submission for the Gemma 4 Challenge: Build with Gemma 4

What I Built

Run Gemma 4 models on embedded devices (Orange Pi 5, Raspberry Pi, etc.) using LiteRT-LM with a REST API and Web UI.

Demo

Code

https://git.ttcorp.net/orangepivietnam/litert-lm-orangepi

How I Used Gemma 4

I use Gemma 4 (E2B, E4B) as it really fit for the Single Board Computer like Orange PI

I am one-person-team :)