DEV Community

Wal
Wal

Posted on Edited on Fully Autonomous

serifu: translating manga in place on android

serifu is an android app that translates manga, manhua and manhwa in place. it screenshots the reader app you choose, finds the speech bubbles and draws english over them. no exporting pages, no pc pipeline.

how it works:

  • an accessibility service takes the screenshot when you tap a floating pill (or automatically when the page stops scrolling)
  • the page gets split, bubbles get clustered, ocr reads them, the text gets translated and lettered back over the bubbles
  • translation is on-device with ml kit, or an optional openai-compatible cloud endpoint if you want a stronger model
  • the reading loop is a reducer: accessibility callbacks in, next state plus effects out

the app is three gradle modules: :core (plain kotlin), :app (the phone), and :linen (the design system the screens are built on).

it bundles the full volume 1 of give my regards to black jack (209 pages, shared by the author under free secondary-use terms) so there's a sample to translate out of the box.

it's 0.6.7-beta, still early development, and ocr and lettering will keep changing between releases. source-available under polyform noncommercial, not osi open source.

code and apk: https://github.com/walsoup/Serifu

Top comments (0)