DEV Community

Cover image for Building Neo v0.1: Desktop Screen Perception & OCR Accuracy in LuxurAI Cowork
Achyut Srivastava
Achyut Srivastava

Posted on

Building Neo v0.1: Desktop Screen Perception & OCR Accuracy in LuxurAI Cowork

What We Built Today

Today, we focused on improving desktop screen perception and OCR accuracy in LuxurAI Cowork, our autonomous desktop coworker powered by the Neo v0.1 vision-language model.

The Problem We Solved

Accurate desktop screen perception is crucial for seamless automation. We needed to enhance text detection and ensure fuzzy typo tolerance for fast typing and minor errors.

How The Architecture Works

  • Neo v0.1 Vision Engine: Runs on our dedicated dual-GPU cluster, processing live desktop frames at 15 fps.
  • OCR Pipeline: Enhanced text detection with fuzzy typo tolerance.
  • Human-in-the-Loop Safety Gate: Every high-risk action requires explicit user confirmation via an overlay prompt.

Transparent Economics

LuxurAI Cowork is priced at 3 LC/min (≈ ₹0.75/minute), with a pay-as-you-go model.

How We Can Make This Better

We're optimizing Neo v0.1 for multi-monitor high-DPI setups and seeking advice on low-overhead desktop frame capture. Would love your feedback!

Try Free

Test LuxurAI Cowork Beta here: https://luxurai.in

Top comments (0)