DEV Community

vmodal_ai
vmodal_ai

Posted on

Building an Offline-First Robot Control App with Kotlin

Building an Offline-First Robot Control App with Kotlin

What You Will Build

In this tutorial, you will build a practical Kotlin/Android component for a robotics or Physical AI system. The design emphasizes asynchronous processing, lifecycle-aware state, real-time data handling, observability, and safe separation between the Android interface and physical robot control.

Architecture

Android Kotlin + Jetpack Compose
             ↓
       ViewModel / Flow
             ↓
      Repository / API
             ↓
   ROS 2 / Jetson / AI Backend
             ↓
        Robot System
Enter fullscreen mode Exit fullscreen mode

Step 1 — Define local robot state

data class LocalRobotState(
    val connected: Boolean = false,
    val pendingCommands: List<String> = emptyList()
)
Enter fullscreen mode Exit fullscreen mode

Step 2 — Cache the latest known state

Use a local persistence layer appropriate to your application so the UI can open without a network connection.

Step 3 — Queue commands

data class PendingCommand(
    val id: String,
    val command: String,
    val createdAt: Long
)
Enter fullscreen mode Exit fullscreen mode

Step 4 — Sync when connected

if (connected) {
    pendingCommands.forEach { send(it) }
}
Enter fullscreen mode Exit fullscreen mode

Step 5 — Make commands idempotent

Use unique command IDs so a reconnect does not accidentally execute the same command twice.

Step 6 — Define offline limits

Do not allow dangerous physical actions to queue indefinitely while disconnected. Some commands should be disabled entirely when the robot cannot be verified as connected.

Step 7 — Show connection state

Make it obvious whether the user is operating the live robot, viewing cached information, or waiting for synchronization.

Performance Checklist

  • Keep CPU-heavy work off the main thread.
  • Use bounded buffers for high-rate streams.
  • Prefer StateFlow for observable UI state.
  • Sample high-frequency telemetry before rendering.
  • Measure end-to-end latency instead of only model latency.
  • Handle reconnects and stale data explicitly.
  • Keep emergency controls independent of high-bandwidth streams.

Testing Checklist

  1. Test with no network connection.
  2. Test reconnect and duplicate messages.
  3. Test high-rate telemetry.
  4. Test lifecycle cancellation.
  5. Test low battery and degraded network conditions.
  6. Test emergency-stop behavior.
  7. Verify that AI-generated instructions cannot bypass the deterministic safety layer.

Conclusion

The resulting Kotlin layer can be extended with real ROS 2 bridges, NVIDIA Jetson services, computer vision models, smart-glasses SDKs, or multimodal AI backends. Keep hardware-specific code behind interfaces so the Android application remains maintainable as the robotics stack evolves.

Useful Links

Website: www.v-modal.com

SDK Flutter: https://github.com/v-modal/vmodal_sdk_flutter

SDK Android: https://github.com/v-modal/vmodal_sdk_android

Discord: https://discord.gg/K72z28KUx

Reddit: https://www.reddit.com/r/v_modal/

Top comments (0)