DEV Community

vmodal_ai
vmodal_ai

Posted on

Kotlin + NVIDIA Jetson: Building a Physical AI Robot Digital-Twin Dashboard

Kotlin + NVIDIA Jetson: Building a Physical AI Robot Digital-Twin Dashboard

A digital-twin dashboard gives operators a live software representation of a physical robot. NVIDIA provides Isaac Sim for physically based robotics simulation, while Jetson can host edge AI workloads for deployment.

Architecture 

             Digital Twin
                 |
        +--------+--------+
        |                 |
   Isaac Sim          Android
        |              Kotlin
        |                 |
        +------ API ------+
                 |
              Jetson
                 |
               ROS 2
                 |
              Robot
Enter fullscreen mode Exit fullscreen mode

1. Define the twin state 

data class DigitalTwinState(
    val positionX: Double,
    val positionY: Double,
    val heading: Double,
    val battery: Int,
    val mode: String
)
Enter fullscreen mode Exit fullscreen mode

2. Synchronize state

The Jetson or robotics gateway can publish the robot's latest state.

Robot sensors
     ↓
ROS 2
     ↓
State aggregator
     ↓
Gateway
     ↓
Kotlin StateFlow
Enter fullscreen mode Exit fullscreen mode

3. Build a Compose representation

Start with a 2D top-down representation before attempting a complete 3D renderer.

@Composable
fun RobotMarker(x: Float, y: Float) {
    Box(
        modifier = Modifier.offset(
            x = x.dp,
            y = y.dp
        )
    ) {
        Text("🤖")
    }
}
Enter fullscreen mode Exit fullscreen mode

4. Simulation-first development

Use simulation to test:

  • Navigation goals
  • Sensor data
  • Obstacle scenarios
  • UI state transitions
  • Network failures
  • Autonomous task workflows

NVIDIA Isaac Sim is designed for physically based simulation and robotics development.

5. Connect simulation and Android

Use the same high-level gateway API for simulation and hardware:

Android
   ↓
Robot API
   ↓
+------------------+
| Simulation       |
| OR               |
| Physical Jetson  |
+------------------+
Enter fullscreen mode Exit fullscreen mode

This reduces changes required when moving from simulation to physical testing.

6. Add replay

Record state streams and replay them into the Android application. This lets developers reproduce UI bugs without having a robot connected.

7. Deployment considerations

Keep environment-specific settings outside the application binary:

development
staging
production
Enter fullscreen mode Exit fullscreen mode

Use authenticated connections and never hard-code production credentials in the APK.

Conclusion

A Kotlin digital-twin dashboard can bridge simulation, edge AI, and physical robot operations. Isaac Sim can support simulation and validation, while Jetson provides the edge-computing platform for deployed robotics workloads.

References

Useful Links

Website: www.v-modal.com

SDK Flutter: https://github.com/v-modal/vmodal_sdk_flutter

SDK Android: https://github.com/v-modal/vmodal_sdk_android

Discord: https://discord.gg/K72z28KUx

Reddit: https://www.reddit.com/r/v_modal/

Top comments (0)