DEV Community

loading...
Cover image for How to Add Hand Tracking to your AR App in 15 Minutes or Less

How to Add Hand Tracking to your AR App in 15 Minutes or Less

echoAR
echoAR (www.echoAR.xyz) is a cloud platform for augmented and virtual reality (AR/VR) apps
Updated on ・2 min read

Trying to figure out how to set up hand tracking functionalities in your AR experience? This Unity demo uses echoAR’s 3D model streaming in combination with ManoMotion, a framework for hand-tracking and gesture recognition in AR. The full demo can also be found on echoAR’s GitHub.

Alt Text

Any number of models can be uploaded to the echoAR console and streamed into the app. You can tap on any detected horizontal plane to move the active model to that location, and use the button at the top of the screen to switch to the next model. The button can be tapped on via the screen, but it can also be used by placing your hand in front of the camera and making a “click” gesture behind the button, as shown below.

Register

Don’t have an API key? Make sure to register for FREE at echoAR.

Setup

You can also add your own models to the echoAR console by searching or adding your own, and they will appear when you cycle through the models. Just make sure that the number of models does not exceed the value you give to the maxModels variable of the Place on Plane script of the AR Session Origin.

Run

Build and run the AR application.

Alt Text

Learn more

Refer to our documentation to learn more about how to use Unity and echoAR.
If you want more demos of Manomotion’s technology, there are additional demos created by Manomotion in the Manomotion/Examples folder. Although these do not incorporate echoAR, they show off a lot more functionality. Please see ManoMotion’s website to see documentation and to get your own API key.

Support

Feel free to reach out at support@echoAR.xyz or join our support channel on Slack.

Demo created by Caleb Biddulph.


echoAR (http://www.echoAR.xyz; Techstars ’19) is a cloud platform for augmented reality (AR) and virtual reality (VR) that provides tools and server-side infrastructure to help developers & companies quickly build and deploy AR/VR apps and experiences.

Alt Text

Discussion (0)