DEV Community

JavaScript Quickies: Controlling 3D Objects with Hands 🤯

Sarthak Sharma on July 22, 2019

Hey guys, what's up? We all at Team XenoX are really excited to inform you that we are starting a new series of articles called Javascript Quickies...
Collapse
 
elmuerte profile image
Michiel Hendriks

I have a leapmotion which is a quality IR camera with driver which is able to read hands and fingers with high precision. Sadly they have deprecated browser support. Via JavaScript you could easily read the hands and fingers and respond to thing.

I can tell you one thing. Waving your hands around for a while is quite tiring.

Collapse
 
voanhcuoc profile image
Khoa Che

I did try these handtrack devices in the browser by writing a websocket server in C++ or whatever language they provide API, then forward skelectal coordinates as JSON string. That's a pretty terrible experience, the orbit is not linear and come in zig-zag shape, doing interpolation afterward resulted in huge delays.

Any suggestion ? Thank in advance :)

Collapse
 
sarthology profile image
Sarthak Sharma

Try Three.js

Collapse
 
sarthology profile image
Sarthak Sharma

Well that can also increase arm strength 😬

Collapse
 
pavanjadhaw profile image
Pavan Jadhaw

This is so cool, just imagine the possibilities using body as input.
You don't need any fancy sensors or hardware just tiny camera which you can find almost everywhere. I am not completely sure but this can also be used for converting sign language to text or voice output. We can also build hand gesture input based game my younger brother would like it lot.

Cool and fascinating stuff.

Collapse
 
sarthology profile image
Sarthak Sharma

Let’s make something then 😊

Collapse
 
loki profile image
Loki Le DEV

Wow so cool to do this with just a webcam and a browser :)

I made something similar in 2014 with a leapmotion and a webcam in C++:

youtube.com/watch?v=8b99VDvN64M

Collapse
 
sarthology profile image
Sarthak Sharma

That awesome mannnnnn !!!!

Collapse
 
loki profile image
Loki Le DEV

Thanks!

Thread Thread
 
sarthology profile image
Sarthak Sharma

😊

Collapse
 
sharmarajat01 profile image
sharmarajat01 • Edited

woahhh !! seems to be a cool one, but, but, but, IRON-MAN's way is best :p

Collapse
 
sarthology profile image
Sarthak Sharma

Of course, He is IRON MAN.

Collapse
 
warengonzaga profile image
Waren Gonzaga

This is impressive... can I join?

Collapse
 
sarthology profile image
Sarthak Sharma

Of course 😊

Collapse
 
warengonzaga profile image
Waren Gonzaga

how can I join? where to start?

Thread Thread
 
sarthology profile image
Sarthak Sharma

Here

GitHub logo sarthology / XenoXMultiverse

🔥🚀 XenoX Assemble !!

XenoX Multiverse

We're making things official with the beginning of XenoX Multiverse. Team XenoX started as my dream, just a small team of devs working on open-source projects for the fun of it. But over the months, it has grown bigger and stronger. So with this, I want to formally announce the Team XenoX open source initiative. This is where the master list of all the projects and all the devs collaborating on XenoX will live.

If you want to be one of us, just write your name and you're in!

How to join the Team? 💪🏼

  1. Fork the repo.
  2. Add your name to this file.
  3. Submit a pull request.

That's it. You're all set. Someone from the team will contact you and formally welcome you to the team. Cheers!

The Team

  1. Sarthak Sharma 🔥
  2. Utkarsh Talwar 🎸
  3. Rajat Sharma 🎧
  4. Rajesh Mainali 🎵



Thread Thread
 
warengonzaga profile image
Waren Gonzaga

Will do!

Collapse
 
sureshmurali29 profile image
Suresh M

This looks super cool. It would be nice if handtrack.js can track hand gestures.
Thanks for the telegram channel 🙏

Collapse
 
sarthology profile image
Sarthak Sharma

I’m sure someone will build something over Handtrack.js to get that too.

😊😊

Collapse
 
somedood profile image
Basti Ortiz

It was at this moment when all the jaws in the world dropped to the floor. 😮

Collapse
 
sarthology profile image
Sarthak Sharma

😂😂😊

Collapse
 
kunalvohra profile image
Kunal Vohra

Wow, that's impressive...

How about creating a full-body gaming interface that could be a replacement for costly equipment and also, it could be enhanced for giving gesture commands to PC.

Collapse
 
sarthology profile image
Sarthak Sharma

That’s a great idea too. 🤓

Collapse
 
damxipo profile image
Damian Cipolat

Not bad, I have used your demo is interesting, I remember something similar using the leapmotion device.