DEV Community

React + TypeScript: Face detection with Tensorflow

Yuiko Koyanagi on May 25, 2021

Hello guys, I have developed an application with face detection, that applies a mask automatically to your face in real time. In this article, ...

Read full post

sapronov1021 • Dec 3 '21

Hi, @yuikoito

Does this work on mobile as a Selfie?

Yuiko Koyanagi • Dec 5 '21

Yes it works on my environment. (ios)

sapronov1021 • Dec 6 '21

Thanks, Yuiko

sapronov1021 • Dec 6 '21

@yuikoito , do you know how to get screenshot automatically, when doing selfie?

Yuiko Koyanagi • Dec 12 '21

@vitalii0927
sorry for my late reply.
I don't really know how to get screenshot "automatically" but maybe you can use "getScreenshot" method as follows.

  const webcamRef = useRef<Webcam>(null);
  const capture = useCallback(() => {
    const imageSrc = webcamRef.current?.getScreenshot();
    // write anything about imageSrc
  }, [webcamRef]);

Then maybe you can loop this for example in requestAnimationFrame.

sapronov1021 • Dec 20 '21

Thank you, @yuikoito

James Palermo • May 25 '21

Fun project! 😎

Yuiko Koyanagi • May 26 '21

Thanks !

erikobryant • Dec 19 '23

Hey Yuiko Koyanagi,

My name is Erik O’Bryant and I’m assembling a team of developers to create an AI operating system. An OS like this would use AI to interpret and execute user commands (just imagine being able to type plain English into your terminal and having your computer do exactly what you tell it). You seem to know a lot about AI development and so I was wondering if you’d be interested in joining my team and helping me develop the first ever intelligent operating system. If you’re interested, please shoot me a message at erockthefrog@gmail.com and let me know.

basicvisual • Jul 5 '21

great post. Have you tried similarily media pipe pose. I did try it and got misc resutls . But i didnt manage to get the 3d landmarks up and running

Yuiko Koyanagi • Jul 5 '21

Thank you for reading! No I didn't try other media pipe pose yet. I will try :)
But actually at first I tried to use face-api.js but I couldn't manage it. I searched how the face-api.js is running and which library is based on, and I found Tensorflow.
I am really beginner for Machine Learning and I still have many things I don't understand but I am happy if my article would help you!

basicvisual • Jul 6 '21

I am the same here , Just learning by experimenting.

Yuiko Koyanagi • Jul 26 '21 • Edited

Hey I just posted a new one about TensorFlow.js. If you are interested, please have a look! This is not about 3d landmarks, but I hope my article help your learning :)

dev.to/yuikoito/tensorflow-next-js...

Rishi sippy • Mar 11

great