The latest articles on DEV Community by Fabrice Sepret (@fabricesepret). https://dev.to/fabricesepret https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1365497%2Fdd06d0c8-ba3f-490e-acb0-e6f60afda4c9.jpg https://dev.to/fabricesepret en Fabrice Sepret Tue, 19 Mar 2024 13:08:45 +0000 https://dev.to/fabricesepret/pose-estimation-track-users-motion-in-real-time-with-ease-on-any-device-4e4c https://dev.to/fabricesepret/pose-estimation-track-users-motion-in-real-time-with-ease-on-any-device-4e4c <p>PoseTracker is a real-time pose estimation SDK and API for fitness and rehab apps. It runs MoveNet on-device on React Native, iOS, Android and the web. Keypoints are free. An optional API key adds rep counting, joint angles and a form score.</p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fjko0gfmbu7un1ouy8rmn.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fjko0gfmbu7un1ouy8rmn.png" alt="PoseTracker pose estimation" width="800" height="1424"></a></p> <h2> What you get </h2> <ul> <li> <strong>17 body keypoints</strong> (COCO), from the phone camera, on the device.</li> <li> <strong>Reps, joint angles and a form score</strong> for catalog movements such as squats, lunges and push-ups, with an API key.</li> <li> <strong>Two ways to integrate it.</strong> An iframe (or a native WebView) that loads the hosted tracking page, or an npm package in your app.</li> <li> <strong>React Native, iOS, Android and the web.</strong> The React Native package runs in Expo Go.</li> </ul> <p>Keypoints do not need an API key. The free tier is 200 API calls per month for the exercise engine, for non-commercial use.</p> <p>PoseTracker is already in production apps: <a href="https://www.flexifit.app/" rel="noopener noreferrer">Flexifit</a>, <a href="https://www.kobisport.eu/" rel="noopener noreferrer">Kobi</a>, <a href="https://apps.apple.com/fr/app/how2jump-jump-higher-faster/id6755148059" rel="noopener noreferrer">How2Jump</a> and <a href="https://www.move-break.com/" rel="noopener noreferrer">MoveBreak</a>.</p> <h2> Try the iframe </h2> <p>Load the hosted page in an <code>&lt;iframe&gt;</code> or a native WebView. No npm install. Same camera, same keypoints.</p> <p><a href="https://docs.posetracker.com/webview/quickstart" rel="noopener noreferrer">https://docs.posetracker.com/webview/quickstart</a></p> <p>Which path to use: <a href="https://docs.posetracker.com/choose-integration" rel="noopener noreferrer">https://docs.posetracker.com/choose-integration</a></p> <h2> Or install the SDK </h2> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>npm <span class="nb">install</span> @pose-tracker/react-native-pose-estimation </code></pre> </div> <p>Quickstart: <a href="https://docs.posetracker.com/quickstart" rel="noopener noreferrer">https://docs.posetracker.com/quickstart</a></p> <p>Run it on a phone with Expo Go: <a href="https://docs.posetracker.com/try-expo-go" rel="noopener noreferrer">https://docs.posetracker.com/try-expo-go</a></p> tensorflow react mobile ai