etcGrab Cube — My Browser-Based VR Full-Body Tracking System

🚀 etcGrab Cube — My Browser-Based VR Full-Body Tracking System
GitHub: https://github.com/Sami9889/hand-grab-cube

I’ve been working on a project called etcGrab Cube, a fully modular VR-ready system for full-body tracking, hand tracking, face tracking, ragdoll physics, and advanced avatar animation — all running directly in the browser with no extra hardware.

The system combines MediaPipe Pose, Hands, and FaceMesh with three.js to deliver real-time 3D motion capture, expressive avatars, and interactive VR experiences. My goal with this project is to push what’s possible using only a camera and the web.

⸻

🌟 What etcGrab Cube Can Do

🔥 Full-Body Tracking
Captures your movement through MediaPipe Pose, supports world landmarks, and stays stable during fast motion, jumping, or partial visibility.

🖐 Hand & Finger Tracking + Gesture Detection
Tracks fingers, pinch/grab gestures, double pinches, and presence/loss of hands. Perfect for interactions, UI control, and gameplay systems.

🙂 Face Tracking
FaceMesh adds facial landmark tracking for expressions, avatar reactions, and more.

🎥 Multi-Camera Fusion
Supports multiple webcams at once for improved 3D accuracy, depth estimation, and a better understanding of body position in space.

🧍 Modular Advanced Avatar
Includes a detailed avatar with expressive motion, accessories, animation layers, outlines, smoothing, and modular components you can swap or extend.

🧩 Ragdoll Physics
Toggle ragdoll mode anytime. The system smoothly blends between physics simulation and tracked movement for realistic falling and interaction.

🎮 WebXR VR Support
Enter VR directly in the browser. Supports VR controllers, tracked hands (if available), and haptics for interaction feedback.

🛠 Full UI Controls
Everything is adjustable:
• Ragdoll
• VR mode
• HUD overlays
• Tracking mode
• Smoothing
• Low-perf mode
• Multi-camera selection
• Snapshot capture

🪄 Gesture & Interaction Events
High-level events fire for pinches, releases, hand presence, double-pinches, and more, making integration with apps, games, and tools seamless.

📸 Snapshot & Debug Tools
Capture the 3D scene, view tracking overlays, and debug pose/hand/face landmarks.

🎞 Camera Fallback Mode
Use a test video input when no real camera is available.

🔒 Robust Error Handling
Handles camera permissions, disconnects, and performance gracefully for a smooth experience.

⸻

🎯 Why I Built It

I wanted a lightweight, browser-based full-body tracking system that:
• Doesn’t require VR trackers
• Doesn’t need special gloves or sensors
• Works with a laptop webcam or multiple cameras
• Supports VR and physics
• Can become a base for future games, tools, and creative experiments

etcGrab Cube is my solution — a flexible foundation for VR, animation, motion capture, and interactive 3D.

⸻

🔗 GitHub Repository

https://github.com/Sami9889/hand-grab-cube

If you’re into VR, tracking, or web-based 3D, feel free to check it out, fork it, or reach out with ideas!