[Codename: Project V.I.B.E (visual interpretation of behavior and emotion)] Part 1

🧠 AI-Powered Human Activity & Emotion Recognition System
July 4th, 2025

🔧 Python Modules Used (as of 4th July 2025)
DeepFace – For emotion, age, gender, and race detection

OpenCV – Capturing video streams and general image processing

MediaPipe – Real-time pose, face, and hand tracking

NumPy – Image arrays, mathematical operations, and performance optimization

Pandas – Storing and processing structured detection data

datetime – For extracting and formatting timestamps

os / pathlib – Robust file and path handling

⚠️ Planned Feature: Considering adding sign language detection in the future using hand landmark analysis.

🧠 Project Overview
I'm developing an AI-driven human activity and emotion recognition system that combines real-time computer vision with machine learning to analyze behavior from live webcam feeds.

The pipeline begins with person detection and pose estimation using OpenCV and MediaPipe’s BlazePose module, which extracts 33 body landmarks per frame. These are used to infer postural states such as standing, sitting, walking, etc. Once the person is detected, the system triggers a facial detection module to isolate and analyze facial regions.

Using DeepFace, the system then infers:

🧠 Emotional state

🧓 Estimated age

🧑 Gender

🌎 Race

🆔 (Optionally) identity using facial embeddings

The architecture is optimized for live inference, utilizing NumPy for efficient frame management and buffering, and parallel processing where possible to maintain responsiveness. Data from each frame is logged with pandas for later analysis, and time-tagged using datetime utilities. File structure and output management is handled using os and pathlib for OS-level compatibility.

🎥 Devlog & Behind-the-Scenes
I've been documenting the build process and plan to release a YouTube video soon that showcases the development journey, complete with timelapses, breakdowns, and a slightly chaotic (but fun) commentary. Hope to see you guys there!