DEV Community

Rohit Mane
Rohit Mane

Posted on

LifeLens โ€“ My Multimodal Health & Wellness Companion

๐Ÿš€ LifeLens โ€“ My Multimodal Health & Wellness Companion

This is a submission for the Google AI Studio Multimodal Challenge

What I Built

I built LifeLens, a personal health & wellness companion applet powered by Geminiโ€™s multimodal intelligence.

Instead of juggling separate apps for food logging, fitness, and mood tracking, LifeLens lets you:

๐Ÿ“ธ Snap a meal photo โ†’ Get calorie & nutrition breakdown

๐Ÿ‹๏ธ Upload a workout photo/selfie โ†’ Detect exercise type and duration

๐ŸŽ™ Record a voice note โ†’ Analyze mood, stress, or energy levels

โœ๏ธ Write a quick journal entry โ†’ Extract lifestyle insights (e.g., sleep quality, focus)

At the end of each day, Gemini compiles everything into a personalized daily health snapshot โ€” a simple, infographic-style report that shows nutrition, activity, and mood in one place.

The goal: make health tracking frictionless and holistic, using natural inputs (photo, voice, text).

Demo

๐ŸŒ Live App (Cloud Run):

๐ŸŽฅ Demo Video:

๐Ÿ–ผ Screenshots:

Meal photo โ†’ nutrition analysis

Workout photo โ†’ activity detection

Voice note โ†’ stress/mood insights

Final daily health report (infographic)

How I Used Google AI Studio

I used Google AI Studio with Gemini 2.5 to power all the multimodal intelligence in LifeLens:

Image understanding โ†’ Meal & workout detection

Audio analysis โ†’ Emotional tone & mood recognition

Text extraction โ†’ Journaling insights + summarization

Multimodal fusion โ†’ Combine all three inputs into one personalized daily report

The best part is that Gemini can process mixed inputs in a single prompt, so the final report feels contextual and cohesive rather than three disconnected analyses.

Multimodal Features

Hereโ€™s how multimodality shines in LifeLens:

๐Ÿ“ธ Food recognition โ€“ Instead of manually typing calories, just take a picture.

๐Ÿ‹๏ธ Exercise recognition โ€“ Gemini detects workouts visually.

๐ŸŽ™ Mood detection โ€“ Voice notes capture feelings more authentically than typing.

โœ๏ธ Lifestyle journaling โ€“ Short reflections provide context Gemini can analyze.

๐Ÿ“Š Daily Health Report โ€“ Combines everything into a single, easy-to-read summary (optionally with an AI-generated infographic).

Together, these make LifeLens a natural and engaging way to track health, lowering the barrier for consistent use.

Why It Matters

Most people abandon health apps because logging feels like work.

LifeLens makes tracking feel like living your day normally: take a picture, talk to your phone, write a sentence.

Gemini does the heavy lifting, turning it into insightful, actionable feedback.

Roadmap

If I expand this applet further, Iโ€™d add:

๐Ÿ“ฑ Wearable integration (steps, heart rate, sleep)

๐ŸŽฎ Gamification with streaks & achievements

๐ŸŒ Multilingual support for accessibility

๐Ÿค Community features for sharing anonymized health highlights

Team

Solo project by @rohitsmane57-glitch

Top comments (0)