DEV Community

Cover image for CookFlow+: Turn Any YouTube Recipe Into a Hands-Free, Voice-Guided Cooking Experience
OtNotorious
OtNotorious Subscriber

Posted on

CookFlow+: Turn Any YouTube Recipe Into a Hands-Free, Voice-Guided Cooking Experience

#devchallenge #googleaichallenge #ai #gemini

What I Built

CookFlow+ is a cooking assistant that turns any YouTube recipe video into a hands-free, personalized cooking experience. It solves the pain of pausing, rewinding, and juggling messy hands while trying to cook along with videos.

Paste a link, and CookFlow+ gives you:

  • Structured Recipes with steps, ingredients, timestamps, and tips from the chef.

  • Smart Substitutions when you don’t have an ingredient

  • Voice-Guided Cooking so you can ask questions, or say “next step” or “repeat” while you cook

  • Video Analysis to find key moments, product mentions, and summaries

Demo

Click me to experienc3 cookflow+

1.Paste any cooking video (e.g. Gordon Ramsay’s Beef Wellington) to generate recipes

2.Use voice to navigate while cooking, swap ingredients, or ask for alternatives

3.See timestamps and highlights pulled directly from the video

Home screen

Generated recipe

Generated recipes 2

Live cooking

How I Used Google AI Studio

  • Gemini 2.5 Pro: video-to-recipe analysis

  • Gemini 2.5 Flash: Fast ingredient swaps and substitutions

  • Gemini 2.5 Flash Audio Dialog: Real-time voice assistant with interruption handling

  • Gemini 2.5 Flash Image: Step thumbnails and visual context

Example integration:

const videoPart = Part.fromUri(youtubeUrl, "video/youtube");
const result = await model.generateContent([recipePrompt, videoPart]);
Enter fullscreen mode Exit fullscreen mode

Multimodal Features

  1. Video Understanding: Extracts recipes, techniques, and timestamps directly from video.

  2. Voice Interaction: Hands-free step navigation, substitutions, and Q&A while cooking.

  3. Visual Context: Uses rear camera for progress checks and guidance.

  4. Content Enhancement: AI suggests substitutions with correct ratios and roles (fat, acid, etc.).

  5. Cross-Modal Processing: Syncs video, audio, and text into structured, easy-to-follow recipes.

Bonus features

You can:

  1. save a recipe to come back later.
  2. Export a text/json file to share with other people.

Before CookFlow+: Cooking from YouTube meant constant pausing, ingredient confusion, and messy hands.
With CookFlow+: Recipes are clear, interactive, and adaptive—your kitchen becomes fully AI-assisted.

dev.to username= "OtNotorious"

Top comments (0)