DEV Community

Cover image for Cooking with Google AI
Ulrike Herold
Ulrike Herold

Posted on

Cooking with Google AI

This is a submission for the Google AI Studio Multimodal Challenge

What I Built

"From Fridge to" is a web applet that helps users reduce food waste and discover new recipes. By simply uploading a photo of their refrigerator's contents, the app leverages Google's Gemini multimodal AI to identify available ingredients. It then intelligently suggests recipes that can be made with those ingredients, providing a practical solution for meal planning and utilizing existing food items.

Demo

  • Link to applet https://fromfridgeto-578201669268.europe-west1.run.app/ *

  • Start page of applet

Start page app

  • Result page of applet*

Result page - part one
Result page - part two

How I Used Google AI Studio

I leveraged Google AI Studio by integrating the Gemini 2.5 Flash/Pro model. This allowed me to utilize its powerful multimodal capabilities for both image understanding and text generation. Specifically, Gemini was used to:

  • Analyze uploaded images of fridge contents to identify and extract individual food items.
  • Generate creative and relevant recipe suggestions based on the detected ingredients.

Multimodal Features

The core multimodal features of "From Fridge to" are:

  • Image Recognition (Gemini 2.5 Flash/Pro): The application takes an image input (a photo of a fridge) and processes it using Gemini's vision capabilities to accurately identify various food items and ingredients within the image. This enhances the user experience by automating the ingredient listing process, making it quick and effortless.
  • Natural Language Generation (Gemini 2.5 Flash/Pro): Based on the identified ingredients, Gemini generates natural language recipe suggestions. This goes beyond simple keyword matching by understanding the context of the ingredients and providing coherent, actionable recipes, significantly enhancing the user's ability to utilize their existing food.

Challenges Faced:

  • Finding an idea ;-)
  • API rate limits
  • Deployment to Google Cloud (encountered some internal errors)

Top comments (0)