The latest articles on DEV Community by Aayush K Raut (@aayuamor). https://dev.to/aayuamor https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3474484%2F57ad6924-87c5-491d-8987-c36a1366e61e.png https://dev.to/aayuamor en Aayush K Raut Sat, 13 Sep 2025 19:49:18 +0000 https://dev.to/aayuamor/videos-to-notes-app-productivity-boost-with-multimodal-ai-4fi0 https://dev.to/aayuamor/videos-to-notes-app-productivity-boost-with-multimodal-ai-4fi0 <p>_This is a submission for the Google AI Studio Multimodal Challenge<br> _<br> <strong>What I Built</strong></p> <p>I built Client Videos to Notes App, a productivity tool that converts video content into structured notes.</p> <p>The app solves the problem of information overload in video content. Instead of watching long videos and manually writing notes, users can simply upload a client video and instantly receive concise, organized notes.</p> <p><strong>This makes it especially helpful for:</strong></p> <ul> <li>Students reviewing lecture videos</li> <li>Freelancers handling client video briefs</li> <li>Professionals processing meeting recordings</li> </ul> <p><strong>Demo</strong></p> <p>GitHub Repo : <a href="https://github.com/AayuAmor/Videos_to_Notes" rel="noopener noreferrer">Videos_to_Notes_Repo</a></p> <p>Live App: <a href="https://client-videos-to-notes-app-sxmp.vercel.app/" rel="noopener noreferrer">Videos To Notes App</a></p> <p>Demo Video: <a href="https://youtu.be/0386PiWUj4c" rel="noopener noreferrer">Watch on YouTube</a></p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F7cqj0vctejlxo7yx43lf.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F7cqj0vctejlxo7yx43lf.png" alt="Use of Gemini 2.5 Pro in VS-Code" width="800" height="429"></a></p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F9vlm8b5b8u6p6uv8ffl0.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F9vlm8b5b8u6p6uv8ffl0.png" alt="Debugging with Gemini 2.5 pro" width="800" height="424"></a></p> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fb8ntv8sk5lxug6lhm3rr.png" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fb8ntv8sk5lxug6lhm3rr.png" alt="End of Free Tier of Gemini API" width="800" height="424"></a></p> <p><strong>How I Used Google AI Studio</strong></p> <p>I integrated Gemini 2.5 Pro through Google AI Studio (via GitHub Pro free tier).</p> <p><strong>Here’s how it works:</strong></p> <ol> <li><p>User uploads a video.</p></li> <li><p>Audio is extracted and passed to Gemini 2.5 Pro.</p></li> <li><p>Gemini processes the audio + video content and generates structured text notes.</p></li> <li><p>Notes are displayed in an interactive React interface.</p></li> </ol> <p><strong>Multimodal Features</strong></p> <ul> <li>Video + Audio Understanding: Gemini 2.5 Pro processes both video and audio streams.</li> <li>Text Summarization: Key insights and points are extracted automatically.</li> <li>Cross-format Processing: The app accepts multiple video formats and converts them into readable notes.</li> </ul> <p>This multimodal approach enhances the user experience by transforming complex, time-consuming video content into instantly accessible knowledge.</p> <p><strong>Notes for Judges</strong></p> <p>_This project was built solo by <a class="mentioned-user" href="https://dev.to/aayuamor">@aayuamor</a>.</p> <p>I did not use paid cloud services. Instead of Cloud Run, the app is deployed on Vercel free hosting.</p> <p>All AI functionality relies on Gemini 2.5 Pro (free tier), showcasing what’s possible even without paid APIs._</p> devchallenge googleaichallenge ai gemini