Categories of Submission for the AssemblyAI Challenge :
- No More Monkey Business 🙈
- Really Rad Real-Time 🤖
Team 👥 : @neilblaze & @rds_agi
What We Built
Kleio is a bleeding-edge SaaS AI solution that enhances your meeting experience. Our platform seamlessly integrates with your video conferencing tools to capture, analyze, and distill the essence of your meetings into clear, concise, and actionable formats ✨
And it's much much more than that! Check out the video below 👇🏻
Demo Video ▶️
App Tryout Link 🔗
Kleio 👉 kleio.vercel.app / [Deployed on Vercel ▲]
How does it Work?
Kleio operates through a browser extension that, upon user authentication and consent, integrates with Google Meet sessions to capture audio streams. The system implements dual processing: primary audio segments are stored in Cloudflare R2 Datastore and processed through AssemblyAI's speech-to-text engine, while a fallback mechanism leverages the WebSpeech API to store temporary caption snapshots in IndexDB. Real-time processing via AssemblyAI's LeMUR generates contextual summarization, analytics, sentiments, and mindmaps, all accessible through an end-to-end encrypted Next.js dashboard built with ShadCN UI components. The dashboard enables real-time querying and converts discussions into AI-generated handwritten study notes, with all insights available immediately post-meeting.
Features 🎠
- AI-Powered Intelligent Transcription with advanced speech-to-text technology
- Automatic Meeting Summary Generation highlighting key points and action items
- One-Click Presentation Creation transforming meetings into professional slides
- Comprehensive Meeting Analytics tracking participation, patterns, and productivity
- Smart Handwritten Answer Note Generation (especially useful for students)
- Seamless Platform Integration, supports Google Meet, MSFT Teams, and Zoom (Web)
- Custom Chrome Extension for ease of access!
- Real-Time Meeting Transcript Analysis
- Enterprise-Grade Security with E2E Encryption
- Scalable Infrastructure supporting meetings of all sizes
- Instant Insights Delivery through intuitive web application
- Instant Collaborative Sharing of Meeting Insights
Target Audience 👥
- Students
- Business Professionals
- Startups
- Enterprise Teams
- Remote Workers
- Collaborative Teams
So, how's AssemblyAI's LeMUR being used here? 🤔
- Automatic transcription of audio recordings
- Generating context-aware answers to specific questions
- Supporting multiple question formats
- Handling predefined answer options
- Processing spoken data with intelligent retrieval
- Extracting insights from meeting transcripts
- Enabling Q&A functionality on audio content
- Flexible summarization of meeting discussions
Design 🎨
We were heavily inspired by the revised version of Double Diamond design process, a model popularized by the British Design Council, which not only includes visual design, but a full-fledged research cycle in which you must discover and define your problem before tackling your solution & then finally deploy it.
- Discover: a deep dive into the problem we are trying to solve.
- Define: synthesizing the information from the discovery phase into a problem definition.
- Develop: think up solutions to the problem.
- Deliver: pick the best solution and build that.
Moreover, we utilized design tools like Figma & Photoshop to prototype our designs before doing any coding. Through this, we are able to get iterative feedback so that we spend less time re-writing code.
🟦 GitHub Repository: https://github.com/H4CK4TH0N/kleio
To run the app locally, follow this guide.
🟦 License: MIT
What's next? 🚀
We believe that our App has great potential. We just really want this project to have a positive impact on people's lives! We would love to make it more cross-platform and multilingual so that the user interaction increases to a great extent!
Conclusion 🐣
It has been all fun, and we got to learn so many things in such a short span 🙌. Thank you #DEV #DEVCommunity & #AssemblyAI for hosting this hackathon! 💙
Top comments (0)