AI assistants are becoming increasingly capable, but one major limitation remains: they often don't remember what happened before.
A conversation can contain important business information, decisions, preferences, and context. Without persistent memory, that information can easily be lost.
For HackwithHyderabad 3.0, we built CodeZero, an AI assistant designed to explore how persistent memory can make AI agents more useful over time.
🧠 What is CodeZero?
CodeZero is a conversational AI application that can store relevant information from previous interactions, retrieve it when needed, and use it to provide more contextual responses.
The core of the project is Hindsight by Vectorize, which provides the persistent memory layer.
Instead of treating every interaction as completely new, CodeZero can retrieve relevant memories and use them alongside the current conversation.
💡 The Idea
Imagine you're using an AI assistant for your business.
During one conversation, you tell it:
Information about your products
Your target customers
Marketing strategies
Previous campaign decisions
Business goals
Later, you ask:
"What should we focus on for our next campaign?"
A traditional chatbot may only have access to the current conversation.
CodeZero can retrieve relevant information from previous interactions and use that context when generating its response.
That's the core idea behind our project:
AI shouldn't just answer. It should remember and learn from experience.
🧠 How Hindsight Fits In
Hindsight acts as the memory layer of CodeZero.
When a user sends a message:
User → Flutter → FastAPI → Hindsight
Hindsight retrieves memories that are relevant to the current query.
Those memories are then provided to the LLM along with the user's current message.
The LLM generates the response, and the interaction can then be stored as a new memory.
This creates a simple loop:
Remember → Retrieve → Reason → Respond → Learn
🏗️ Architecture
Our application consists of four main parts:
Frontend — Flutter
We built the user interface using Flutter.
The application provides:
User authentication
Chat interface
Multiple chat sessions
Chat history
New conversations
Persistent user accounts
Backend — FastAPI
FastAPI acts as the bridge between the Flutter application, memory system, and LLM.
It handles:
Chat requests
Memory creation
Memory retrieval
LLM requests
Storing new interactions
Memory — Hindsight
Hindsight is the most important part of the architecture.
It allows CodeZero to retrieve relevant information from previous interactions instead of relying only on the current conversation.
LLM — Ollama + Qwen
For response generation, we use Ollama with Qwen, allowing the model to run locally.
This also helped us keep the project lightweight and cost-conscious during development.
🔄 Example Workflow
A simplified request looks like this:
User
↓
Flutter App
↓
FastAPI Backend
↓
Retrieve relevant memories
↓
Hindsight
↓
Combine memory + current question
↓
Qwen
↓
AI Response
↓
Store new interaction
🎯 Our Demo
For the demonstration, we use a fictional business scenario.
We first provide CodeZero with information about the business, its customers, marketing activities, and previous decisions.
Later, we ask questions that depend on information from those earlier interactions.
CodeZero retrieves the relevant memories through Hindsight and uses them to generate a contextual response.
This demonstrates the difference between an AI that simply responds and an AI agent that can build context over time.
🛠️ Tech Stack
Frontend
Flutter
Backend
FastAPI
Python
Memory
Hindsight by Vectorize
LLM
Ollama
Qwen
Authentication & Database
Firebase Authentication
Firebase Firestore
🚀 What We Learned
Building CodeZero helped us understand that adding memory to an AI system isn't simply about storing every previous message.
The important part is being able to:
Store useful information
Retrieve relevant memories
Combine them with the current context
Let the AI decide how that information should influence its response
This is what makes persistent memory interesting for AI agents.
🔮 Future Improvements
There are several directions we would like to explore further:
More advanced memory organization
Long-term user preferences
Better business analytics
Multi-user business workspaces
More sophisticated memory retrieval
Improved agent reasoning and planning
🏆 HackwithHyderabad 3.0
CodeZero was built for the HackwithHyderabad 3.0 — AI Agents That Learn Using Hindsight challenge.
The project gave us the opportunity to explore how persistent memory can change the way we interact with AI agents.
🔗 Project Links
GitHub:
www.github.com/guru-012/codezero
Demo Video:
👨💻 Team CodeZero
Built with curiosity, experimentation, and a lot of debugging. 🚀
Top comments (0)