An offline-first experiment in open-source AI, digital ghosts, and the stories we refuse to lose.
What I Built
What if an abandoned computer could tell stories? What if the memories we keep on our devices could live on without depending on a cloud service?
For Hacktoberfest Week 4, I’m exploring Ghost in the Machine: a local AI experience that gives forgotten digital artifacts a voice.
Inspired by Halloween and Día de los Muertos, the project explores two kinds of ghosts: the eerie personality hiding inside an old terminal and the memories of people, places, and moments that deserve to be remembered.
The goal is to create an experience that feels atmospheric and personal while keeping the underlying AI under the user's control.
Code
How I Built It
The project is designed around open-weight AI and local inference rather than a hosted, proprietary AI API.
The planned stack includes:
- Ollama to run a compatible language model locally.
- Qwen or Mistral as the conversational engine.
- Python for application logic and prompt orchestration.
- Streamlit for a lightweight interactive interface.
The model's personality comes from carefully designed system prompts, while the application controls how user input is processed and how responses are presented.
The architecture is intentionally modular. The model can be replaced, the prompts can be modified, and the interface can evolve without rebuilding the entire system around one vendor's API.
Why Does Open Innovation Matter?
For a project about memories and digital ghosts, ownership matters.
A closed AI service can be convenient, but it introduces dependencies: internet access, service availability, API costs, and policies controlled by someone else.
Building around open-weight models and local inference offers a different set of possibilities.
Privacy by design: Personal stories and family memories can stay on the user's machine instead of being sent to an external inference service.
Offline potential: Once the model and dependencies are installed, the core experience can work without an internet connection, assuming no online services are required by the application.
Freedom to experiment: Open model weights and configurable prompts make it possible to change the personality, compare models, and adapt the experience to different creative uses.
Less vendor lock-in: The project can evolve with its community instead of depending entirely on one proprietary endpoint.
Open innovation isn't just a way to reduce costs. It gives developers more control over how an AI behaves, where it runs, and who gets to use it.
For this project, that control is part of the point.
The Spirit of It
Halloween asks us to imagine what might be hiding in the machine. Día de los Muertos reminds us that remembering is itself an act of keeping something alive.
I wanted to explore both ideas through AI: not just a model that generates spooky text, but a tool whose architecture gives people greater control over the stories they share with it.
The most interesting part isn't whether the machine sounds haunted.
It's whether we can build something that remembers without asking us to give up ownership of what matters.
Top comments (0)