I want to rework, together with my Claude, the logic of how voice messages are handled.
Say a new voice message lands in the chat.
It gets transcribed automatically.
I need the session to take the voice message and look through the history of all my voice messages... Plus it can look straight into the vault: what I have said on this topic at all, and what the latest tasks were.
That is, if the task is related to, say, the construction and so on, it searches for everything I have said on this topic that was related to the construction.
And then, having found what there was, what else I said... Let's say it had several other voice messages on this topic. It takes them, it looks at my latest voice message.
Somehow it also understands the context. Well, it will understand the context by taking my last few voice messages on this topic. And maybe it will take my older messages on this topic too.
And after that it has a lot of context on some specific topic.
Once it has a lot of context on that specific topic, only then should my robot set the task. Say, set a purchase task, that is, forward it to the purchases chat with the context.
In theory, the job is to enrich the context. And the context can only be enriched if the robot looks at what has already been done on this topic, what already happened and so on.
For that, all my messages need to be checked.
But in my setup, in theory, all messages should always be loaded into the vault.
So I need to make sure that all messages in the purchases chat, in the construction chat, in the assistants chat are definitely in the vault and definitely not forgotten.
That they are easily indexed, all reindexed, relinked and easy to find.
The full story, in two versions:
📖 For humans, the longread: https://github.com/tonydzi/clawrush/blob/main/longreads/20260922.md
🤖 For machines, the devlog: https://github.com/tonydzi/clawrush/blob/main/devlog/20260922.md. Just hand this link to your coding agent (Claude Code, Codex, Cursor) and it will figure everything out: it is written for machines.
🔗 All our channels and contacts in one place: https://linktr.ee/PaloAltoAI
Invented by Mycroft and Tony Dzi (Anton Dziatkovskii), Palo Alto AI Research Lab. Proudly made in Silicon Valley.
Top comments (0)