You told an AI assistant the budget was $600, then it proposed a $900 trip. This fictional example makes one distinction clear: what you can scroll back to see is not necessarily everything used for the next reply.
Originally published on a-samadi.com on 10 October 2026. Primary references reopened and checked on 15 October 2026 for this edition. The examples and diagrams are illustrative, not observations of a particular product.
At a glance
- Context: information available for this reply.
- Memory: selected saved information, if the app supports it.
- Training: how the model learned its underlying patterns.
What input does an AI use for each reply?
Context is the input available when a model produces a response. It can include your question, instructions, earlier messages and relevant files or tool results. The context window is a limited amount of working space. Its size depends on the model; text, images and the new answer can all consume it.
Source: Anthropic: Context windows.
A long chat may be managed by the app
A chat application can summarize earlier turns, leave some material out or retrieve past information when needed. Different products handle this differently. A visible transcript and the current input therefore need not be identical. A working desk is a useful analogy, not a literal description of storage.
Sources: Anthropic: Context windows, Effective context engineering for AI agents, Claude: Chat search and memory.
A summary can drop a detail
A shorter summary may preserve the main goal but omit an exact limit, date or decision. In the fictional example, “plan a trip” survives while “budget $600” is missing. Summarization can help a conversation continue, but the selection of what to keep matters.
Source: Anthropic: Effective context engineering.
Available does not mean correctly used
A model can overlook or misuse a detail that is still in its input. Larger context is not a guarantee of better recall or a correct answer. Losing access to a constraint and failing to follow an available constraint are different failure modes.
Sources: Anthropic: Context windows, Effective context engineering.
How does saved memory differ from current context?
Some applications save selected information across conversations or retrieve relevant earlier chats. These features depend on the product, settings and access. They are not the same as including every old message in every reply. Review important saved notes rather than assuming a complete permanent transcript is active.
Source: Claude: Chat search and memory.
A message is not an instant training step
Training adjusts a model to learn patterns. Ordinary answering, called inference, uses a trained model on current input. Sending a chat message does not itself instantly retrain the model. A service may have separate policies for later use of chat data; check its settings and terms.
Source: IBM: What is AI inference?.
Keep a short current brief
For a long task, restate the goal, hard limits and latest decisions together. Ask the assistant to list those constraints before answering, then compare the result with them. A fresh brief helps provide useful input; it cannot guarantee correctness. Check important names, dates and numbers in the final output.
Sources: Anthropic: Context windows, Effective context engineering.
The original explanation and ten-slide carousel show the mechanism visually. For an applied decision framework, explore Before You Build the AI.
About the author
Ahmadreza Samadi is a Dubai-based technology entrepreneur, Co-Founder & Technical Lead at Appraiva (Cleveland, Ohio; remote), and Co-Founder & CEO at Royal Abraj Group (Dubai).
AI assisted this adaptation and source review. No firsthand product test or measured improvement is claimed. For the weekly AI and property brief, see Start with the Decision.
Top comments (0)