Summary
Google has introduced Tool Retrieval for the Gemini API, a way for agents to access the tool they need at the time they need it, without loading every tool definition up front. It is now available in public preview.
What changed
Google announced on November 19, 2026, in a post on its own blog, that Tool Retrieval is now available in preview in the Gemini API.
An agent built on the Gemini API can now define hundreds or even thousands of tools, but only load the tool schemas relevant to each step. Instead of sending the full tool list at once, the model can request specific tool schemas, reducing token consumption and preventing the model from picking irrelevant tools.
Tool Retrieval has a search step: developers can use either semantic search, which looks for the tool whose description is closest to the request, or exact match search, which matches based on keywords. The tool selected by Tool Retrieval then becomes available to the model. The next step is a normal function call: if a tool is relevant, the model calls it; if not, it moves on.
Tool Retrieval is especially useful for agents with hundreds of tools, where loading all schemas would use context and tokens, and could confuse the model. In that case, the model can call tools in parallel or in sequence, as with a normal function call.
Why it matters
Tool Retrieval changes how developers should build agents in the Gemini API. Teams that have hesitated to add a new tool, because it could increase the size of the prompt, can now make tools available without making the model carry every tool schema in memory. That reduces costs and simplifies the management of agents with large tool sets, because the tool list can grow without increasing the context size on every request.
It also improves reliability: the model only sees relevant tools, so it is less likely to pick the wrong tool. The tradeoff is that developers have to add a retrieval step, but the benefit is that agents can now scale beyond a small number of tools without rethinking the whole architecture.
Sources
- Introducing Tool Retrieval in the Gemini API — Google (Official)
Top comments (0)