[QUESTION] : tool search tool ' : persistent context usage #355
Description
Your Question
If I am not wrong , looking at the custom tool search tool with embedding, once the tool has been "selected" it stays in the conversation history
https://github.com/anthropics/claude-cookbooks/blob/main/tool_use/tool_search_with_embeddings.ipynb
This is different than how skill are managed (they are "discarded" from history after use .)
Can someone confirm this ?
If confirmed , question is why tool stay in history (hence occupying space in context for the rest of the conversation) .?
My answer is that : because tools have parameters !
Try in the cookbook example for custom tool search tool to:
- do not put in history the search tool call/ and the tool search tool result (the tool matching schema)
- change question from. "How is the weather in London" to "how is the weather" (needs follow up question)
Result : when the LLM has tbe tool definition it has not the tool parameter , them it asks for parameter (city) to user, user reply "London" , but using "London" as text search, the tool search tool does not find the weather tool :(
Happy if someone confirm / or not my reasoning
Related Notebook (if applicable)
No response
What I've Tried
No response
Additional Context
No response