Discussion about this post

User's avatar
Abhishek Pan's avatar

954 paid calls down to 415 on HumanEval just from reusing settled decisions is a big chunk of an agent bill. Hashing tool name, arguments and the previous tool result per step and counting repeats over a week of traces shows how much of yours is the model re-deciding the same thing.

Ready for more?