Commit Graph
2 Commits
Author SHA1 Message Date
Sameer Kankute 777ae4f530 Fix :test_count_tokens_caching 2026-01-10 00:57:11 +05:30
ConstantineandGitHub 3ebec39b74 fix(proxy): use async anthropic client to prevent event loop blocking (#18435)
Fixes #16716.
Previously, synchronous Anthropic client was used for token counting, which blocked the event loop.
This change switches to AsyncAnthropic and caches the client instance.
2026-01-08 23:26:46 +05:30