3 Commits

Author	SHA1	Message	Date
malags	68189d1c04	[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000) ... * Improved performance by reducing complexity * Improved logic to prevent memory from increasing too much, added test * Restore indent * Restore indent * Added type annotation * Updated test to correctly initialize the expiration_heap	2025-09-30 16:49:35 -07:00
Copilot	1816176f9d	[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set (#14869) ... * Initial plan * Fix InMemoryCache unbounded growth issue when TTLs are set Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>	2025-09-24 11:54:06 -07:00
Krish Dholakia	ef42461c1e	Litellm fix GitHub action testing (#11163) ... * test: add __init__.py files * refactor: rename test folder to avoid naming conflict * test: update workflows * test: update tests * test: update imports * test: update tests * test: remove unused import * ci(test-litellm.yml): add pytest retry to github workflow * test: fix test	2025-05-26 14:41:42 -07:00