924418aeea
fix: prune expired in-memory cache heap entries ( #25664 )
2026-04-14 23:37:49 +05:30
68189d1c04
[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) ( #15000 )
...
* Improved performance by reducing complexity
* Improved logic to prevent memory from increasing too much, added test
* Restore indent
* Restore indent
* Added type annotation
* Updated test to correctly initialize the expiration_heap
2025-09-30 16:49:35 -07:00
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set ( #14869 )
...
* Initial plan
* Fix InMemoryCache unbounded growth issue when TTLs are set
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-24 11:54:06 -07:00
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
Emerson Gomes