malags and GitHub
68189d1c04
[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) ( #15000 )
...
* Improved performance by reducing complexity
* Improved logic to prevent memory from increasing too much, added test
* Restore indent
* Restore indent
* Added type annotation
* Updated test to correctly initialize the expiration_heap
2025-09-30 16:49:35 -07:00
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set ( #14869 )
...
* Initial plan
* Fix InMemoryCache unbounded growth issue when TTLs are set
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-24 11:54:06 -07:00
Michal Otmianowski
c444263e7d
verify expires field prior to serving cache entry
2025-08-25 10:42:12 +02:00
Michal Otmianowski
a6f052882b
fix test
2025-08-21 12:10:29 +02:00
Michal Otmianowski
feae09da5d
minor adjustments
2025-08-21 11:33:11 +02:00
Michal Otmianowski
5dd7e00127
formatting adjustments
2025-08-21 11:27:12 +02:00
Michal Otmianowski
08c942c306
refactor tests
2025-08-21 10:38:43 +02:00
Michal Otmianowski
744dca1dc3
init asyc implementation
2025-08-21 10:22:54 +02:00
Michal Otmianowski
405e74ec16
use namespace as prefix in s3
2025-08-18 13:43:51 +02:00
Pascal Bro and GitHub
a17d483c89
Add GCS bucket caching support ( #13122 )
2025-08-04 16:09:33 -07:00
Ishaan Jaff
311d356520
test_qdrant_semantic_cache_async_set_cache
2025-07-19 15:59:56 -07:00
Brian Caswell and GitHub
45605f8362
add azure blob cache support ( #12587 )
...
* add support for Azure Blob caching
* add integration tests
* address feedback
2025-07-15 11:47:38 -07:00
Krish Dholakia and GitHub
db23016536
fix(redis_cache.py): support pipeline redis lpop for older redis vers… ( #11425 )
...
* fix(redis_cache.py): support pipeline redis lpop for older redis versions
Fixes https://github.com/BerriAI/litellm/issues/10379
* test: add mock host
2025-06-05 00:05:54 -07:00
Krish Dholakia and GitHub
ba39f9e360
Helicone base url support + fix for embedding cache hits on str input ( #11211 )
...
* fix(helicone.py): add helicone api base support
Fixes https://github.com/BerriAI/litellm/issues/10825
* test: add unit test for cache hit response on embedding calls
* fix(caching_handler.py): fix handling cache hit on embedding when input is string
Fixes LIT-197
* docs(helicone_integration.md): document new helicone api base param
2025-05-28 22:02:55 -07:00
Krish Dholakia and GitHub
ef42461c1e
Litellm fix GitHub action testing ( #11163 )
...
* test: add __init__.py files
* refactor: rename test folder to avoid naming conflict
* test: update workflows
* test: update tests
* test: update imports
* test: update tests
* test: remove unused import
* ci(test-litellm.yml): add pytest retry to github workflow
* test: fix test
2025-05-26 14:41:42 -07:00
