Commit Graph
6837 Commits
Author SHA1 Message Date
Krrish Dholakia 191eef06de build(requirements.txt): fix dependency 2024-02-06 14:10:56 -08:00
ishaan-jaffandKrrish Dholakia 7f870ebced (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia 3fa5bba4ea (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
Krrish Dholakia c46aca7951 refactor(main.py): trigger deploy
n
2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia 2b9a48eb6c (fix) redisvl requirements.txt issue 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia 3a5923cffa (fix) langfuse show semantic-similarity in tags 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia 8bce6d4fb2 (fix) dockerfile requirements.txt 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia d9f407b4c2 (feat) show semantic-cache on health/readiness 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia 3d1d447db9 (feat) redis-semantic cache on proxy 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia ff7d05aaef (fix) add redisvl==0.0.7 2024-02-06 13:58:20 -08:00
ishaan-jaffandKrrish Dholakia d05984ef13 (feat) working semantic cache on proxy 2024-02-06 13:58:13 -08:00
Krrish Dholakia cde96b8ba0 test(test_completion.py): fix test 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 667e006dbf (ci/cd) run again 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 548d56ac42 (fix) mark semantic caching as beta test 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia ca26ecc4dc (fix) semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 4d1b437d0a (docs) litellm semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 06ac218d9f (docs) redis cache 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia b2c78108c8 (fix) test-semantic caching 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia a8d190f507 (feat) redis-semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia ee80987c8f (docs) using semantic caching on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 63e91eb2c4 (fix) use semantic cache on proxy 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 000afc1391 allow setting redis_semantic cache_embedding model 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia 74fb4e4cba (feat) log semantic_sim to langfuse 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia e0c464cc71 (fix) add redisvl==0.0.7 2024-02-06 13:30:31 -08:00
ishaan-jaffandKrrish Dholakia a7b3148c99 (feat) working semantic cache on proxy 2024-02-06 13:30:30 -08:00
ishaan-jaffandKrrish Dholakia 2b86c3a9b4 (feat) redis-semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia ba0d92c712 (feat) working semantic-cache on litellm proxy 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia 87b5b418d8 (test) async semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia b2f9dde360 (feat) RedisSemanticCache - async 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia b63fe39ed2 (fix) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia 4450be0a64 (test) semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia 80e1d901d8 (test) semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia 80865f93b8 (feat) working - sync semantic caching 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia 168a2f7806 (feat )add semantic cache 2024-02-06 13:30:17 -08:00
ishaan-jaffandKrrish Dholakia a73d57b32b (feat) show langfuse logging tags better through proxy 2024-02-06 13:30:17 -08:00
Krrish Dholakia 31f85d65ae bump: version 1.22.8 → 1.22.9 2024-02-06 13:15:51 -08:00
Krrish Dholakia b7f1bd696e fix(utils.py): round max tokens to be int always 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia eb779c61c6 (ci/cd) run again 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 2a7b07ffca (ci/cd) run again 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 79f444edda (ci/cd) fix test_config_no_auth 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 9355fc62a7 (fix) test_normal_router_tpm_limit 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia b4372457c4 (fix) parallel_request_limiter debug 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 84942bb694 (ci/cd) run again 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 0fc721eb31 (ci/cd) run pytest without -s 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 0719c32f9e (fix) proxy_startup test 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia acf2474d68 (fix) rename proxy startup test 2024-02-06 13:15:51 -08:00
ishaan-jaffandKrrish Dholakia 9ed1d033fe (ci/cd) run in verbose mode 2024-02-06 13:15:51 -08:00
Krrish Dholakia e5fec98e1f fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected) 2024-02-06 12:57:05 -08:00
Krrish Dholakia e542aa10cc bump: version 1.22.7 → 1.22.8 2024-02-06 10:12:13 -08:00
Krrish Dholakia d1db67890c fix(ollama.py): support format for ollama 2024-02-06 10:11:52 -08:00