 ishaan-jaffandKrrish Dholakia
|
43061d612d
|
(fix) mark semantic caching as beta test
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
e32c2beddd
|
(fix) semantic caching
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
102f20fc03
|
(docs) litellm semantic caching
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b49b37568a
|
(docs) redis cache
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
f3de05cc54
|
(fix) test-semantic caching
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
f8248b2c79
|
(feat) redis-semantic cache on proxy
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
04433c01fd
|
(docs) using semantic caching on proxy
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
58f47c9e29
|
(fix) use semantic cache on proxy
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
91424b66d7
|
allow setting redis_semantic cache_embedding model
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
e2c88ce154
|
(feat) log semantic_sim to langfuse
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
fb1212ac82
|
(fix) add redisvl==0.0.7
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
e0d5c953d6
|
(feat) working semantic cache on proxy
|
2024-02-06 15:17:40 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
c8d5714e59
|
(feat) redis-semantic cache
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
aa7580411d
|
(feat) working semantic-cache on litellm proxy
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
1d151e4777
|
(test) async semantic cache
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
08d72fd2a0
|
(feat) RedisSemanticCache - async
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
553b993473
|
(fix) semantic cache
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
2ad8b70f50
|
(test) semantic caching
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
a5afbf6d56
|
(test) semantic cache
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
a510adb1e6
|
(feat) working - sync semantic caching
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
d67a9ada4f
|
(feat )add semantic cache
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
d85b1f8816
|
(feat) show langfuse logging tags better through proxy
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
6de6da71b7
|
bump: version 1.22.8 → 1.22.9
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
eee5353e77
|
fix(utils.py): round max tokens to be int always
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
647dbb9331
|
(ci/cd) run again
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
01701c95b8
|
(ci/cd) run again
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
5b63827430
|
(ci/cd) fix test_config_no_auth
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
6640690ad6
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
97dbf14b32
|
(fix) parallel_request_limiter debug
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
0d5f6cacc4
|
(ci/cd) run again
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
334acfb5f8
|
(ci/cd) run pytest without -s
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
233590e8c2
|
(fix) proxy_startup test
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b3a4982eda
|
(fix) rename proxy startup test
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
45ab0f01c0
|
(ci/cd) run in verbose mode
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
fbf95ca9c7
|
bump: version 1.22.7 → 1.22.8
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
b47f9dcb6d
|
fix(ollama.py): support format for ollama
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
944833b04a
|
build(requirements.txt): update the proxy requirements.txt
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
7b286f38ce
|
bump: version 1.22.6 → 1.22.7
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
80eb8d0eae
|
fix(ollama_chat.py): explicitly state if ollama call is streaming or not
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
3db9830d4b
|
fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
d189e95045
|
fix(ollama_chat.py): fix ollama chat completion token counting
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
3b977679f8
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
7ccb7c00d8
|
(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
ca029d13ee
|
(fix) proxy startup test
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
732ac6df49
|
(feat) proxy - upperbound params /key/generate
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
e21f906463
|
(test) test_upperbound_key_params
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
8d0c235004
|
(feat) upperbound_key_generate_params
|
2024-02-06 15:17:35 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
0996ea3f36
|
(docs) upperbound_key_generate_params
|
2024-02-06 15:17:35 -08:00 |
|
|
Krrish Dholakia
|
f363f0f5ba
|
fix(langfuse.py): support logging failed llm api calls to langfuse
|
2024-02-06 15:17:35 -08:00 |
|
|
John HUandKrrish Dholakia
|
f48c92e817
|
Fix admin UI title and description
|
2024-02-06 15:17:35 -08:00 |
|