 ishaan-jaffandKrrish Dholakia
|
548d56ac42
|
(fix) mark semantic caching as beta test
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
ca26ecc4dc
|
(fix) semantic caching
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
4d1b437d0a
|
(docs) litellm semantic caching
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
06ac218d9f
|
(docs) redis cache
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b2c78108c8
|
(fix) test-semantic caching
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
a8d190f507
|
(feat) redis-semantic cache on proxy
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
ee80987c8f
|
(docs) using semantic caching on proxy
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
63e91eb2c4
|
(fix) use semantic cache on proxy
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
000afc1391
|
allow setting redis_semantic cache_embedding model
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
74fb4e4cba
|
(feat) log semantic_sim to langfuse
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
e0c464cc71
|
(fix) add redisvl==0.0.7
|
2024-02-06 13:30:31 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
a7b3148c99
|
(feat) working semantic cache on proxy
|
2024-02-06 13:30:30 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
2b86c3a9b4
|
(feat) redis-semantic cache
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
ba0d92c712
|
(feat) working semantic-cache on litellm proxy
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
87b5b418d8
|
(test) async semantic cache
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b2f9dde360
|
(feat) RedisSemanticCache - async
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b63fe39ed2
|
(fix) semantic cache
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
4450be0a64
|
(test) semantic caching
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
80e1d901d8
|
(test) semantic cache
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
80865f93b8
|
(feat) working - sync semantic caching
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
168a2f7806
|
(feat )add semantic cache
|
2024-02-06 13:30:17 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
a73d57b32b
|
(feat) show langfuse logging tags better through proxy
|
2024-02-06 13:30:17 -08:00 |
|
|
Krrish Dholakia
|
31f85d65ae
|
bump: version 1.22.8 → 1.22.9
|
2024-02-06 13:15:51 -08:00 |
|
|
Krrish Dholakia
|
b7f1bd696e
|
fix(utils.py): round max tokens to be int always
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
eb779c61c6
|
(ci/cd) run again
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
2a7b07ffca
|
(ci/cd) run again
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
79f444edda
|
(ci/cd) fix test_config_no_auth
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
9355fc62a7
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
b4372457c4
|
(fix) parallel_request_limiter debug
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
84942bb694
|
(ci/cd) run again
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
0fc721eb31
|
(ci/cd) run pytest without -s
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
0719c32f9e
|
(fix) proxy_startup test
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
acf2474d68
|
(fix) rename proxy startup test
|
2024-02-06 13:15:51 -08:00 |
|
|
ishaan-jaffandKrrish Dholakia
|
9ed1d033fe
|
(ci/cd) run in verbose mode
|
2024-02-06 13:15:51 -08:00 |
|
|
Krrish Dholakia
|
e5fec98e1f
|
fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)
|
2024-02-06 12:57:05 -08:00 |
|
|
Krrish Dholakia
|
e542aa10cc
|
bump: version 1.22.7 → 1.22.8
|
2024-02-06 10:12:13 -08:00 |
|
|
Krrish Dholakia
|
d1db67890c
|
fix(ollama.py): support format for ollama
|
2024-02-06 10:11:52 -08:00 |
|
|
Krish DholakiaandGitHub
|
dd87386cad
|
Merge pull request #1846 from BerriAI/litellm_proxy_update_requirements_txt
build(requirements.txt): update the proxy requirements.txt
|
2024-02-06 07:51:48 -08:00 |
|
|
Krrish Dholakia
|
f2ef32bcee
|
bump: version 1.22.6 → 1.22.7
|
2024-02-06 07:44:04 -08:00 |
|
|
Krrish Dholakia
|
9e091a0624
|
fix(ollama_chat.py): explicitly state if ollama call is streaming or not
|
2024-02-06 07:43:47 -08:00 |
|
|
Krrish Dholakia
|
4a5b635e35
|
build(requirements.txt): update the proxy requirements.txt
|
2024-02-06 07:35:46 -08:00 |
|
|
Krrish Dholakia
|
c2a523b954
|
fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk
|
2024-02-06 07:30:26 -08:00 |
|
|
Krrish Dholakia
|
2e3748e6eb
|
fix(ollama_chat.py): fix ollama chat completion token counting
|
2024-02-06 07:30:26 -08:00 |
|
|
ishaan-jaff
|
47bed68c7f
|
(fix) test_normal_router_tpm_limit
|
2024-02-06 06:46:49 -08:00 |
|
|
ishaan-jaff
|
9a8abdb1ae
|
(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict
|
2024-02-05 22:53:31 -08:00 |
|
|
ishaan-jaff
|
4d625818d6
|
(fix) proxy startup test
|
2024-02-05 22:51:11 -08:00 |
|
|
Ishaan JaffandGitHub
|
ed53f34537
|
Merge pull request #1844 from BerriAI/litellm_set_upperbound_budgets
[Feat] Proxy set upperbound params for key/generate
|
2024-02-05 22:42:01 -08:00 |
|
|
ishaan-jaff
|
71814d8149
|
(feat) proxy - upperbound params /key/generate
|
2024-02-05 22:40:52 -08:00 |
|
|
ishaan-jaff
|
4d4554b0e4
|
(test) test_upperbound_key_params
|
2024-02-05 22:39:36 -08:00 |
|
|
ishaan-jaff
|
a712596d46
|
(feat) upperbound_key_generate_params
|
2024-02-05 22:38:47 -08:00 |
|