Commit Graph
7066 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub f785aee0df Merge pull request #1860 from BerriAI/litellm_spend_logging_high_traffic
fix(proxy_server.py): prisma client fixes for high traffic
2024-02-06 23:37:43 -08:00
Krish DholakiaandGitHub df60edfa07 Merge branch 'main' into litellm_spend_logging_high_traffic 2024-02-06 23:36:58 -08:00
Krrish Dholakia fd9c7a90af fix(proxy_server.py): update user cache to with new spend 2024-02-06 23:06:05 -08:00
Krrish Dholakia 73d8e3e640 fix(ollama_chat.py): fix token counting 2024-02-06 22:18:46 -08:00
Krrish Dholakia 4174471dac fix(proxy_server.py): fix endpoint 2024-02-06 22:09:30 -08:00
Krish DholakiaandGitHub 2bc710d8e9 Merge pull request #1843 from BerriAI/litellm_admin_ui_view_all_keys
feat(ui): enable admin to view all valid keys created on the proxy
2024-02-06 22:06:46 -08:00
Krrish Dholakia 0874c17a31 fix: export npm build into proxy 2024-02-06 20:12:50 -08:00
Krrish Dholakia 4a0df3cb4f fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections 2024-02-06 19:39:49 -08:00
ishaan-jaff 5f4b06fb19 (docs) caching v1.22.11 2024-02-06 19:39:32 -08:00
ishaan-jaff 5a29f362ee (fix) allow litellm_settings to be None 2024-02-06 19:29:39 -08:00
ishaan-jaff e9bf16bbda bump: version 1.22.10 → 1.22.11 2024-02-06 19:23:57 -08:00
ishaan-jaff c69eaebfd8 (fix) dockerfile for semantic caching 2024-02-06 19:23:27 -08:00
ishaan-jaff 7b26b3b789 (ci/cd) run again v1.22.10 2024-02-06 18:25:15 -08:00
Krrish Dholakia b6adeec347 fix(proxy_server.py): prisma client fixes for high traffic 2024-02-06 17:30:36 -08:00
ishaan-jaff 83628938ab bump: version 1.22.9 → 1.22.10 2024-02-06 17:12:46 -08:00
Ishaan JaffandGitHub 73c6ce890b Merge pull request #1859 from BerriAI/litellm_allow_using_budgets_without_keys
[Feat] Budgets for 'user' param passed to /chat/completions, /embeddings etc
2024-02-06 16:32:25 -08:00
ishaan-jaff 6369424629 (ci/cd) run again 2024-02-06 16:08:25 -08:00
Krish DholakiaandGitHub 0fd64bc906 Merge pull request #1839 from BerriAI/litellm_slack_langfuse_alerting
fix(proxy/utils.py): if langfuse trace id passed in, include in slack alert
2024-02-06 15:49:00 -08:00
Krish DholakiaandGitHub 9e9fb747ce Merge branch 'main' into litellm_slack_langfuse_alerting 2024-02-06 15:48:52 -08:00
ishaan-jaff 8208ebd9db (docs) budget per end_user 2024-02-06 15:39:45 -08:00
ishaan-jaff 196787359f (test) track_cost_ for end users 2024-02-06 15:25:51 -08:00
ishaan-jaff 52b864976b (feat) support max_user_budget 2024-02-06 15:19:36 -08:00
Krrish Dholakia be81183782 refactor(main.py): trigger deploy
n
2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 78f75647da (fix) redisvl requirements.txt issue 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 8ba2c8dbf7 (fix) langfuse show semantic-similarity in tags 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia eb3b68a2f0 (fix) dockerfile requirements.txt 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 325ca43946 (feat) show semantic-cache on health/readiness 2024-02-06 15:17:40 -08:00
Krrish Dholakia 0d03b28a3b test(test_completion.py): fix test 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia b5db630dba (ci/cd) run again 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 43061d612d (fix) mark semantic caching as beta test 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia e32c2beddd (fix) semantic caching 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 102f20fc03 (docs) litellm semantic caching 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia b49b37568a (docs) redis cache 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia f3de05cc54 (fix) test-semantic caching 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia f8248b2c79 (feat) redis-semantic cache on proxy 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 04433c01fd (docs) using semantic caching on proxy 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 58f47c9e29 (fix) use semantic cache on proxy 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia 91424b66d7 allow setting redis_semantic cache_embedding model 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia e2c88ce154 (feat) log semantic_sim to langfuse 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia fb1212ac82 (fix) add redisvl==0.0.7 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia e0d5c953d6 (feat) working semantic cache on proxy 2024-02-06 15:17:40 -08:00
ishaan-jaffandKrrish Dholakia c8d5714e59 (feat) redis-semantic cache 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia aa7580411d (feat) working semantic-cache on litellm proxy 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia 1d151e4777 (test) async semantic cache 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia 08d72fd2a0 (feat) RedisSemanticCache - async 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia 553b993473 (fix) semantic cache 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia 2ad8b70f50 (test) semantic caching 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia a5afbf6d56 (test) semantic cache 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia a510adb1e6 (feat) working - sync semantic caching 2024-02-06 15:17:35 -08:00
ishaan-jaffandKrrish Dholakia d67a9ada4f (feat )add semantic cache 2024-02-06 15:17:35 -08:00