Commit Graph
11302 Commits
Author SHA1 Message Date
Ishaan Jaff 86758c2b89 ui - show key alias on "end users tab" 2024-04-25 11:50:54 -07:00
Ishaan Jaff 737af2b458 fix better debugging for latency 1.35.26.dev3 2024-04-25 11:35:08 -07:00
Ishaan Jaff 787735bb5a fix 2024-04-25 11:25:03 -07:00
Ishaan Jaff 984259d420 temp - show better debug logs for lowest latency 2024-04-25 11:22:52 -07:00
Krish DholakiaandGitHub ce07b62899 Merge pull request #3298 from aswny/main
fix Llama models messages to prompt conversion for AWS Bedrock
2024-04-25 11:20:46 -07:00
Ishaan JaffandGitHub 003a21b27d Merge pull request #3300 from BerriAI/ui_viewing_teams
[UI] View Number of Keys, Members in a team
2024-04-25 11:10:17 -07:00
Ishaan Jaff fcaa138882 ui - show number of keys in team 2024-04-25 11:09:28 -07:00
Ishaan Jaff 8ff8b29cfa ui - show num keys, members in team 2024-04-25 11:09:15 -07:00
Lucca Zenobio 6127d9f488 merge 2024-04-25 15:00:07 -03:00
aswny 781af56f48 check model type chat/instruct to apply template 2024-04-25 17:52:38 +00:00
aswny 9ead717531 fix Llama models message to prompt conversion in for AWS Bedrock provider 2024-04-25 17:19:55 +00:00
Ishaan JaffandGitHub 54e0acde35 Merge pull request #3289 from andeplane/patch-1
Fixed typo in token_usage.md
2024-04-25 09:08:53 -07:00
Ishaan Jaff 1bb1b9c259 ui -show tooltip with info 2024-04-25 09:07:01 -07:00
Krrish Dholakia 5ad91e1277 bump: version 1.35.26 → 1.35.27 2024-04-25 08:46:40 -07:00
Krrish Dholakia 1270ed55a1 docs(replicate.md): add proxy examples to docs 2024-04-25 08:46:21 -07:00
Krrish Dholakia 4f46b4c397 fix(factory.py): add replicate meta llama prompt templating support 2024-04-25 08:25:00 -07:00
Ishaan Jaff 92f21cba30 fix - increase default penalty for lowest latency v1.35.26.dev1 2024-04-25 07:54:25 -07:00
Anders HafreagerandGitHub 16a9cb34d9 Fixed typo in token_usage.md 2024-04-25 09:47:25 +02:00
Ishaan Jaff 74817c560e (ci/cd) run again 2024-04-24 23:23:14 -07:00
Ishaan Jaff 4e707af592 Revert "fix(router.py): fix max retries on set_client"
This reverts commit 821844c1a3.
v1.35.26
2024-04-24 23:19:14 -07:00
Ishaan Jaff 13e0ac64ef (fix) updating router settings 2024-04-24 23:09:25 -07:00
Krrish Dholakia 72dffdba39 fix(router.py): fix default retry on router 2024-04-24 23:06:53 -07:00
Krrish Dholakia b8f862bb76 fix(proxy_server.py): fix update router 2024-04-24 23:01:21 -07:00
Krrish Dholakia fe188f3cc1 fix(proxy_server.py): fix updating non-router settings for proxy config 2024-04-24 22:50:04 -07:00
Krrish Dholakia 4800acc756 refactor(main.py): trigger new build 2024-04-24 22:08:31 -07:00
Krrish Dholakia 0a9cdf6f9b refactor(main.py): trigger new build 2024-04-24 22:04:24 -07:00
Krrish Dholakia 821844c1a3 fix(router.py): fix max retries on set_client 2024-04-24 22:03:01 -07:00
Ishaan Jaff 242830108c (ci/cd) run again 2024-04-24 21:09:49 -07:00
Krish DholakiaandGitHub 435a4b5ed4 Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
2024-04-24 21:08:33 -07:00
Ishaan Jaff d2462c0995 bump: version 1.35.24 → 1.35.25 v1.35.25 2024-04-24 21:04:55 -07:00
Ishaan Jaff 70ca65d1ef ui - new build 2024-04-24 21:04:44 -07:00
Krrish Dholakia dacadbf624 fix(utils.py): fix anthropic streaming return usage tokens 2024-04-24 20:56:10 -07:00
Ishaan JaffandGitHub 2c7f4695d9 Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency
[Fix] Add better observability for debugging lowest latency routing
2024-04-24 20:42:52 -07:00
Ishaan Jaff b84502c2aa ui - new build 1.35.24.dev6 2024-04-24 20:40:01 -07:00
Krrish Dholakia df7db2b870 fix(factory.py): support llama3 instuct chat template
allows automatic templating for llama3 instruct requests
2024-04-24 20:35:10 -07:00
Krrish Dholakia 495aebb582 fix(utils.py): fix setattr error 2024-04-24 20:19:27 -07:00
Ishaan Jaff ffc277c2bb temp fix _add_langfuse_trace_id_to_alert 2024-04-24 20:19:21 -07:00
Krish DholakiaandGitHub b498561c76 Merge pull request #3282 from BerriAI/litellm_config_update_fixes
fix(proxy_server.py): fix `/config/update`
2024-04-24 20:14:11 -07:00
Ishaan Jaff 212369498e fix - set latency stats in kwargs 2024-04-24 20:13:45 -07:00
Krrish Dholakia 5650e8ea44 feat(router.py): support mock testing fallbacks flag
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
2024-04-24 20:13:10 -07:00
Ishaan Jaff 24b0dfee29 fix - add _get_deployment_latencies_to_alert 2024-04-24 20:09:02 -07:00
Krrish Dholakia 94cbe5516e feat(router.py): support mock testing fallbacks flag on router 2024-04-24 17:33:00 -07:00
Krrish Dholakia f54510b6ee fix(proxy_server.py): fix /config/update/
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
2024-04-24 16:42:42 -07:00
Ishaan Jaff 2e6fc91a75 test - lowest latency logger 2024-04-24 16:35:43 -07:00
Ishaan Jaff bf6abed808 feat - penalize timeout errors 2024-04-24 16:35:00 -07:00
Krrish Dholakia bae6f41017 build(add-fallbacks-on-UI): allows admin to add fallbacks on the UI 2024-04-24 15:40:02 -07:00
Ishaan JaffandGitHub b1e2728906 Merge pull request #3280 from BerriAI/ui_filter_models_dropdown
[UI-Polish] filter by models on dropdown
2024-04-24 15:32:03 -07:00
Ishaan Jaff 11628d6c40 ui cleanup filter by model group section 2024-04-24 15:16:37 -07:00
Ishaan Jaff f67c08335c ui - cleanup filter by model group 2024-04-24 15:09:21 -07:00
Ishaan JaffandGitHub 166f3915f9 Merge pull request #3279 from BerriAI/litellm_show_api_base_exceptions
[Feat] Show model, api base in APITimeoutError exceptions
2024-04-24 14:59:14 -07:00