Ishaan Jaff
|
86758c2b89
|
ui - show key alias on "end users tab"
|
2024-04-25 11:50:54 -07:00 |
|
Ishaan Jaff
|
737af2b458
|
fix better debugging for latency
1.35.26.dev3
|
2024-04-25 11:35:08 -07:00 |
|
Ishaan Jaff
|
787735bb5a
|
fix
|
2024-04-25 11:25:03 -07:00 |
|
Ishaan Jaff
|
984259d420
|
temp - show better debug logs for lowest latency
|
2024-04-25 11:22:52 -07:00 |
|
 Krish DholakiaandGitHub
|
ce07b62899
|
Merge pull request #3298 from aswny/main
fix Llama models messages to prompt conversion for AWS Bedrock
|
2024-04-25 11:20:46 -07:00 |
|
 Ishaan JaffandGitHub
|
003a21b27d
|
Merge pull request #3300 from BerriAI/ui_viewing_teams
[UI] View Number of Keys, Members in a team
|
2024-04-25 11:10:17 -07:00 |
|
Ishaan Jaff
|
fcaa138882
|
ui - show number of keys in team
|
2024-04-25 11:09:28 -07:00 |
|
Ishaan Jaff
|
8ff8b29cfa
|
ui - show num keys, members in team
|
2024-04-25 11:09:15 -07:00 |
|
Lucca Zenobio
|
6127d9f488
|
merge
|
2024-04-25 15:00:07 -03:00 |
|
aswny
|
781af56f48
|
check model type chat/instruct to apply template
|
2024-04-25 17:52:38 +00:00 |
|
aswny
|
9ead717531
|
fix Llama models message to prompt conversion in for AWS Bedrock provider
|
2024-04-25 17:19:55 +00:00 |
|
 Ishaan JaffandGitHub
|
54e0acde35
|
Merge pull request #3289 from andeplane/patch-1
Fixed typo in token_usage.md
|
2024-04-25 09:08:53 -07:00 |
|
Ishaan Jaff
|
1bb1b9c259
|
ui -show tooltip with info
|
2024-04-25 09:07:01 -07:00 |
|
Krrish Dholakia
|
5ad91e1277
|
bump: version 1.35.26 → 1.35.27
|
2024-04-25 08:46:40 -07:00 |
|
Krrish Dholakia
|
1270ed55a1
|
docs(replicate.md): add proxy examples to docs
|
2024-04-25 08:46:21 -07:00 |
|
Krrish Dholakia
|
4f46b4c397
|
fix(factory.py): add replicate meta llama prompt templating support
|
2024-04-25 08:25:00 -07:00 |
|
Ishaan Jaff
|
92f21cba30
|
fix - increase default penalty for lowest latency
v1.35.26.dev1
|
2024-04-25 07:54:25 -07:00 |
|
 Anders HafreagerandGitHub
|
16a9cb34d9
|
Fixed typo in token_usage.md
|
2024-04-25 09:47:25 +02:00 |
|
Ishaan Jaff
|
74817c560e
|
(ci/cd) run again
|
2024-04-24 23:23:14 -07:00 |
|
Ishaan Jaff
|
4e707af592
|
Revert "fix(router.py): fix max retries on set_client"
This reverts commit 821844c1a3.
v1.35.26
|
2024-04-24 23:19:14 -07:00 |
|
Ishaan Jaff
|
13e0ac64ef
|
(fix) updating router settings
|
2024-04-24 23:09:25 -07:00 |
|
Krrish Dholakia
|
72dffdba39
|
fix(router.py): fix default retry on router
|
2024-04-24 23:06:53 -07:00 |
|
Krrish Dholakia
|
b8f862bb76
|
fix(proxy_server.py): fix update router
|
2024-04-24 23:01:21 -07:00 |
|
Krrish Dholakia
|
fe188f3cc1
|
fix(proxy_server.py): fix updating non-router settings for proxy config
|
2024-04-24 22:50:04 -07:00 |
|
Krrish Dholakia
|
4800acc756
|
refactor(main.py): trigger new build
|
2024-04-24 22:08:31 -07:00 |
|
Krrish Dholakia
|
0a9cdf6f9b
|
refactor(main.py): trigger new build
|
2024-04-24 22:04:24 -07:00 |
|
Krrish Dholakia
|
821844c1a3
|
fix(router.py): fix max retries on set_client
|
2024-04-24 22:03:01 -07:00 |
|
Ishaan Jaff
|
242830108c
|
(ci/cd) run again
|
2024-04-24 21:09:49 -07:00 |
|
 Krish DholakiaandGitHub
|
435a4b5ed4
|
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
|
2024-04-24 21:08:33 -07:00 |
|
Ishaan Jaff
|
d2462c0995
|
bump: version 1.35.24 → 1.35.25
v1.35.25
|
2024-04-24 21:04:55 -07:00 |
|
Ishaan Jaff
|
70ca65d1ef
|
ui - new build
|
2024-04-24 21:04:44 -07:00 |
|
Krrish Dholakia
|
dacadbf624
|
fix(utils.py): fix anthropic streaming return usage tokens
|
2024-04-24 20:56:10 -07:00 |
|
 Ishaan JaffandGitHub
|
2c7f4695d9
|
Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency
[Fix] Add better observability for debugging lowest latency routing
|
2024-04-24 20:42:52 -07:00 |
|
Ishaan Jaff
|
b84502c2aa
|
ui - new build
1.35.24.dev6
|
2024-04-24 20:40:01 -07:00 |
|
Krrish Dholakia
|
df7db2b870
|
fix(factory.py): support llama3 instuct chat template
allows automatic templating for llama3 instruct requests
|
2024-04-24 20:35:10 -07:00 |
|
Krrish Dholakia
|
495aebb582
|
fix(utils.py): fix setattr error
|
2024-04-24 20:19:27 -07:00 |
|
Ishaan Jaff
|
ffc277c2bb
|
temp fix _add_langfuse_trace_id_to_alert
|
2024-04-24 20:19:21 -07:00 |
|
 Krish DholakiaandGitHub
|
b498561c76
|
Merge pull request #3282 from BerriAI/litellm_config_update_fixes
fix(proxy_server.py): fix `/config/update`
|
2024-04-24 20:14:11 -07:00 |
|
Ishaan Jaff
|
212369498e
|
fix - set latency stats in kwargs
|
2024-04-24 20:13:45 -07:00 |
|
Krrish Dholakia
|
5650e8ea44
|
feat(router.py): support mock testing fallbacks flag
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
|
2024-04-24 20:13:10 -07:00 |
|
Ishaan Jaff
|
24b0dfee29
|
fix - add _get_deployment_latencies_to_alert
|
2024-04-24 20:09:02 -07:00 |
|
Krrish Dholakia
|
94cbe5516e
|
feat(router.py): support mock testing fallbacks flag on router
|
2024-04-24 17:33:00 -07:00 |
|
Krrish Dholakia
|
f54510b6ee
|
fix(proxy_server.py): fix /config/update/
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
|
2024-04-24 16:42:42 -07:00 |
|
Ishaan Jaff
|
2e6fc91a75
|
test - lowest latency logger
|
2024-04-24 16:35:43 -07:00 |
|
Ishaan Jaff
|
bf6abed808
|
feat - penalize timeout errors
|
2024-04-24 16:35:00 -07:00 |
|
Krrish Dholakia
|
bae6f41017
|
build(add-fallbacks-on-UI): allows admin to add fallbacks on the UI
|
2024-04-24 15:40:02 -07:00 |
|
 Ishaan JaffandGitHub
|
b1e2728906
|
Merge pull request #3280 from BerriAI/ui_filter_models_dropdown
[UI-Polish] filter by models on dropdown
|
2024-04-24 15:32:03 -07:00 |
|
Ishaan Jaff
|
11628d6c40
|
ui cleanup filter by model group section
|
2024-04-24 15:16:37 -07:00 |
|
Ishaan Jaff
|
f67c08335c
|
ui - cleanup filter by model group
|
2024-04-24 15:09:21 -07:00 |
|
 Ishaan JaffandGitHub
|
166f3915f9
|
Merge pull request #3279 from BerriAI/litellm_show_api_base_exceptions
[Feat] Show model, api base in APITimeoutError exceptions
|
2024-04-24 14:59:14 -07:00 |
|