 Ishaan Jaff
|
92f21cba30
|
fix - increase default penalty for lowest latency
v1.35.26.dev1
|
2024-04-25 07:54:25 -07:00 |
|
|
Ishaan Jaff
|
74817c560e
|
(ci/cd) run again
|
2024-04-24 23:23:14 -07:00 |
|
|
Ishaan Jaff
|
4e707af592
|
Revert "fix(router.py): fix max retries on set_client"
This reverts commit 821844c1a3.
v1.35.26
|
2024-04-24 23:19:14 -07:00 |
|
|
Ishaan Jaff
|
13e0ac64ef
|
(fix) updating router settings
|
2024-04-24 23:09:25 -07:00 |
|
|
Krrish Dholakia
|
72dffdba39
|
fix(router.py): fix default retry on router
|
2024-04-24 23:06:53 -07:00 |
|
|
Krrish Dholakia
|
b8f862bb76
|
fix(proxy_server.py): fix update router
|
2024-04-24 23:01:21 -07:00 |
|
|
Krrish Dholakia
|
fe188f3cc1
|
fix(proxy_server.py): fix updating non-router settings for proxy config
|
2024-04-24 22:50:04 -07:00 |
|
|
Krrish Dholakia
|
4800acc756
|
refactor(main.py): trigger new build
|
2024-04-24 22:08:31 -07:00 |
|
|
Krrish Dholakia
|
0a9cdf6f9b
|
refactor(main.py): trigger new build
|
2024-04-24 22:04:24 -07:00 |
|
|
Krrish Dholakia
|
821844c1a3
|
fix(router.py): fix max retries on set_client
|
2024-04-24 22:03:01 -07:00 |
|
|
Ishaan Jaff
|
242830108c
|
(ci/cd) run again
|
2024-04-24 21:09:49 -07:00 |
|
|
Krish DholakiaandGitHub
|
435a4b5ed4
|
Merge pull request #3267 from BerriAI/litellm_openai_streaming_fix
fix(utils.py): fix streaming to not return usage dict
|
2024-04-24 21:08:33 -07:00 |
|
|
Ishaan Jaff
|
d2462c0995
|
bump: version 1.35.24 → 1.35.25
v1.35.25
|
2024-04-24 21:04:55 -07:00 |
|
|
Ishaan Jaff
|
70ca65d1ef
|
ui - new build
|
2024-04-24 21:04:44 -07:00 |
|
|
Krrish Dholakia
|
dacadbf624
|
fix(utils.py): fix anthropic streaming return usage tokens
|
2024-04-24 20:56:10 -07:00 |
|
|
Ishaan JaffandGitHub
|
2c7f4695d9
|
Merge pull request #3283 from BerriAI/litellm_debug_lowest_latency
[Fix] Add better observability for debugging lowest latency routing
|
2024-04-24 20:42:52 -07:00 |
|
|
Ishaan Jaff
|
b84502c2aa
|
ui - new build
1.35.24.dev6
|
2024-04-24 20:40:01 -07:00 |
|
|
Krrish Dholakia
|
df7db2b870
|
fix(factory.py): support llama3 instuct chat template
allows automatic templating for llama3 instruct requests
|
2024-04-24 20:35:10 -07:00 |
|
|
Krrish Dholakia
|
495aebb582
|
fix(utils.py): fix setattr error
|
2024-04-24 20:19:27 -07:00 |
|
|
Ishaan Jaff
|
ffc277c2bb
|
temp fix _add_langfuse_trace_id_to_alert
|
2024-04-24 20:19:21 -07:00 |
|
|
Krish DholakiaandGitHub
|
b498561c76
|
Merge pull request #3282 from BerriAI/litellm_config_update_fixes
fix(proxy_server.py): fix `/config/update`
|
2024-04-24 20:14:11 -07:00 |
|
|
Ishaan Jaff
|
212369498e
|
fix - set latency stats in kwargs
|
2024-04-24 20:13:45 -07:00 |
|
|
Krrish Dholakia
|
5650e8ea44
|
feat(router.py): support mock testing fallbacks flag
allow user to test if fallbacks work as expected with a `mock_testing_fallbacks = True` flag set during a call
|
2024-04-24 20:13:10 -07:00 |
|
|
Ishaan Jaff
|
24b0dfee29
|
fix - add _get_deployment_latencies_to_alert
|
2024-04-24 20:09:02 -07:00 |
|
|
Krrish Dholakia
|
94cbe5516e
|
feat(router.py): support mock testing fallbacks flag on router
|
2024-04-24 17:33:00 -07:00 |
|
|
Krrish Dholakia
|
f54510b6ee
|
fix(proxy_server.py): fix /config/update/
allows updating router config via UI and having the change be propogated across all proxy instances by persisting config changes to the db
|
2024-04-24 16:42:42 -07:00 |
|
|
Ishaan Jaff
|
2e6fc91a75
|
test - lowest latency logger
|
2024-04-24 16:35:43 -07:00 |
|
|
Ishaan Jaff
|
bf6abed808
|
feat - penalize timeout errors
|
2024-04-24 16:35:00 -07:00 |
|
|
Krrish Dholakia
|
bae6f41017
|
build(add-fallbacks-on-UI): allows admin to add fallbacks on the UI
|
2024-04-24 15:40:02 -07:00 |
|
|
Ishaan JaffandGitHub
|
b1e2728906
|
Merge pull request #3280 from BerriAI/ui_filter_models_dropdown
[UI-Polish] filter by models on dropdown
|
2024-04-24 15:32:03 -07:00 |
|
|
Ishaan Jaff
|
11628d6c40
|
ui cleanup filter by model group section
|
2024-04-24 15:16:37 -07:00 |
|
|
Ishaan Jaff
|
f67c08335c
|
ui - cleanup filter by model group
|
2024-04-24 15:09:21 -07:00 |
|
|
Ishaan JaffandGitHub
|
166f3915f9
|
Merge pull request #3279 from BerriAI/litellm_show_api_base_exceptions
[Feat] Show model, api base in APITimeoutError exceptions
|
2024-04-24 14:59:14 -07:00 |
|
|
Ishaan Jaff
|
12a2621ead
|
ui - filter by model names
|
2024-04-24 14:51:14 -07:00 |
|
|
Ishaan Jaff
|
7a5c07de22
|
fix - show api_base, model in exceptions
|
2024-04-24 14:03:48 -07:00 |
|
|
Ishaan JaffandGitHub
|
2ac3885a50
|
Merge pull request #3277 from BerriAI/litellm_update_deployments
[UI] V0 - Edit Model tpm, rpm, api_base
|
2024-04-24 14:03:00 -07:00 |
|
|
Ishaan Jaff
|
ca4fd85296
|
fix show api_base, model in timeout errors
|
2024-04-24 14:01:32 -07:00 |
|
|
Ishaan Jaff
|
8a8ba96831
|
fix build issues
|
2024-04-24 13:29:10 -07:00 |
|
|
Ishaan Jaff
|
36f8431bf0
|
(ci/cd) testing
|
2024-04-24 13:25:18 -07:00 |
|
|
Ishaan Jaff
|
31a8270206
|
ui -edit model flow
|
2024-04-24 13:21:22 -07:00 |
|
|
Ishaan Jaff
|
f8803cb877
|
ui - working edit model flow
|
2024-04-24 13:21:12 -07:00 |
|
|
Krrish Dholakia
|
1f7abb8d92
|
fix(langfuse.py): fix langfuse environ check
|
2024-04-24 13:21:00 -07:00 |
|
|
Krish DholakiaandGitHub
|
263439ee4a
|
Merge pull request #3098 from greenscale-ai/main
Support for Greenscale AI logging
|
2024-04-24 13:09:03 -07:00 |
|
|
Krrish Dholakia
|
57cd3f482a
|
bump: version 1.35.23 → 1.35.24
v1.35.24.dev1
v1.35.24
|
2024-04-24 11:13:37 -07:00 |
|
|
Krrish Dholakia
|
3fdb2f0779
|
fix(ui): fix add slack/langfuse logging on ui
|
2024-04-24 10:58:44 -07:00 |
|
|
Ishaan Jaff
|
efbf85a5ad
|
/model/update endpoint
|
2024-04-24 10:39:20 -07:00 |
|
|
Krrish Dholakia
|
07793660ea
|
build(ui): add refresh button for model page
prevents need for user to reload page just to see if new model added
|
2024-04-24 10:31:54 -07:00 |
|
|
Krrish Dholakia
|
26e9ae38ce
|
fix(proxy_server.py): add new flag for disable sharing master key on ui
|
2024-04-24 10:06:01 -07:00 |
|
|
Ishaan Jaff
|
3d1a158b63
|
feat - update deployments
|
2024-04-24 09:53:42 -07:00 |
|
|
Krrish Dholakia
|
b918f58262
|
fix(vertex_ai.py): raise explicit error when image url fails to download - prevents silent failure
|
2024-04-24 09:23:15 -07:00 |
|