 yishiyiyuan
|
5faa493d35
|
🐞 fix: djl vllm support
support vllm response format on sagemaker, which only return one choice.
|
2024-04-03 11:00:51 +08:00 |
|
|
CLARKBENHAM
|
44cb0f352a
|
formating
|
2024-04-02 19:56:07 -07:00 |
|
|
CLARKBENHAM
|
18749e7051
|
undo black formating
|
2024-04-02 19:53:48 -07:00 |
|
|
CLARKBENHAM
|
164898a213
|
fix lowest latency tests
|
2024-04-02 19:10:40 -07:00 |
|
|
CLARKBENHAM
|
29573b0967
|
param both tests to include failure (also fix prev)
|
2024-04-02 18:53:42 -07:00 |
|
|
Krrish Dholakia
|
d7601a4844
|
perf(proxy_server.py): batch write spend logs
reduces prisma client errors, by batch writing spend logs - max 1k logs at a time
|
2024-04-02 18:46:55 -07:00 |
|
|
CLARKBENHAM
|
4f95966475
|
tests showing error
|
2024-04-02 18:45:05 -07:00 |
|
|
Ishaan Jaff
|
c35b4c9b80
|
(ui) allow settig all proxy models
|
2024-04-02 18:02:23 -07:00 |
|
|
Ishaan JaffandGitHub
|
203a91864c
|
Merge pull request #2807 from BerriAI/litellm_support_all_team_models_as_ui_alias
UI - use all-team-models as an alias
|
2024-04-02 17:53:59 -07:00 |
|
|
Ishaan JaffandGitHub
|
21379eb56d
|
Merge pull request #2801 from BerriAI/litellm_support_all_models_as_a_ui_alias
[UI] use all_models alias
|
2024-04-02 17:53:25 -07:00 |
|
|
Ishaan Jaff
|
1d2d38b580
|
ui show all team models
|
2024-04-02 17:46:07 -07:00 |
|
|
Ishaan Jaff
|
df043eb1fb
|
ui neatly show all proxy models
|
2024-04-02 17:38:10 -07:00 |
|
|
CLARKBENHAM
|
6b0f3d3fd3
|
add routing strategy
|
2024-04-02 17:26:57 -07:00 |
|
|
Ishaan Jaff
|
6e3ec361ae
|
show all models in red on ui
|
2024-04-02 17:20:00 -07:00 |
|
|
CLARKBENHAM
|
2d7bafa12d
|
comments
|
2024-04-02 17:18:56 -07:00 |
|
|
CLARKBENHAM
|
75d029a91d
|
comments
|
2024-04-02 17:18:03 -07:00 |
|
|
RaGe
|
c16833e73c
|
(fix) add vertex_language_models to model_list
|
2024-04-02 20:02:46 -04:00 |
|
|
RaGe
|
a250aedf71
|
(fix) restore missing comma
|
2024-04-02 20:02:28 -04:00 |
|
|
Krish DholakiaandGitHub
|
e453a96c67
|
Merge pull request #2799 from BerriAI/litellm_fix_text_completion_response
fix(openai.py): return logprobs for text completion calls
|
2024-04-02 16:23:35 -07:00 |
|
|
Ishaan Jaff
|
3245d8cdce
|
support all-proxy-models for teams
|
2024-04-02 16:04:09 -07:00 |
|
|
Ishaan Jaff
|
b83c452ddd
|
support all-models-on-proxy
|
2024-04-02 15:52:54 -07:00 |
|
|
Ishaan Jaff
|
dfc020ca5f
|
ui - support all-models alias
|
2024-04-02 15:27:50 -07:00 |
|
|
Ishaan Jaff
|
73ef4780f7
|
(fix) support all-models alias on backend
|
2024-04-02 15:12:37 -07:00 |
|
|
Krrish Dholakia
|
919ec86b2b
|
fix(openai.py): switch to using openai sdk for text completion calls
|
2024-04-02 15:08:12 -07:00 |
|
|
Ishaan Jaff
|
d46f77fd58
|
ui use all_models alias
|
2024-04-02 15:01:42 -07:00 |
|
|
CLARKBENHAM
|
f32d39aa93
|
check if in future None results are returned
|
2024-04-02 14:49:20 -07:00 |
|
|
Krrish Dholakia
|
b07788d2a5
|
fix(openai.py): return logprobs for text completion calls
|
2024-04-02 14:05:56 -07:00 |
|
|
CLARKBENHAM
|
a2bf891e48
|
test for rate limits
|
2024-04-02 13:49:13 -07:00 |
|
|
Ishaan JaffandGitHub
|
7946c68f47
|
Merge pull request #2797 from BerriAI/ui_qa_imps
[UI] Quality Improvements - show correct team based usage, add litellm favicon
|
2024-04-02 13:48:02 -07:00 |
|
|
Ishaan Jaff
|
3d32567f4c
|
fix show correct team based usage
|
2024-04-02 13:43:33 -07:00 |
|
|
Ishaan Jaff
|
327cf73d73
|
fix left join on litellm team table
|
2024-04-02 13:36:22 -07:00 |
|
|
Ishaan Jaff
|
1a417733d3
|
feat ui use litellm favicon
|
2024-04-02 13:27:48 -07:00 |
|
|
Ishaan JaffandGitHub
|
768cb6ec36
|
Merge pull request #2795 from BerriAI/ui_edit_keys
[UI] Edit Keys
|
2024-04-02 12:59:01 -07:00 |
|
|
Ishaan Jaff
|
407199a9e7
|
new ui build
|
2024-04-02 12:58:31 -07:00 |
|
|
Ishaan Jaff
|
ccfd7b5ab5
|
(ui) edit keys models / budgets
|
2024-04-02 12:53:22 -07:00 |
|
|
Krrish Dholakia
|
80f8645e1a
|
build(config.yml): pin boto3 version - circle ci
|
2024-04-02 12:39:31 -07:00 |
|
|
Krish DholakiaandGitHub
|
63bff68846
|
Merge pull request #2791 from w3bdesign/patch-1
Delete node_modules directory
|
2024-04-02 12:35:07 -07:00 |
|
|
Daniel FjeldstadandGitHub
|
255dbdedff
|
Update .gitignore
Includes /node_modules
|
2024-04-02 21:31:57 +02:00 |
|
|
Ishaan Jaff
|
5eacee7cdd
|
ui populate edit screen
|
2024-04-02 09:57:26 -07:00 |
|
|
Krrish Dholakia
|
72abe200a9
|
fix(main.py): fix elif block
v1.34.21
|
2024-04-02 09:47:49 -07:00 |
|
|
Ishaan Jaff
|
22799b8890
|
v0 pencil icon
|
2024-04-02 09:07:37 -07:00 |
|
|
Krish DholakiaandGitHub
|
d95a1f3a28
|
Merge pull request #2790 from phact/patch-2
Fix max_tokens type in main.py
|
2024-04-02 09:02:34 -07:00 |
|
|
Krish DholakiaandGitHub
|
7233e5ab25
|
Merge pull request #2789 from BerriAI/litellm_set_ttl
fix(proxy_server.py): allow user to set in-memory + redis ttl
|
2024-04-02 08:53:34 -07:00 |
|
|
Krish DholakiaandGitHub
|
595fddca01
|
Merge pull request #2794 from turmind/main
Add sync iterator
|
2024-04-02 08:52:10 -07:00 |
|
|
Krrish Dholakia
|
4e03b35481
|
bump: version 1.34.20 → 1.34.21
|
2024-04-02 08:51:30 -07:00 |
|
|
Krrish Dholakia
|
2fc7aede12
|
refactor(main.py): trigger new build
|
2024-04-02 08:51:18 -07:00 |
|
|
Krrish Dholakia
|
0d949d71ab
|
fix(main.py): support text completion input being a list of strings
addresses - https://github.com/BerriAI/litellm/issues/2792, https://github.com/BerriAI/litellm/issues/2777
|
2024-04-02 08:50:16 -07:00 |
|
|
jdhuang
|
b6f98e408f
|
Add sync iterator
|
2024-04-02 20:14:37 +08:00 |
|
|
Daniel FjeldstadandGitHub
|
775a18c2cd
|
Delete node_modules directory
This folder should generally not be committed to Github
|
2024-04-02 08:46:27 +02:00 |
|
|
Sebastián EstévezandGitHub
|
d3a86e7b7f
|
Fix max_tokens type in main.py
|
2024-04-02 00:28:08 -04:00 |
|