 Krrish Dholakia
|
52462e8bac
|
fix(router.py): move specific deployment check outside common functions
1.34.40.dev1
|
2024-04-10 18:06:31 -07:00 |
|
|
Krrish Dholakia
|
37ac17aebd
|
fix(router.py): fix datetime object
|
2024-04-10 17:55:24 -07:00 |
|
|
Krrish Dholakia
|
2531701a2a
|
fix(router.py): make get_cooldown_deployment logic async
|
2024-04-10 16:57:01 -07:00 |
|
|
Krrish Dholakia
|
a47a719caa
|
fix(router.py): generate consistent model id's
having the same id for a deployment, lets redis usage caching work across multiple instances
|
2024-04-10 15:23:57 -07:00 |
|
|
Krrish Dholakia
|
180cf9bd5c
|
feat(lowest_tpm_rpm_v2.py): move to using redis.incr and redis.mget for getting model usage from redis
makes routing work across multiple instances
|
2024-04-10 14:56:23 -07:00 |
|
|
Krrish Dholakia
|
b2741933dc
|
fix(proxy_cli.py): don't double load the router config
was causing callbacks to be instantiated twice - double couting usage in cache
|
2024-04-10 13:23:56 -07:00 |
|
|
Krrish Dholakia
|
d8da4cf8bb
|
bump: version 1.34.39 → 1.34.40
|
2024-04-10 12:08:21 -07:00 |
|
|
Krrish Dholakia
|
ef8ac6faf6
|
docs(ui.md): update docs to clarify sso is behind an enterprise license
|
2024-04-10 11:51:06 -07:00 |
|
|
Krrish Dholakia
|
5271202a84
|
build(ui): fix ui runtime error when sso is turned on
|
2024-04-10 08:54:08 -07:00 |
|
|
Ishaan Jaff
|
580534c765
|
ui - fix when selected team is undefined
|
2024-04-10 08:31:53 -07:00 |
|
|
Krrish Dholakia
|
a311788f0d
|
test(test_completion.py): handle api instability
v1.34.39
|
2024-04-09 21:58:48 -07:00 |
|
|
Krrish Dholakia
|
47997c3f04
|
fix(replicate.py): handle empty response - replicate
|
2024-04-09 21:57:25 -07:00 |
|
|
Krrish Dholakia
|
a6b004f10b
|
test(test_completion.py): change model
|
2024-04-09 21:38:17 -07:00 |
|
|
Krrish Dholakia
|
0408b3217f
|
bump: version 1.34.38 → 1.34.39
|
2024-04-09 21:15:59 -07:00 |
|
|
Krrish Dholakia
|
a943f21f75
|
refactor(main.py): trigger new build
|
2024-04-09 21:15:33 -07:00 |
|
|
Krish DholakiaandGitHub
|
2fa47cf416
|
Merge pull request #2924 from BerriAI/litellm_text_completion_response
fix(main.py): handle translating text completion openai to chat completion for async requests
|
2024-04-09 21:13:30 -07:00 |
|
|
Krish DholakiaandGitHub
|
884f22c9d8
|
Merge pull request #2909 from CLARKBENHAM/clark/tpm_rpm_docs
Clark/tpm rpm docs
|
2024-04-09 21:12:30 -07:00 |
|
|
Krish DholakiaandGitHub
|
5d0557145a
|
Merge pull request #2926 from jpshackelford/main
Gemini pro 1.5 model is now named correctly for AI Studio.
|
2024-04-09 21:11:57 -07:00 |
|
|
Krish DholakiaandGitHub
|
23400fa664
|
Merge pull request #2925 from BerriAI/litellm_genai_updates
feat(gemini.py): support google-genai system instruction
|
2024-04-09 18:16:04 -07:00 |
|
|
Krish DholakiaandGitHub
|
6d8d8e9909
|
Merge pull request #2914 from cheahjs/feat/vertex-gemini-1.5.pro-public-preview
feat: add gemini-1.5-pro-preview-0409 to vertex ai
|
2024-04-09 18:08:25 -07:00 |
|
|
Krish DholakiaandGitHub
|
5d2734479d
|
Update README.md
|
2024-04-09 18:03:09 -07:00 |
|
|
Krrish Dholakia
|
8857c9b978
|
test(test_key_generate_prisma.py): add better unit testing for spend logs on proxy server
|
2024-04-09 17:58:18 -07:00 |
|
|
Krrish Dholakia
|
28940c3b71
|
fix(proxy_server.py): fixes logging to spend logs db url
|
2024-04-09 17:38:48 -07:00 |
|
|
John-Mason P. Shackelford
|
ec65bf56c2
|
Gemini pro 1.5 model is now named correctly for AI Studio.
|
2024-04-09 20:25:26 -04:00 |
|
|
Krrish Dholakia
|
67b1ad622f
|
feat(gemini.py): support google-genai system instruction
|
2024-04-09 17:23:14 -07:00 |
|
|
Krrish Dholakia
|
855e7ed9d2
|
fix(main.py): handle translating text completion openai to chat completion for async requests
also adds testing for this, to prevent future regressions
|
2024-04-09 16:47:49 -07:00 |
|
|
Krrish Dholakia
|
ba57434374
|
docs(demo.md): update demo ui link
|
2024-04-09 16:35:35 -07:00 |
|
|
Krrish Dholakia
|
30798126eb
|
build(docker-compose.yml): fix default docker compose to run with config
|
2024-04-09 16:27:03 -07:00 |
|
|
Krrish Dholakia
|
4096118bf5
|
build(ui): make sure total spend and api keys sum up
|
2024-04-09 16:20:26 -07:00 |
|
|
Krrish Dholakia
|
dbbf605653
|
fix(proxy_server.py): fix sso callback check to work for user email
|
2024-04-09 14:50:39 -07:00 |
|
|
Krish DholakiaandGitHub
|
0a456743d6
|
Merge pull request #2920 from ventz/main
Added support for newly released `gpt-4-turbo-2024-04-09` and `gpt-4-turbo`
|
2024-04-09 13:46:57 -07:00 |
|
|
Krrish Dholakia
|
4495f6c058
|
test(test_key_generate_prisma.py): fix check for raising error if key generate max budget > key upperbound
v1.34.38
|
2024-04-09 13:07:57 -07:00 |
|
|
Ventz PetkovandGitHub
|
17111d2f47
|
Update model_prices_and_context_window.json
Added support for `gpt-4-turbo-2024-04-09` and `gpt-4-turbo`
|
2024-04-09 16:02:35 -04:00 |
|
|
Krish DholakiaandGitHub
|
23ebb5cd1d
|
Merge pull request #2919 from BerriAI/litellm_admin_ui
build(ui/admin.tsx): allow adding admins + upgrading viewer to admin
|
2024-04-09 13:00:49 -07:00 |
|
|
Krrish Dholakia
|
a1a5132b5f
|
build(ui/admin.tsx): allow adding admins + upgrading viewer to admin
Allows proxy admin to add more admins via UI
|
2024-04-09 13:00:09 -07:00 |
|
|
Ishaan Jaff
|
658f67d845
|
bump: version 1.34.37 → 1.34.38
|
2024-04-09 10:21:31 -07:00 |
|
|
Jun Siang Cheah
|
ea86913e1c
|
feat: add gemini-1.5-pro-preview-0409 to vertex ai
|
2024-04-09 17:02:56 +01:00 |
|
|
Ishaan JaffandGitHub
|
caec5374d9
|
Merge pull request #2893 from unclecode/main
Fix issue #2832: Add protected_namespaces to Config class within utils.py, router.py and completion.py to avoid the warning message.
|
2024-04-09 08:51:41 -07:00 |
|
|
Krrish Dholakia
|
df62f931e7
|
fix(proxy_server.py): allow 'upperbound_key_generate' params to be set via 'os.environ/'
|
2024-04-09 07:48:29 -07:00 |
|
|
Ishaan JaffandGitHub
|
fd424a387c
|
Merge pull request #2913 from BerriAI/litellm_add_voyage_2
[New Models] Add Voyage 2 embedding models
|
2024-04-09 07:47:18 -07:00 |
|
|
Ishaan Jaff
|
9dcf671b55
|
docs- add voyage 2
|
2024-04-09 07:43:30 -07:00 |
|
|
Ishaan Jaff
|
4c7f38fca9
|
add voyage2 embeddings
|
2024-04-09 07:43:22 -07:00 |
|
|
Krrish Dholakia
|
1adabcaca2
|
fix(proxy_server.py): raise exception if max user value > max value set in config
|
2024-04-09 07:34:34 -07:00 |
|
|
Ishaan JaffandGitHub
|
6463c1ec93
|
Merge pull request #2912 from BerriAI/litellm_ui_qa
[UI] QA Improvements to adding callbacks, models
v1.34.37.dev1
|
2024-04-09 07:34:05 -07:00 |
|
|
Ishaan Jaff
|
23ce5c2fad
|
instantly add deployment on /model/new
|
2024-04-09 07:32:24 -07:00 |
|
|
Krrish Dholakia
|
0c2ae7a90e
|
fix(proxy_server.py): allow jwt public key ttl to be passed as os.environ
|
2024-04-09 07:23:13 -07:00 |
|
|
Ishaan Jaff
|
bb22f0718b
|
fix - ui qa
|
2024-04-09 07:19:27 -07:00 |
|
|
Krrish Dholakia
|
ef4c85522c
|
test(test_llm_guard.py): fix test
v1.34.37
|
2024-04-08 21:55:35 -07:00 |
|
|
CLARKBENHAM
|
e96d97d9e5
|
remove formating changes
|
2024-04-08 21:31:21 -07:00 |
|
|
CLARKBENHAM
|
6e20bb13b2
|
Revert "doc pre_call_check: enables router rate limits for concurrent calls"
This reverts commit 886c859519.
|
2024-04-08 21:27:38 -07:00 |
|