 Ishaan Jaff
|
71db88115d
|
bump: version 1.34.19 → 1.34.20
v1.34.20
|
2024-04-01 19:55:07 -07:00 |
|
|
Ishaan Jaff
|
91269257f2
|
(docs) openai wildcard models
|
2024-04-01 19:53:34 -07:00 |
|
|
Ishaan JaffandGitHub
|
92984a1c6f
|
Merge pull request #2788 from BerriAI/litellm_support_-_models
[Feat] Allow using model = * on proxy config.yaml
v1.34.19
|
2024-04-01 19:46:50 -07:00 |
|
|
Ishaan Jaff
|
98df2b027b
|
test test_wildcard_openai_routing
|
2024-04-01 19:46:07 -07:00 |
|
|
Krrish Dholakia
|
6b35436c2a
|
bump: version 1.34.18 → 1.34.19
|
2024-04-01 19:17:25 -07:00 |
|
|
Krish DholakiaandGitHub
|
da85384649
|
Merge pull request #2787 from BerriAI/litellm_optional_team_jwt_claim
fix(proxy_server.py): don't require scope for team-based jwt access
|
2024-04-01 19:16:39 -07:00 |
|
|
Krrish Dholakia
|
c096ba566f
|
fix(proxy_server.py): fix cache param arg name
|
2024-04-01 19:14:39 -07:00 |
|
|
Krrish Dholakia
|
203e2776f8
|
fix(proxy_server.py): allow user to set in-memory + redis ttl
addresses - https://github.com/BerriAI/litellm/issues/2700
|
2024-04-01 19:13:23 -07:00 |
|
|
Ishaan Jaff
|
037b624c89
|
(fix) allow wildcard models
|
2024-04-01 19:07:05 -07:00 |
|
|
Ishaan Jaff
|
aabd7eff1f
|
feat router allow * models
|
2024-04-01 19:00:24 -07:00 |
|
|
Krrish Dholakia
|
c52819d47c
|
fix(proxy_server.py): don't require scope for team-based jwt access
If team with the client_id exists then it should be allowed to make a request, if it doesn't then as we discussed it should return an error
|
2024-04-01 18:52:00 -07:00 |
|
|
Ishaan JaffandGitHub
|
b14b6083f5
|
Merge pull request #2785 from BerriAI/litellm_high_traffic_redis_caching_fixes
[Feat] Proxy - high traffic redis caching - when using `url`
|
2024-04-01 18:38:27 -07:00 |
|
|
Krrish Dholakia
|
ceabf726b0
|
fix(main.py): support max retries for transcription calls
|
2024-04-01 18:37:53 -07:00 |
|
|
Krrish Dholakia
|
c3e4af76cf
|
refactor: fix linting issue
|
2024-04-01 18:11:38 -07:00 |
|
|
Krrish Dholakia
|
ca54b62656
|
refactor(main.py): trigger new build
|
2024-04-01 18:03:46 -07:00 |
|
|
Krrish Dholakia
|
6467dd4e11
|
fix(tpm_rpm_limiter.py): fix cache init logic
|
2024-04-01 18:01:38 -07:00 |
|
|
Ishaan Jaff
|
4ebb4570be
|
(fix) handle urls correctly
|
2024-04-01 17:08:48 -07:00 |
|
|
Ishaan Jaff
|
916e4032ee
|
redis show client_list, info
|
2024-04-01 16:54:42 -07:00 |
|
|
Ishaan Jaff
|
9accc544e9
|
add /cache/redis/info endpoint
|
2024-04-01 16:51:23 -07:00 |
|
|
Krrish Dholakia
|
9c0aecf9b8
|
fix(proxy/utils.py): support redis caching for alerting
|
2024-04-01 16:13:59 -07:00 |
|
|
Krrish Dholakia
|
cdae08f3c3
|
docs(openai.md): fix docs to include example of calling openai on proxy
|
2024-04-01 12:09:22 -07:00 |
|
|
Krish DholakiaandGitHub
|
d3e61a0adc
|
Merge pull request #2783 from BerriAI/litellm_context_window_Fallback_fix
fix(router.py): fix check for context window fallbacks
|
2024-04-01 11:55:49 -07:00 |
|
|
Krrish Dholakia
|
a917fadf45
|
docs(routing.md): refactor docs to show how to use pre-call checks and fallback across model groups
|
2024-04-01 11:21:27 -07:00 |
|
|
Ishaan Jaff
|
d5d800e141
|
(fix) _update_end_user_cache
|
2024-04-01 11:18:00 -07:00 |
|
|
Krrish Dholakia
|
52b1538b2e
|
fix(router.py): support context window fallbacks for pre-call checks
|
2024-04-01 10:51:54 -07:00 |
|
|
Krrish Dholakia
|
f46a9d09a5
|
fix(router.py): fix check for context window fallbacks
fallback if list is not none
|
2024-04-01 10:41:12 -07:00 |
|
|
Krrish Dholakia
|
c9e6b05cfb
|
test(test_max_tpm_rpm_limiter.py): add unit testing for redis namespaces working for tpm/rpm limits
|
2024-04-01 10:39:03 -07:00 |
|
|
Ishaan JaffandGitHub
|
f58436d6a0
|
Merge pull request #2782 from phact/patch-1
support cohere_chat in get_api_key
|
2024-04-01 10:33:43 -07:00 |
|
|
Sebastián EstévezandGitHub
|
e50e76bbd5
|
support cohere_chat in get_api_key
|
2024-04-01 13:24:03 -04:00 |
|
|
Ishaan Jaff
|
53d7b95364
|
(fix) load testing key used
|
2024-04-01 08:28:19 -07:00 |
|
|
Ishaan JaffandGitHub
|
bbfd850e12
|
Merge pull request #2774 from BerriAI/litellm_async_perf
(fix) improve async perf by 100ms
|
2024-04-01 08:12:34 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
f3e47323b9
|
test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy
|
2024-04-01 08:11:30 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
19fc120081
|
fix(proxy/utils.py): uncomment max parallel request limit check
|
2024-04-01 08:11:30 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
1bb4f3ad6d
|
fix(utils.py): set redis_usage_cache to none by default
|
2024-04-01 08:11:30 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
2dd5f2bc8c
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-04-01 08:11:30 -07:00 |
|
|
Krrish Dholakia
|
383f12bbd3
|
test(test_max_tpm_rpm_limiter.py): unit tests for key + team based tpm rpm limits on proxy
|
2024-04-01 08:00:01 -07:00 |
|
|
Ishaan Jaff
|
ddb35facc0
|
ci/cd run again
|
2024-04-01 07:40:05 -07:00 |
|
|
DaxServerandIshaan Jaff
|
3f25049dc8
|
fix(docs): Correct Docker pull command in deploy.md
Corrected the Docker pull command in deploy.md to remove duplicated 'docker pull' command.
|
2024-04-01 07:29:56 -07:00 |
|
|
DaxServerandIshaan Jaff
|
a2c7455c3d
|
docs: Update references to Ollama repository url
Updated references to the Ollama repository URL from https://github.com/jmorganca/ollama to https://github.com/ollama/ollama.
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
ea2356fd95
|
bump: version 1.34.17 → 1.34.18
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
5800a5095a
|
refactor(main.py): trigger new build
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
a1365f6035
|
test: cleanup
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
d4dd6d0cdc
|
fix(proxy/utils.py): uncomment max parallel request limit check
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
aebb0e489c
|
test: fix test
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
17cabf013c
|
fix(caching.py): respect redis namespace for all redis get/set requests
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
583e334bd2
|
fix(utils.py): set redis_usage_cache to none by default
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
0c77f75ce9
|
fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams
allows tpm/rpm checks to work across instances
https://github.com/BerriAI/litellm/issues/2730
|
2024-04-01 07:29:56 -07:00 |
|
|
Krrish DholakiaandIshaan Jaff
|
ea76c546ff
|
docs(deploy.md): fix docs for litlelm-database docker run example
|
2024-04-01 07:29:56 -07:00 |
|
|
Ishaan Jaff
|
15b5cb1612
|
(fix) check size of data to predict
|
2024-04-01 07:29:56 -07:00 |
|
|
Ishaan Jaff
|
e62e83c42a
|
(ui) dont let prediction block spend view
|
2024-04-01 07:29:56 -07:00 |
|