Krish DholakiaandGitHub 1356f6cd32 Merge pull request #2775 from BerriAI/litellm_redis_user_api_key_cache_v3 ...

fix(tpm_rpm_limiter.py): enable redis caching for tpm/rpm checks on keys/user/teams

2024-03-30 22:07:05 -07:00

..

deprecated_litellm_server

…

integrations

Merge branch 'main' into main

2024-03-30 13:21:53 +09:00

llms

fix(factory.py): parse list in xml tool calling response (anthropic)

2024-03-29 11:51:26 -07:00

proxy

Merge pull request #2775 from BerriAI/litellm_redis_user_api_key_cache_v3

2024-03-30 22:07:05 -07:00

router_strategy

fix(lowest_tpm_rpm_routing.py): fix base case where max tpm/rpm is 0

2024-03-28 14:51:31 -07:00

tests

test: fix test

2024-03-30 20:22:48 -07:00

types

…

__init__.py

fix(proxy_server.py): enforce end user budgets with 'litellm.max_end_user_budget' param

2024-03-29 17:14:40 -07:00

_logging.py

fix(parallel_request_limiter.py): handle metadata being none

2024-03-14 10:02:41 -07:00

_redis.py

fix(redis.py): fix instantiating redis client from url

2024-02-15 17:48:00 -08:00

_version.py

…

budget_manager.py

…

caching.py

fix(caching.py): respect redis namespace for all redis get/set requests

2024-03-30 20:20:29 -07:00

cost.json

…

exceptions.py

fix(main.py): map list input to ollama prompt input format

2024-02-16 11:54:12 -08:00

main.py

refactor(main.py): trigger new build

2024-03-30 21:41:14 -07:00

model_prices_and_context_window_backup.json

build(model_prices_and_context_window.json): add proper bedrock mixtral model name

2024-03-30 08:37:06 -07:00

requirements.txt

…

router.py

fix(router.py): check for context window error when handling 400 status code errors

2024-03-26 08:08:15 -07:00

timeout.py

…

utils.py

Merge branch 'main' into main

2024-03-30 13:21:53 +09:00