litellm

adapters

LiteLLM Minor Fixes & Improvements (09/27/2024) (#5938 )

2024-09-27 22:52:57 -07:00

assistants

Add pyright to ci/cd + Fix remaining type-checking errors (#6082 )

2024-10-05 17:04:00 -04:00

batch_completion

(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208 )

2024-10-14 16:34:01 +05:30

batches

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

caching

(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886 )

2024-11-24 16:36:19 -08:00

deprecated_litellm_server

(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208 )

2024-10-14 16:34:01 +05:30

files

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

fine_tuning

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

integrations

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30

litellm_core_utils

(QOL improvement) Provider budget routing - allow using 1s, 1d, 1mo, 2mo etc (#6885 )

2024-11-23 16:59:46 -08:00

llms

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30

proxy

ui new build

2024-11-25 22:42:59 -08:00

realtime_api

LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158 )

2024-10-11 23:04:36 -07:00

rerank_api

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30

router_strategy

(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886 )

2024-11-24 16:36:19 -08:00

router_utils

(feat) provider budget routing improvements (#6827 )

2024-11-19 21:25:08 -08:00

secret_managers

(Perf / latency improvement) improve pass through endpoint latency to ~50ms (before PR was 400ms) (#6874 )

2024-11-22 18:47:26 -08:00

tests

LiteLLM Minor Fixes & Improvements (11/13/2024) (#6729 )

2024-11-15 11:18:31 +05:30

types

(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886 )

2024-11-24 16:36:19 -08:00

__init__.py

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30

_logging.py

LiteLLM Minor Fixes & Improvements (10/30/2024) (#6519 )

2024-11-02 00:44:32 +05:30

_redis.py

(fix proxy redis) Add redis sentinel support (#6154 )

2024-11-12 18:36:46 -08:00

_service_logger.py

(feat) log error class, function_name on prometheus service failure hook + only log DB related failures on DB service hook (#6650 )

2024-11-07 17:01:18 -08:00

_version.py

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

budget_manager.py

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

constants.py

Litellm router max depth (#6501 )

2024-10-29 22:05:41 -07:00

cost_calculator.py

fix imagegeneration output_cost_per_image on model cost map (#6752 )

2024-11-14 20:37:21 -08:00

cost.json

…

exceptions.py

Litellm dev 10 26 2024 (#6472 )

2024-10-28 15:05:43 -07:00

main.py

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30

model_prices_and_context_window_backup.json

Litellm dev 11 21 2024 (#6837 )

2024-11-22 01:53:52 +05:30

py.typed

…

requirements.txt

…

router.py

(Feat) Add provider specific budget routing (#6817 )

2024-11-19 20:25:27 -08:00

scheduler.py

(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208 )

2024-10-14 16:34:01 +05:30

timeout.py

Litellm ruff linting enforcement (#5992 )

2024-10-01 19:44:20 -04:00

utils.py

LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870 )

2024-11-23 15:17:40 +05:30