litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-06-18 17:28:19 +00:00

Files

T

Krish Dholakia 33ead69c0a Support checking provider /models endpoints on proxy /v1/models endpoint (#9958 )

* feat(utils.py): support global flag for 'check_provider_endpoints'

enables setting this for `/models` on proxy

* feat(utils.py): add caching to 'get_valid_models'

Prevents checking endpoint repeatedly

* fix(utils.py): ensure mutations don't impact cached results

* test(test_utils.py): add unit test to confirm cache invalidation logic

* feat(utils.py): get_valid_models - support passing litellm params dynamically

Allows for checking endpoints based on received credentials

* test: update test

* feat(model_checks.py): pass router credentials to get_valid_models - ensures it checks correct credentials

* refactor(utils.py): refactor for simpler functions

* fix: fix linting errors

* fix(utils.py): fix test

* fix(utils.py): set valid providers to custom_llm_provider, if given

* test: update test

* fix: fix ruff check error

2025-04-14 23:23:20 -07:00

conftest.py

(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899 )

2025-01-21 20:27:55 -08:00

log.txt

Allow passing thinking param to litellm proxy via client sdk + Code QA Refactor on get_optional_params (get correct values) (#9386 )

2025-04-07 21:04:11 -07:00

test_aws_secret_manager.py

(AWS Secret Manager) - Using K/V pairs in 1 AWS Secret (#9039 )

2025-03-06 19:30:18 -08:00

test_get_secret.py

(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899 )