Krish Dholakia 48316520f4 LiteLLM Minor Fixes & Improvements (12/23/2024) - P2 (#7386) ...

* fix(main.py): support 'mock_timeout=true' param

allows mock requests on proxy to have a time delay, for testing

* fix(main.py): ensure mock timeouts raise litellm.Timeout error

triggers retry/fallbacks

* fix: fix fallback + mock timeout testing

* fix(router.py): always return remaining tpm/rpm limits, if limits are known

allows for rate limit headers to be guaranteed

* docs(timeout.md): add docs on mock timeout = true

* fix(main.py): fix linting errors

* test: fix test

2024-12-23 17:41:27 -08:00

..

my-website

LiteLLM Minor Fixes & Improvements (12/23/2024) - P2 (#7386)

2024-12-23 17:41:27 -08:00