Krish Dholakia 3a7b13efa2 feat(health_check.py): set upperbound for api when making health check call (#7865) ...

* feat(health_check.py): set upperbound for api when making health check call

prevent bad model from health check to hang and cause pod restarts

* fix(health_check.py): cleanup task once completed

* fix(constants.py): bump default health check timeout to 1min

* docs(health.md): add 'health_check_timeout' to health docs on litellm

* build(proxy_server_config.yaml): add bad model to health check

2025-01-18 19:47:43 -08:00

..

my-website

feat(health_check.py): set upperbound for api when making health check call (#7865)

2025-01-18 19:47:43 -08:00