diff --git a/docs/my-website/docs/proxy/timeout.md b/docs/my-website/docs/proxy/timeout.md index 85428ae53e..52cb160cf7 100644 --- a/docs/my-website/docs/proxy/timeout.md +++ b/docs/my-website/docs/proxy/timeout.md @@ -38,9 +38,15 @@ $ litellm --config /path/to/config.yaml -### Custom Timeouts, Stream Timeouts - Per Model -For each model you can set `timeout` & `stream_timeout` under `litellm_params` +### Custom Timeouts & Stream Timeouts (Per Model) +For each model, you can set `timeout` and `stream_timeout` under `litellm_params`: + +- **`timeout`** → maximum time for the *complete response*. + Use this to cap long-running completions. + +- **`stream_timeout`** → maximum time to wait for the *first chunk* (i.e., first token) in a streaming response. + Use this to abort “hanging” providers (e.g., Bedrock slow start) and retry another model.