From 439bb5bfe335c30c04e33ef707df2c52ce3dca71 Mon Sep 17 00:00:00 2001 From: Alexsander Hamir Date: Wed, 10 Dec 2025 13:09:00 -0800 Subject: [PATCH] fix: suggest Gunicorn instead of uvicorn when using max_requests_before_restart (#17788) --- docs/my-website/docs/proxy/prod.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/my-website/docs/proxy/prod.md b/docs/my-website/docs/proxy/prod.md index 5536925482..76698071c6 100644 --- a/docs/my-website/docs/proxy/prod.md +++ b/docs/my-website/docs/proxy/prod.md @@ -81,6 +81,13 @@ CMD ["--port", "4000", "--config", "./proxy_server_config.yaml", "--num_workers" export MAX_REQUESTS_BEFORE_RESTART=10000 ``` +> **Tip:** When using `--max_requests_before_restart`, the `--run_gunicorn` flag is more stable and mature as it uses Gunicorn's battle-tested worker recycling mechanism instead of Uvicorn's implementation. + +```shell +# Use Gunicorn for more stable worker recycling +CMD ["--port", "4000", "--config", "./proxy_server_config.yaml", "--num_workers", "$(nproc)", "--run_gunicorn", "--max_requests_before_restart", "10000"] +``` + ## 4. Use Redis 'port','host', 'password'. NOT 'redis_url'