diff --git a/docs/my-website/docs/aiohttp_benchmarks.md b/docs/my-website/docs/aiohttp_benchmarks.md index a0737f3be2..ebe1fbdbeb 100644 --- a/docs/my-website/docs/aiohttp_benchmarks.md +++ b/docs/my-website/docs/aiohttp_benchmarks.md @@ -14,6 +14,10 @@ The load testing was conducted using the following parameters: - **Transport Comparison:** httpx (existing) vs aiohttp (new implementation) - **Number of pods/instance of litellm:** 1 - **Machine Specs:** 2 vCPUs, 4GB RAM +- **LiteLLM Settings:** + - Tested against a [fake openai endpoint](https://exampleopenaiendpoint-production.up.railway.app/) + - Set `USE_AIOHTTP_TRANSPORT="True"` in the environment variables. This feature flag enables the aiohttp transport. + ## Benchmark Results