From 7775e8471cfdbd06e40fdf4b729e214fcbd175fb Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Sat, 24 May 2025 17:43:38 -0700 Subject: [PATCH] docs benchmarks --- docs/my-website/docs/aiohttp_benchmarks.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/docs/my-website/docs/aiohttp_benchmarks.md b/docs/my-website/docs/aiohttp_benchmarks.md index a0737f3be2..ebe1fbdbeb 100644 --- a/docs/my-website/docs/aiohttp_benchmarks.md +++ b/docs/my-website/docs/aiohttp_benchmarks.md @@ -14,6 +14,10 @@ The load testing was conducted using the following parameters: - **Transport Comparison:** httpx (existing) vs aiohttp (new implementation) - **Number of pods/instance of litellm:** 1 - **Machine Specs:** 2 vCPUs, 4GB RAM +- **LiteLLM Settings:** + - Tested against a [fake openai endpoint](https://exampleopenaiendpoint-production.up.railway.app/) + - Set `USE_AIOHTTP_TRANSPORT="True"` in the environment variables. This feature flag enables the aiohttp transport. + ## Benchmark Results