docs benchmarks

This commit is contained in:
Ishaan Jaff
2025-05-24 17:43:38 -07:00
parent 39feb742cd
commit 7775e8471c
@@ -14,6 +14,10 @@ The load testing was conducted using the following parameters:
- **Transport Comparison:** httpx (existing) vs aiohttp (new implementation)
- **Number of pods/instance of litellm:** 1
- **Machine Specs:** 2 vCPUs, 4GB RAM
- **LiteLLM Settings:**
- Tested against a [fake openai endpoint](https://exampleopenaiendpoint-production.up.railway.app/)
- Set `USE_AIOHTTP_TRANSPORT="True"` in the environment variables. This feature flag enables the aiohttp transport.
## Benchmark Results