tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-12 03:06:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Ishaan Jaff
2023-12-26 11:57:00 +05:30
committed by GitHub
parent 87cc96b590
commit d915fb8729
1 changed files with 9 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+9 -4
View File
@@ -24,10 +24,15 @@
</a>
</h4>
LiteLLM manages
- Translating inputs to the provider's `completion` and `embedding` endpoints
- Guarantees [consistent output](https://docs.litellm.ai/docs/completion/output), text responses will always be available at `['choices'][0]['message']['content']`
- Load-balance across multiple deployments (e.g. Azure/OpenAI) - `Router` **1k+ requests/second**
This Package Provides:
- Python client to call 100+ LLMs in OpenAI Format
- Translate inputs to provider's `completion` and `embedding` endpoints
- [Consistent output](https://docs.litellm.ai/docs/completion/output), text responses will always be available at `['choices'][0]['message']['content']`
- Load-balance multiple deployments (e.g. Azure/OpenAI) - `Router` **1k+ requests/second**
- OpenAI Proxy Server:
- Track spend across multiple projects/people
- Call 100+ LLMs in OpenAI Format
# OpenAI Proxy - ([Docs](https://docs.litellm.ai/docs/simple_proxy))