tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-23 18:25:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Ishaan Jaff
2023-10-17 13:54:41 -07:00
committed by GitHub
parent 5113a5d9c6
commit 0726d8f58c
1 changed files with 1 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -6
View File
@@ -87,15 +87,10 @@ Create an OpenAI API compatible server to call any non-openai model (e.g. Huggin
This works for async + streaming as well.
```python
litellm --model <model_name>
```
Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server)
### Multiple LLMs ([Docs](https://docs.litellm.ai/docs/proxy_server#multiple-llms))
```shell
$ litellm
#INFO: litellm proxy running on http://0.0.0.0:8000
```
Running your model locally or on a custom endpoint ? Set the `--api-base` parameter [see how](https://docs.litellm.ai/docs/proxy_server)
### Self-host server ([Docs](https://docs.litellm.ai/docs/proxy_server#deploy-proxy))