docs(openai-proxy-readme): positioning stuff

This commit is contained in:
Krrish Dholakia
2023-10-23 17:25:06 -07:00
parent c99fa955f4
commit 87c32d7a95
+13 -12
View File
@@ -17,18 +17,6 @@ A simple, fast, and lightweight **OpenAI-compatible server** to call 100+ LLM AP
docker run -e PORT=8000 -p 8000:8000 ghcr.io/berriai/litellm:latest
```
### Running Locally
```shell
$ git clone https://github.com/BerriAI/litellm.git
```
```shell
$ cd ./litellm/openai-proxy
```
```shell
$ uvicorn main:app --host 0.0.0.0 --port 8000
```
## Endpoints:
- `/chat/completions` - chat completions endpoint to call 100+ LLMs
- `/models` - available models on server
@@ -69,4 +57,17 @@ response = openai.ChatCompletion.create(
print(response)
```
### Running Locally
```shell
$ git clone https://github.com/BerriAI/litellm.git
```
```shell
$ cd ./litellm/openai-proxy
```
```shell
$ uvicorn main:app --host 0.0.0.0 --port 8000
```
[**See how to call Huggingface,Bedrock,TogetherAI,Anthropic, etc.**](https://docs.litellm.ai/docs/simple_proxy)