docs(simple_proxy.md): improving tutorial

This commit is contained in:
Krrish Dholakia
2023-11-03 14:06:08 -07:00
parent 22fd8953c1
commit 432520ffcf
+4 -2
View File
@@ -211,8 +211,6 @@ $ litellm --config /path/to/config.yaml
## Multiple Models
Evaluate between multiple models.
If you have 1 model running on a local GPU and another that's hosted (e.g. on Runpod), you can call both via the same litellm server by listing them in your `config.yaml`.
```yaml
@@ -227,6 +225,10 @@ model_list:
api_base: https://<my-hosted-endpoint>
```
```shell
$ litellm --config /path/to/config.yaml
```
### Evaluate model
If you're repo let's you set model name, you can call the specific model by just passing in that model's name -