mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-19 12:25:58 +00:00
(docs) proxy setting default models
This commit is contained in:
@@ -452,7 +452,7 @@ Here's how you can use multiple llms with one proxy `config.yaml`.
|
||||
#### Step 1: Setup Config
|
||||
```yaml
|
||||
model_list:
|
||||
- model_name: zephyr-alpha
|
||||
- model_name: zephyr-alpha # the 1st model is the default on the proxy
|
||||
litellm_params: # params for litellm.completion() - https://docs.litellm.ai/docs/completion/input#input---request-body
|
||||
model: huggingface/HuggingFaceH4/zephyr-7b-alpha
|
||||
api_base: http://0.0.0.0:8001
|
||||
@@ -467,6 +467,9 @@ model_list:
|
||||
|
||||
```
|
||||
|
||||
#### Default Model - Config:
|
||||
The proxy uses the first model in the config as the default model - in this config the default model is `zephyr-alpha`
|
||||
|
||||
#### Step 2: Start Proxy with config
|
||||
|
||||
```shell
|
||||
|
||||
Reference in New Issue
Block a user