diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index 06dc0a3ca5..c3ab795375 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -452,7 +452,7 @@ Here's how you can use multiple llms with one proxy `config.yaml`. #### Step 1: Setup Config ```yaml model_list: - - model_name: zephyr-alpha + - model_name: zephyr-alpha # the 1st model is the default on the proxy litellm_params: # params for litellm.completion() - https://docs.litellm.ai/docs/completion/input#input---request-body model: huggingface/HuggingFaceH4/zephyr-7b-alpha api_base: http://0.0.0.0:8001 @@ -467,6 +467,9 @@ model_list: ``` +#### Default Model - Config: +The proxy uses the first model in the config as the default model - in this config the default model is `zephyr-alpha` + #### Step 2: Start Proxy with config ```shell