From 5fcf9fc79926552fbbca34ee8e6c9ad334c69102 Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Fri, 10 Nov 2023 13:06:22 -0800 Subject: [PATCH] (docs) proxy setting default models --- docs/my-website/docs/simple_proxy.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/my-website/docs/simple_proxy.md b/docs/my-website/docs/simple_proxy.md index 06dc0a3ca5..c3ab795375 100644 --- a/docs/my-website/docs/simple_proxy.md +++ b/docs/my-website/docs/simple_proxy.md @@ -452,7 +452,7 @@ Here's how you can use multiple llms with one proxy `config.yaml`. #### Step 1: Setup Config ```yaml model_list: - - model_name: zephyr-alpha + - model_name: zephyr-alpha # the 1st model is the default on the proxy litellm_params: # params for litellm.completion() - https://docs.litellm.ai/docs/completion/input#input---request-body model: huggingface/HuggingFaceH4/zephyr-7b-alpha api_base: http://0.0.0.0:8001 @@ -467,6 +467,9 @@ model_list: ``` +#### Default Model - Config: +The proxy uses the first model in the config as the default model - in this config the default model is `zephyr-alpha` + #### Step 2: Start Proxy with config ```shell