mirror of
https://github.com/tiennm99/litellm.git
synced 2026-07-11 03:04:02 +00:00
docs(health.md): add text completion health check tutorial to docs
This commit is contained in:
@@ -77,3 +77,18 @@ model_list:
|
||||
mode: embedding # 👈 ADD THIS
|
||||
```
|
||||
|
||||
## Text Completion Models
|
||||
|
||||
We need some way to know if the model is a text completion model when running checks, if you have this in your config, specifying mode it makes an embedding health check
|
||||
|
||||
```yaml
|
||||
model_list:
|
||||
- model_name: azure-text-completion
|
||||
litellm_params:
|
||||
model: azure/text-davinci-003
|
||||
api_base: os.environ/AZURE_API_BASE
|
||||
api_key: os.environ/AZURE_API_KEY
|
||||
api_version: "2023-07-01-preview"
|
||||
model_info:
|
||||
mode: completion # 👈 ADD THIS
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user