tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-18 04:28:19 +00:00
Code Issues Packages Projects Releases Wiki Activity

(docs) using azure_text models

Browse Source
This commit is contained in:
ishaan-jaff
2024-03-12 09:54:34 -07:00
parent 223ac464d7
commit ea83c8c9b0
1 changed files with 21 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/providers/azure.md
+21 -3
View File
@@ -118,7 +118,7 @@ response = completion(
```
### Usage - with Azure Vision enhancements
#### Usage - with Azure Vision enhancements
Note: **Azure requires the `base_url` to be set with `/extensions`**
@@ -170,12 +170,30 @@ response = completion(
## Azure Instruct Models
Use `model="azure_text/<your-deployment>"`
| Model Name | Function Call |
|---------------------|----------------------------------------------------|
| gpt-3.5-turbo-instruct | `response = completion(model="azure/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct-0914 | `response = completion(model="azure/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct | `response = completion(model="azure_text/<your deployment name>", messages=messages)` |
| gpt-3.5-turbo-instruct-0914 | `response = completion(model="azure_text/<your deployment name>", messages=messages)` |
```python
import litellm
## set ENV variables
os.environ["AZURE_API_KEY"] = ""
os.environ["AZURE_API_BASE"] = ""
os.environ["AZURE_API_VERSION"] = ""
response = litellm.completion(
model="azure_text/<your-deployment-name",
messages=[{"role": "user", "content": "What is the weather like in Boston?"}]
)
print(response)
```
## Advanced
### Azure API Load-Balancing