tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-18 04:28:19 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix docs

Browse Source
This commit is contained in:
ishaan-jaff
2023-08-17 16:35:55 -07:00
parent f1caef7975
commit 63b39ce447
1 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/completion/supported.md
+4 -2
View File
@@ -94,7 +94,8 @@ Here are some examples of supported models:
### Together AI Models
liteLLM supports `non-streaming` and `streaming` requests to all models on https://api.together.xyz/
# Example TogetherAI Usage - Note: liteLLM supports all models deployed on TogetherAI
Example TogetherAI Usage - Note: liteLLM supports all models deployed on TogetherAI
| Model Name | Function Call | Required OS Variables |
|-----------------------------------|------------------------------------------------------------------------|---------------------------------|
| togethercomputer/llama-2-70b-chat | `completion('togethercomputer/llama-2-70b-chat', messages)` | `os.environ['TOGETHERAI_API_KEY']` |
@@ -107,7 +108,8 @@ liteLLM supports `non-streaming` and `streaming` requests to all models on https
### Baseten Models
Baseten provides infrastructure to deploy and serve ML models https://www.baseten.co/. Use liteLLM to easily call models deployed on Baseten.
# Example Baseten Usage - Note: liteLLM supports all models deployed on Basten
Example Baseten Usage - Note: liteLLM supports all models deployed on Basten
| Model Name | Function Call | Required OS Variables |
|------------------|--------------------------------------------|------------------------------------|
| Falcon 7B | `completion(model='<your model version id>', messages=messages, custom_llm_provider="baseten")` | `os.environ['BASETEN_API_KEY']` |