tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 12:24:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

add proxy key details to docs

Browse Source
This commit is contained in:
Krrish Dholakia
2023-09-20 08:49:52 -07:00
parent 8094301424
commit 102fd83ea6
5 changed files with 23 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/providers/ai21.md
+4 -4
View File
@@ -11,6 +11,10 @@ We provide a free $10 community-key for testing all providers on LiteLLM. You ca
import os
os.environ["AI21_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your ai21 key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### Sample Usage
@@ -24,10 +28,6 @@ messages = [{"role": "user", "content": "Write me a poem about the blue sky"}]
completion(model="j2-light", messages=messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### AI21 Models
docs/my-website/docs/providers/anthropic.md
+5
View File
@@ -9,6 +9,11 @@ import os
os.environ["ANTHROPIC_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your anthropic key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
## Supported Models for LiteLLM Key
These are the models that currently work with the "sk-litellm-.." keys.
## Sample Usage
docs/my-website/docs/providers/nlp_cloud.md
+4
View File
@@ -10,6 +10,10 @@ import os
os.environ["NLP_CLOUD_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your nlp cloud key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Sample Usage
docs/my-website/docs/providers/openai.md
+4 -5
View File
@@ -9,6 +9,10 @@ import os
os.environ["OPENAI_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your openai key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### Usage
```python
@@ -24,11 +28,6 @@ messages = [{ "content": "Hello, how are you?","role": "user"}]
response = completion("gpt-3.5-turbo", messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### OpenAI Chat Completion Models
| Model Name | Function Call | Required OS Variables |
docs/my-website/docs/providers/togetherai.md
+6 -5
View File
@@ -9,6 +9,12 @@ import os
os.environ["TOGETHERAI_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your together ai key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Sample Usage
```python
@@ -22,11 +28,6 @@ messages = [{"role": "user", "content": "Write me a poem about the blue sky"}]
completion(model="together_ai/togethercomputer/Llama-2-7B-32K-Instruct", messages=messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Together AI Models
liteLLM supports `non-streaming` and `streaming` requests to all models on https://api.together.xyz/