tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-06-18 23:40:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

(feat) add groq api pricing, models

Browse Source
This commit is contained in:
ishaan-jaff
2024-02-29 16:11:22 -08:00
parent d2115d5a17
commit 4bfefd2b08
3 changed files with 31 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/providers/groq.md
+3
View File
@@ -1,6 +1,8 @@
# Groq
https://groq.com/
**We support ALL Groq models, just set `groq/` as a prefix when sending completion requests**
## API Key
```python
# env variable
@@ -47,3 +49,4 @@ We support ALL Groq models, just set `groq/` as a prefix when sending completion
| Model Name | Function Call |
|--------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| llama2-70b-4096 | `completion(model="groq/llama2-70b-4096", messages)` |
| mixtral-8x7b-32768 | `completion(model="groq/mixtral-8x7b-32768", messages)` |
litellm/model_prices_and_context_window_backup.json
+14
View File
@@ -580,6 +580,20 @@
"litellm_provider": "mistral",
"mode": "embedding"
},
"groq/llama2-70b-4096": {
"max_tokens": 4096,
"input_cost_per_token": 0.00000070,
"output_cost_per_token": 0.00000080,
"litellm_provider": "groq",
"mode": "chat"
},
"groq/mixtral-8x7b-32768": {
"max_tokens": 32768,
"input_cost_per_token": 0.00000027,
"output_cost_per_token": 0.00000027,
"litellm_provider": "groq",
"mode": "chat"
},
"claude-instant-1.2": {
"max_tokens": 100000,
"max_output_tokens": 8191,
model_prices_and_context_window.json
+14
View File
@@ -580,6 +580,20 @@
"litellm_provider": "mistral",
"mode": "embedding"
},
"groq/llama2-70b-4096": {
"max_tokens": 4096,
"input_cost_per_token": 0.00000070,
"output_cost_per_token": 0.00000080,
"litellm_provider": "groq",
"mode": "chat"
},
"groq/mixtral-8x7b-32768": {
"max_tokens": 32768,
"input_cost_per_token": 0.00000027,
"output_cost_per_token": 0.00000027,
"litellm_provider": "groq",
"mode": "chat"
},
"claude-instant-1.2": {
"max_tokens": 100000,
"max_output_tokens": 8191,