tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 00:26:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

(feat) add groq api pricing, models

Browse Source
This commit is contained in:
ishaan-jaff
2024-02-29 16:11:22 -08:00
parent d2115d5a17
commit 4bfefd2b08
3 changed files with 31 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/providers/groq.md
+3
View File
@@ -1,6 +1,8 @@
# Groq
https://groq.com/
**We support ALL Groq models, just set `groq/` as a prefix when sending completion requests**
## API Key
```python
# env variable
@@ -47,3 +49,4 @@ We support ALL Groq models, just set `groq/` as a prefix when sending completion
| Model Name | Function Call |
|--------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| llama2-70b-4096 | `completion(model="groq/llama2-70b-4096", messages)` |
| mixtral-8x7b-32768 | `completion(model="groq/mixtral-8x7b-32768", messages)` |