tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-07 20:22:41 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added openrouter/meta-llama/llama-3-70b-instruct context and cost metadata

Browse Source 
Per https://openrouter.ai/models/meta-llama/llama-3-70b-instruct

Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct

Updated Apr 18
8,192 context
$0.8/M input tkns
$0.8/M output tkns
This commit is contained in:
Paul Gauthier
2024-04-22 15:07:58 -07:00
parent aa73c115f6
commit 0a021a6fa2
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
model_prices_and_context_window.json
+7
View File
@@ -1535,6 +1535,13 @@
"litellm_provider": "openrouter",
"mode": "chat"
},
"openrouter/meta-llama/llama-3-70b-instruct": {
"max_tokens": 8192,
"input_cost_per_token": 0.0000008,
"output_cost_per_token": 0.0000008,
"litellm_provider": "openrouter",
"mode": "chat"
},
"j2-ultra": {
"max_tokens": 8192,
"max_input_tokens": 8192,