tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-11 07:05:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,302 Commits 2,072 Branches 1,425 Tags
83beb41096f69de76a6eef9994de59a8bc335612
Commit Graph

174 Commits

Author SHA1 Message Date
Paul Gauthier 9162f9c2c5 Added costs & context json 2024-05-07 11:44:55 -07:00
Ishaan Jaff e91f0382d7 feat - update gemini-1.5-pro pricing 2024-05-07 07:56:52 -07:00
Ishaan Jaff fbe412a3a6 feat - add amazon.titan-embed-text-v2 2024-05-03 15:58:05 -07:00
Justin Watts 77098e31e4 Update model_prices_and_context_window.json 2024-05-02 13:21:36 -07:00
Justin Watts 39670cd84a Add Vision Support for Claude 3 Family 
modified the model info table to add "supports_vision": true, for the claude 3 family (haiku, sonnet, and opus)
 2024-05-02 13:09:17 -07:00
Paul Gauthier 500ac36bd9 Added cost & context metadata for openrouter/anthropic/claude-3-opus 2024-05-01 10:43:40 -07:00
Krrish Dholakia 398d503590 build(model_prices_and_context_window.json): add bedrock llama3 pricing 2024-04-30 11:36:29 -07:00
Krrish Dholakia dc5c175406 build(model_prices_and_context_window.json): add token-based replicate costs to model cost map 2024-04-29 08:20:44 -07:00
Krrish Dholakia 7315bfd5de build(model_prices_and_context_window.json): add anthropic tool use system prompt tokens 
anthropic adds a system prompt when making tool calls - this adds to the cost of a tool call with anthropic
 2024-04-23 20:01:24 -07:00
Krrish Dholakia ab24f61099 fix(utils.py): fix mistral api tool calling response 2024-04-23 19:59:11 -07:00
Krrish Dholakia 305d526140 build(model_prices_and_context_window.json): add claude 3 supporting function calling as true flag 2024-04-23 15:38:42 -07:00
Paul Gauthier 0a021a6fa2 Added openrouter/meta-llama/llama-3-70b-instruct context and cost metadata 
Per https://openrouter.ai/models/meta-llama/llama-3-70b-instruct

Meta: Llama 3 70B Instruct
meta-llama/llama-3-70b-instruct

Updated Apr 18
8,192 context
$0.8/M input tkns
$0.8/M output tkns
 2024-04-22 15:07:58 -07:00
Ishaan Jaff 12bf4346ec feat - add llama3 on groq 2024-04-19 14:34:38 -07:00
Krish Dholakia bcdf24e5aa Merge pull request #3102 from BerriAI/litellm_vertex_ai_fixes 
fix(vertex_ai.py): fix faulty async call tool calling check
 2024-04-17 19:16:36 -07:00
Lucca Zenobio 387ed26db3 add mixtral 2024-04-17 21:54:12 -03:00
Krrish Dholakia 32d94feddd refactor(utils.py): make it clearer how vertex ai params are handled ' 
'
 2024-04-17 16:20:56 -07:00
Krrish Dholakia 7656bd1c3f build(model_prices_and_context_window.json): add gemini 1.5 pro latest to model cost map 2024-04-16 18:44:06 -07:00
Krrish Dholakia 96e995f53b docs(openai.md): add gpt-4-turbo to vision docs 2024-04-16 17:43:01 -07:00
David Manouchehri e74f25b8bb (feat): Add Claude v3 Opus on Amazon Bedrock. 2024-04-16 18:02:24 +00:00
Krish Dholakia 523b94acfd Merge pull request #2817 from ryanwclark1/gpt4turbopreview 
Update: gpt-4-turbo-preview pricing and context.  Included in docs.
 2024-04-16 07:35:52 -07:00
Krrish Dholakia 04dfe01660 build(model_prices_and_context_window.json): add output vector size for openai models 2024-04-16 07:16:53 -07:00
Krish Dholakia d9b3368146 Merge pull request #2999 from Dev-Khant/add-vertexai-text-embedding 
add vertex_ai/text-embedding-preview-0409
 2024-04-16 07:03:23 -07:00
Ishaan Jaff 351baf42b5 view models that support_vision 2024-04-15 18:07:03 -07:00
Ishaan Jaff a15f61cc05 Merge pull request #3029 from BerriAI/litellm_add_groq_tool_calling 
Feat - add groq tool calling + testing
 2024-04-15 08:49:52 -07:00
Krrish Dholakia ab1e26ad89 build(model_prices_and_context_window.json): add vertex ai claude 3 opus 2024-04-15 08:45:33 -07:00
Ishaan Jaff 5606971bbb add "supports_function_calling": true for grow 2024-04-15 08:18:56 -07:00
Dev Khant 531eef359d add vertex_ai/text-embedding-preview-0409 2024-04-13 13:00:12 +05:30
David Manouchehri 7f137bc909 Feature: add gemini-1.0-pro-001 and gemini-1.0-pro-002 to models list 2024-04-10 21:48:56 +00:00
Krish Dholakia 6d8d8e9909 Merge pull request #2914 from cheahjs/feat/vertex-gemini-1.5.pro-public-preview 
feat: add gemini-1.5-pro-preview-0409 to vertex ai
 2024-04-09 18:08:25 -07:00
Ventz Petkov 17111d2f47 Update model_prices_and_context_window.json 
Added support for `gpt-4-turbo-2024-04-09` and `gpt-4-turbo`
 2024-04-09 16:02:35 -04:00
Jun Siang Cheah ea86913e1c feat: add gemini-1.5-pro-preview-0409 to vertex ai 2024-04-09 17:02:56 +01:00
Ishaan Jaff 4c7f38fca9 add voyage2 embeddings 2024-04-09 07:43:22 -07:00
Krrish Dholakia e424a294a5 build(model_prices_and_context_window.json): add pricing for bedrock mistral paris region 2024-04-06 09:23:09 -07:00
Ishaan Jaff 2174b240d8 Merge pull request #2861 from BerriAI/litellm_add_azure_command_r_plust 
[FEAT] add azure command-r-plus
 2024-04-05 15:13:35 -07:00
Krish Dholakia 762f68db85 Merge pull request #2859 from cheahjs/feat/vertex-gemini-experimental 
feat: add gemini-experimental to vertex ai
 2024-04-05 13:55:50 -07:00
Jun Siang Cheah 2b326ce6fd feat: add gemini-experimental to vertex ai 2024-04-05 18:44:05 +01:00
Krrish Dholakia f0c4ff6e60 fix(vertex_ai_anthropic.py): support streaming, async completion, async streaming for vertex ai anthropic 2024-04-05 09:27:48 -07:00
Ishaan Jaff 65b1a7be73 add azure command_r_plust 2024-04-05 08:51:39 -07:00
Krish Dholakia eb34306099 Merge pull request #2665 from BerriAI/litellm_claude_vertex_ai 
[WIP] feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai
 2024-04-05 07:06:04 -07:00
Krish Dholakia 4ce8227e70 Merge pull request #2841 from Manouchehri/nuke-gemini-1.5-pro-vision 
Fix: Remove non-existent gemini-1.5-pro-vision model.
 2024-04-05 07:03:38 -07:00
lucca be265fbb15 initial 2024-04-04 16:58:51 -03:00
David Manouchehri 6044045b91 Fix: Remove non-existent gemini-1.5-pro-vision model. 
The gemini-1.5-pro model handles both text and vision.
 2024-04-04 17:33:08 +00:00
ryanwclark1 62caa7e858 Update gpt-4-turbo-preview pricing and context. Included in docs. 2024-04-03 10:48:14 -05:00
Krrish Dholakia 89471ba4c5 build(model_prices_and_context_window.json): add proper bedrock mixtral model name 2024-03-30 08:37:06 -07:00
Krrish Dholakia eb3ca85d7e feat(router.py): enable pre-call checks 
filter models outside of context window limits of a given message for a model group

 https://github.com/BerriAI/litellm/issues/872
 2024-03-23 18:03:30 -07:00
Krrish Dholakia 05029fdcc7 feat(vertex_ai_anthropic.py): Add support for claude 3 on vertex ai 2024-03-23 15:53:04 -07:00
Dragos Campean 40c2c343be Update small model name 2024-03-19 20:05:32 +02:00
Dragos Campean 28d5175908 Correct prices for mistral models 2024-03-19 20:02:09 +02:00
Dragos Campean f3c0b530b8 Add mistral medium latest to model prices 2024-03-17 16:01:40 +02:00
USAGI a9634b717c Add groq/gemma-7b-it 2024-03-15 11:50:19 +08:00