tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-06 00:23:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,275 Commits 2,072 Branches 1,425 Tags
d6cd50dfdbe9bea6dfd378f0a7717b467ef055fe
Commit Graph
821 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 9750374081 [Feat] New LLM API - AI/ML API for Image Gen (#13893) 
* add LlmProviders.AIML

* add AIMLChatConfig

* add aiml

* fix AimlImageGenerationConfig

* add AimlImageGenerationConfig

* add cost_calculator

* fixes for AI ML API

* add known AIML Flux image models

* add AIML Cost Calc

* add AI/ML API

* add aiml_models
 2025-08-23 13:12:44 -07:00
Krish DholakiaandGitHub 49cb9bdbca Merge pull request #13843 from BerriAI/litellm_dev_08_29_2025_p3 
SSO - Free SSO usage for up to 5 users + remove deprecated dbrx models (dbrx-instruct, llama 3.1)
 2025-08-23 12:06:01 -07:00
Krrish Dholakia eb7e5e3a71 Revert "build(model_prices_and_context_window.json): remove retired dbrx model" 
This reverts commit 10d49d0174.
 2025-08-23 10:47:44 -07:00
Krrish Dholakia 10d49d0174 build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-23 10:36:52 -07:00
Krrish Dholakia c270c5a37a build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-23 10:36:52 -07:00
Sameer Kankute f239a0f78a Add openrouter deepseek/deepseek-chat-v3.1 support 2025-08-22 22:59:09 +05:30
Krish DholakiaandGitHub 9c4a86e98e Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model 
[Feat] Add support for voyage-context-3 embedding model
 2025-08-21 23:18:20 -07:00
Toy-97andGitHub 8ba292f201 fix extra bracket.json 2025-08-22 13:21:41 +08:00
Toy-97andGitHub 62ae6d8bbc Update model metadata for deepinfra.json 2025-08-22 13:11:55 +08:00
Ishaan JaffandGitHub 5978f25299 add new gemini/imagen-4.0 models (#13876) 2025-08-21 15:32:31 -07:00
Ishaan JaffandGitHub 9e9ba6861d [Feat] Add new VertexAI image models vertex_ai/imagen-4.0-generate-001, vertex_ai/imagen-4.0-ultra-generate-001, vertex_ai/imagen-4.0-fast-generate-001 (#13874) 
* add vertex_ai/imagen-4.0-fast-generate-001

* add vertex_ai/imagen-4.0-ultra-generate-001

* add vertex_ai/imagen-4.0-generate-001
 2025-08-21 15:15:44 -07:00
Sameer Kankute 5ac4fb512c Add support for voyage-context-3 embedding model 2025-08-22 00:15:12 +05:30
Krrish Dholakia ebab77e7ce build(model_prices_and_context_window.json): remove retired dbrx model 2025-08-20 21:27:06 -07:00
Krrish Dholakia ea39094658 build(model_prices_and_context_window.json): remove deprecated model from model cost map 2025-08-20 21:24:18 -07:00
Ishaan JaffandGitHub 55dcaded72 [Feat] Add VertexAI qwen API Service (#13828) 
* add support for vertex AI QWEN API

* streaming QWEN API support

* test_partner_models_httpx

* test_partner_models_httpx_streaming

* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa

* docs qwen models vertexAI
 2025-08-20 15:00:33 -07:00
Ishaan JaffandGitHub 6f6fd0de0d add fireworks_ai/accounts/fireworks/models/deepseek-v3-0324 (#13821) 2025-08-20 14:31:24 -07:00
Krish DholakiaandGitHub bfe814f981 Merge pull request #13637 from Tasmay-Tibrewal/main 
Added Qwen3, Deepseek R1 0528 Throughput, GLM 4.5 and GPT-OSS models for Together AI
 2025-08-19 22:33:17 -07:00
Krish DholakiaandGitHub 749bafc550 Merge pull request #13660 from BerriAI/litellm_azure_gpt-t 
[LLM Translation] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration
 2025-08-19 22:32:56 -07:00
Krish DholakiaandGitHub be30bc68ae Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations 
Add long context support for claude-4-sonnet
 2025-08-19 22:30:25 -07:00
Krrish Dholakia 7d09375d52 fix: fix gpt-5-chat mappings 2025-08-19 22:21:00 -07:00
Sameer KankuteandGitHub b5f0a7b49b Merge branch 'main' into litellm_feat_correct_cost_calculations 2025-08-19 18:55:36 +05:30
Sameer Kankute 4f38a63152 Add long context support for claude-4-sonnet 2025-08-19 16:40:12 +05:30
Krish DholakiaandGitHub 422447b7f1 Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle openai/v1/responses 
Responses API - add default api version for openai responses api calls + Openrouter - fix claude-sonnet-4 on openrouter + Azure - Handle `openai/v1/responses`
 2025-08-18 18:59:28 -07:00
superpoussin22andGitHub b42df63d17 does not support function (#13612) 2025-08-18 08:45:25 -07:00
Jugal Bhatt 790d2d0830 [Update] Adjust max_input_tokens for azure/gpt-5-chat models in JSON configuration 
* Reduced max_input_tokens from 400000 to 272000 for both azure/gpt-5-chat and azure/gpt-5-chat-latest to optimize resource usage and align with updated model specifications.
 2025-08-15 10:57:39 -07:00
Tasmay Pankaj TibrewalandGitHub d9105a99ab fixed comma delimeter issue 2025-08-15 05:07:46 +05:30
Tasmay Pankaj TibrewalandGitHub d20391101b fixed together ai provider name mistake 2025-08-15 04:43:52 +05:30
Tasmay Pankaj TibrewalandGitHub 4b51e5787c added qwen3, deepseek r1 0528 throughput, glm 4.5 and gpt oss models 2025-08-15 04:33:49 +05:30
huangyafei 2b89f95e37 Add deepseek-chat-v3-0324 to OpenRouter model list 2025-08-14 10:44:15 +08:00
Ishaan JaffandGitHub 76d25926d4 [Feat] New provider - Azure AI Flux Image Generation (#13592) 
* init files

* add AzureFoundryModelInfo

* fix api_version property

* add azure_ai img gen

* use AzureFoundryModelInfo

* get_base_image_generation_call_args

* add azure_ai/FLUX-1.1-pro

* add util for route_image_generation_cost_calculator

* docs azure ai flux

* fixes for flux

* fixes for AzureFoundryFluxImageGenerationConfig

* ruff fix
 2025-08-13 17:20:30 -07:00
Ishaan JaffandGitHub 75bcfbb76a [Feat] New model vertex_ai/deepseek-ai/deepseek-r1-0528-maas (#13594) 
* add ertex_ai/deepseek-ai/deepseek-r1-0528-maas

* fix init

* test_model_info_for_vertex_ai_deepseek_model
 2025-08-13 13:44:45 -07:00
Ishaan JaffandGitHub 828e3e3deb [Feat] Add Streaming support + Docs for bedrock gpt-oss model family (#13346) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input

* fix for should_fake_stream

* TestBedrockGPTOSS

* should_fake_stream

* update supports vision field for openai.gpt-oss models

* fixes for bedrock gpt oss

* fixes for should_fake_stream

* docs bedrock gpt oss models
 2025-08-12 08:39:36 -07:00
Krrish Dholakia e1fd49ce91 build(model_prices_and_context_window.json): fix claude-sonnet-4 on openrouter 
Fixes https://github.com/BerriAI/litellm/issues/13520
 2025-08-11 23:26:06 -07:00
Krish DholakiaandGitHub 184687157e Litellm model cost map fixes (#13480) 
* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix max token values

* build(model_prices_and_context_window.json): fix azure gpt-5-chat pricing
 2025-08-10 07:38:35 -07:00
Sannan NasirandGitHub 0e53b1feab Add digitalocean provider (#12169) 
* Add digitalocean provider

* Add digitalocean provider

* Revert "Add digitalocean provider"

This reverts commit 96dda40f45b3d12ea03e861d060ec81460b7759e.

* changes

* fixes

* Update transformation

* refactoring

* rename provider to Gradient AI

* fixes

* Incorporte review comments

* revert changes

* fix typo

* revert change

* incorporated review comments

* Revert "Incorporte review comments"

This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597.

* changes

* Revert "Revert "Incorporte review comments"

This reverts commit 37bd51bd54ef4fd52ccc12866e47f8de9476d597."

This reverts commit 68c8a198ee0d6441c3a52f6c6a49c9c95a4cb0a8.

* changes

* fixes

* Update provider_specific_fields.tsx
 2025-08-09 16:26:33 -07:00
Cole McIntoshandGitHub d874bec480 feat(models): add OpenRouter and Cerebras GPT-OSS models (20b, 120b) with pricing and context windows; update backup; refs #13428 (#13442) 2025-08-08 22:47:51 -07:00
Jugal D. BhattandGitHub f55666bf5f fix prices for oai gpt 5 (#13441) 2025-08-08 14:33:21 -07:00
Emerson GomesandGitHub aea5af2165 Correct GPT-5 token limits and price (#13423) 2025-08-08 08:55:33 -07:00
Ishaan Jaff 9b86d721d5 test fix oci supports tool choice 2025-08-07 15:26:25 -07:00
Ishaan Jaff 70ddde2215 fix - remove dup model entries 2025-08-07 13:22:00 -07:00
Ishaan JaffandGitHub 2e767c8faf [Feat] add azure/gpt-5 model family (#13385) 
* add azure/gpt-5 model family

* add azure gpt-5 model family

* fixes for gpt-5

* add azure/gpt-5 model family
 2025-08-07 12:50:37 -07:00
Ishaan JaffGitHubCole McIntosh
 		087a1a622c feat: Add GPT-5 model family with official OpenAI specifications (#13… (#13386) 
* feat: Add GPT-5 model family with official OpenAI specifications (#13378)

* Add GPT-5 model family support

Added four new GPT-5 models:
- gpt-5: Flagship model for logic and multi-step tasks
- gpt-5-mini: Cost-sensitive version for budget use cases
- gpt-5-nano: Speed-optimized version for low latency
- gpt-5-chat: Enterprise-focused version for advanced conversations

* Update GPT-5 models with official OpenAI specifications

- Add gpt-5-chat-latest with 400k context, 128k output tokens
- Add gpt-5-2025-08-07 with enhanced reasoning capabilities
- Add gpt-5-mini-2025-08-07 with cost-optimized pricing
- Add gpt-5-nano-2025-08-07 with ultra-fast performance
- Update existing gpt-5, gpt-5-mini, gpt-5-nano to match dated versions
- All models now support reasoning tokens and 400k context window
- Pricing updated per official OpenAI documentation

* fix conflicts

---------

Co-authored-by: Cole McIntosh <82463175+colesmcintosh@users.noreply.github.com>
 2025-08-07 11:58:37 -07:00
Ishaan JaffandGitHub 729e1f530a feat - add claude-opus-4-1 on cost map (#13384) 2025-08-07 11:52:44 -07:00
Low Jian ShengandGitHub 9e0ba10f23 Add GPT 5 models (#13377) 
* add gpt 5 modesl

* update max tokens
 2025-08-07 11:36:16 -07:00
breno-aumoandGitHub e8b4b25774 Update OCI docs (#13336) 
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs
 2025-08-07 09:45:17 -07:00
Ishaan JaffandGitHub 9c5e9d7362 add groq/openai/gpt-oss (#13363) 2025-08-07 00:08:18 -07:00
Ishaan JaffandGitHub 28a894cb06 [Feat] - New model - Add Bedrock gpt oss models - "openai.gpt-oss-20b-1:0", "openai.gpt-oss-120b-1:0" (#13342) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input
 2025-08-06 09:24:04 -07:00
Krrish Dholakia 2e3f564a39 fix: fix map 2025-08-05 18:33:36 -07:00
Krrish Dholakia 352b7ae913 build(model_prices_and_context_window.json): add vertex ai claude-opus-4.1 
Add claude opus 4.1
 2025-08-05 17:52:35 -07:00
Ishaan Jaff 475aa06117 anthropic.claude-opus-4 2025-08-05 14:08:21 -07:00