tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-23 16:24:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,298 Commits 2,072 Branches 1,425 Tags
f07ef8af00a4010145c415ef39a673d96d5e00c8
Commit Graph
1244 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub a8054264ae Merge pull request #19975 from BerriAI/litellm_oss_staging_01_29_2026 
Litellm oss staging 01 29 2026
 2026-01-30 16:58:28 +05:30
Sameer KankuteandGitHub fdb4b54add Merge pull request #20009 from genga6/fix/#20006-update-max-input-tokens-for-gpt-5.2-codex 
Fix `max_input_tokens` for `gpt-5.2-codex`
 2026-01-30 16:18:53 +05:30
Sameer KankuteandGitHub eb50c780e9 Merge branch 'main' into litellm_oss_staging_01_29_2026 2026-01-30 09:03:05 +05:30
Ishaan JaffandGitHub f7e1a22947 [Feat] New Model - amazon.nova-2-pro-preview-20251202-v1:0 (#20033) 
* init: amazon.nova-2-pro-preview-20251202-v1:0

* init: nova amazon.nova-2-pro

* add s3_vectors
 2026-01-29 16:55:55 -08:00
Takumi Matsuzawa fa54c241e0 Fix max_input_tokens for gpt-5.2-codex 2026-01-29 15:39:17 +00:00
Sameer KankuteandGitHub df072979e5 Merge branch 'main' into litellm_oss_staging_01_28_2026 2026-01-29 17:39:42 +05:30
Sameer Kankute ef15861fde Fix: litellm_fix_robotic_model_map_entry 2026-01-29 17:26:50 +05:30
Aaron YimGitHubClaude Opus 4.5
 		d4031c8ba6 Add OpenRouter Kimi K2.5 (#19872) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-28 22:34:48 -08:00
Sameer Kankute be8a76f270 fix gemini gemini-robotics-er-1.5-preview entry 2026-01-29 09:06:44 +05:30
rushilchugh01GitHubRushil Chugh <Rushil>
 		562f0a0282 feat: Add new OpenRouter models: xiaomi/mimo-v2-flash, z-ai/glm-4.7, z-ai/glm-4.7-flash, and minimax/minimax-m2.1. to model prices and context window (#19938) 
Co-authored-by: Rushil Chugh <Rushil>
 2026-01-28 18:56:20 -08:00
Sameer Kankute 3ab1b9f543 Fix gemini-robotics-er-1.5-preview name 2026-01-28 21:13:37 +05:30
Sameer KankuteandGitHub 9fe8b12f44 Merge pull request #19924 from BerriAI/litellm_minimax_reasoning_caching_1 
Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi
 2026-01-28 18:04:13 +05:30
Sameer Kankute f6ead49afe Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi 2026-01-28 17:25:26 +05:30
Sameer KankuteandGitHub 42a0d576f3 Merge pull request #19910 from BerriAI/main 
merge 01 27
 2026-01-28 08:30:47 +05:30
Jay PrajapatiandGitHub 6a9d41234f fix: allow tool_choice for Azure GPT-5 chat models (#19813) 
* fix: don't treat gpt-5-chat as GPT-5 reasoning

* fix: mark azure gpt-5-chat as supporting tool_choice

* test: cover gpt-5-chat params on azure/openai
 2026-01-27 17:51:13 -08:00
Sameer KankuteandGitHub c8a93c7d81 Merge pull request #19845 from BerriAI/litellm_gemini-robotics-er-1.5-preview2 
Add  Gemini Robotics-ER 1.5 preview support
 2026-01-27 17:47:44 +05:30
Sameer KankuteandGitHub c834d7d1fe Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer KankuteandGitHub 9a2750f8ec Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026 
Litellm oss staging 01 23 2026
 2026-01-27 16:55:32 +05:30
Sameer Kankute cf012a2f65 Add gemini-robotics-er-1.5-preview model in model map 2026-01-27 13:58:03 +05:30
Cesar GarciaandGitHub e4a557d95f fix(xai): correct cached token cost calculation for xAI models (#19772) 
* fix(azure): use generic cost calculator for audio token pricing

Azure audio models were charging audio output tokens at the text token
rate instead of the correct audio token rate. This resulted in costs
being ~6.65x lower than expected.

The fix replaces Azure's custom cost calculation logic with the generic
cost calculator that properly handles text, audio, cached, reasoning,
and image tokens.

Fixes #19764

* fix(xai): correct cached token cost calculation for xAI models

- Fix double-counting issue where xAI reports text_tokens = prompt_tokens
  (including cached), causing tokens to be charged twice
- Add cache_read_input_token_cost to xAI grok-3 and grok-3-mini model variants
- Detection: when text_tokens + cached_tokens > prompt_tokens, recalculate
  text_tokens = prompt_tokens - cached_tokens

xAI pricing (25% of input for cached):
- grok-3 variants: $0.75/M cached (input $3/M)
- grok-3-mini variants: $0.075/M cached (input $0.30/M)
 2026-01-26 21:00:35 -08:00
Cesar GarciaandGitHub 0d45b01069 fix(models): set gpt-5.2-codex mode to responses for Azure and OpenRouter (#19770) 
Fixes #19754

The gpt-5.2-codex model only supports the responses API, not chat completions.
Updated azure/gpt-5.2-codex and openrouter/openai/gpt-5.2-codex entries to use
mode: "responses" and supported_endpoints: ["/v1/responses"].
 2026-01-26 20:36:10 -08:00
Cesar GarciaandGitHub 31a8d76d11 Update Gemini 2.0 Flash deprecation dates to March 31, 2026 (#19592) 
Google announced that Gemini 2.0 Flash and Flash Lite models will be discontinued on March 31, 2026. Updated deprecation_date field for all affected model variants across different providers (vertex_ai, gemini, deepinfra, openrouter, vercel_ai_gateway).

Models updated:
- gemini-2.0-flash (added deprecation date)
- gemini-2.0-flash-001 (updated from 2026-02-05)
- gemini-2.0-flash-lite (added deprecation date)
- gemini-2.0-flash-lite-001 (updated from 2026-02-25)

All variants now correctly reflect the March 31, 2026 shutdown date.
 2026-01-23 20:36:36 -08:00
John GreekandGitHub 26a2c90818 [Fix] Anthropic models on Azure AI cache pricing (#19532) (#19614) 2026-01-22 20:00:40 -08:00
拐爷&&老拐瘦GitHubClaude Opus 4.5
 		3372430d40 Add pricing for volcengine models (deepseek-v3-2, glm-4-7, kimi-k2-thinking) (#19335) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-22 19:47:21 -08:00
Sameer KankuteandGitHub ad1edd38d5 Merge branch 'main' into litellm_staging_01_21_2026 2026-01-22 17:56:40 +05:30
Sameer KankuteandGitHub 36f3250016 Merge pull request #19500 from Chesars/fix/audio-model-pricing 
fix(pricing): correct audio token costs for gpt-4o-audio-preview models
 2026-01-22 09:18:55 +05:30
Cesar GarciaGitHubKrish Dholakia
 		4106d24215 feat: add GMI Cloud provider support (#19376) 
* feat: add GMI Cloud provider support

Add GMI Cloud as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 16 models (Claude, GPT, DeepSeek, Gemini, etc.)
- Sidebar entry for docs navigation

* Add gmi_cloud to provider_endpoints_support.json

Add provider entry to pass CI validation check that ensures all
providers in openai_like/providers.json are documented.

* Fix provider key: gmi_cloud -> gmi

Match the provider key with providers.json

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
 2026-01-21 15:48:15 -08:00
Chesars 796e93552d Fix gpt-audio models pricing and add dated snapshots 
- Fix audio token pricing for gpt-audio ($32/$64 per 1M, not $40/$80)
- Add gpt-audio-2025-08-28 snapshot (OpenAI returns this in responses)
- Add gpt-audio-mini-2025-10-06 and gpt-audio-mini-2025-12-15 snapshots
- Add missing fields: supported_endpoints, supported_modalities,
  supported_output_modalities, supports_native_streaming, etc.
 2026-01-21 13:05:38 -03:00
Chesars da8770004c Add gpt-audio and gpt-audio-mini models to pricing 
Fixes #19490 - adds missing OpenAI audio models with correct pricing:

gpt-audio:
- Text: $2.50/$10.00 per 1M tokens (input/output)
- Audio: $40/$80 per 1M tokens (input/output)

gpt-audio-mini:
- Text: $0.60/$2.40 per 1M tokens (input/output)
- Audio: $10/$20 per 1M tokens (input/output)
 2026-01-21 12:47:10 -03:00
Chesars a0cfb56801 fix(pricing): correct audio token costs for gpt-4o-audio-preview models 
Update audio token pricing for gpt-4o-audio-preview and
gpt-4o-audio-preview-2024-10-01 to match OpenAI's official pricing:

- input_cost_per_audio_token: 0.0001 -> 4e-05 ($40/1M tokens)
- output_cost_per_audio_token: 0.0002 -> 8e-05 ($80/1M tokens)

The previous values were 2.5x higher than OpenAI's actual pricing.
 2026-01-21 10:46:03 -03:00
Sameer KankuteandGitHub 540370a1aa Merge pull request #19479 from BerriAI/litellm_sarvam_int 
Add support for sarvam models
 2026-01-21 19:03:52 +05:30
Connor Luebbehusen b810a68f89 fix: correct gemini-2.5-flash-lite audio input and cache read pricing 2026-01-21 05:58:38 -05:00
Sameer Kankute 46c0f903a3 Add support for sarvam models 2026-01-21 15:17:26 +05:30
Sameer KankuteandGitHub 9e1275b76c Merge branch 'main' into litellm_staging_01_19_2026 2026-01-20 19:19:36 +05:30
Sameer KankuteandGitHub deb9142117 Merge pull request #19400 from BerriAI/main 
merge main iin 19/1 staging
 2026-01-20 16:45:01 +05:30
Sameer Kankute cebcad48d3 Add gemini-2.5-computer-use-preview-10-2025 model for vertex ai provider 2026-01-20 15:53:02 +05:30
Connor LuebbehusenandGitHub d48df6c17d fix: correct us.anthropic.claude-opus-4-5 In-region pricing (#19310) 2026-01-19 19:00:24 -08:00
Connor LuebbehusenandGitHub 2ba7d2e821 fix: correct Groq gpt-oss pricing and add cache pricing (#19311) 2026-01-19 10:41:28 -08:00
Manuel SchweigertandGitHub 29adf34313 Add ChatGPT subscription support and responses bridge (#19030) 
* Add ChatGPT subscription support and responses bridge

* Fix typing import for responses bridge

* Guard device code timestamp parsing

* add /v1/messages endpoint to chatgpt model
 2026-01-19 05:37:45 -08:00
Sameer KankuteandGitHub c5a8d4e34e Merge branch 'main' into litellm_staging_01_16_2026 2026-01-19 18:11:21 +05:30
Ostap BodnarandGitHub ce1a2c3209 add openai/dall-e base pricing entries (#19133) 2026-01-17 04:48:46 +05:30
YutaSaitoandGitHub 7aba0f738a Revert "Litellm staging 01 15 2026" 2026-01-17 06:31:34 +09:00
Ishaan Jaffer b86aae0212 fix stability mode 2026-01-16 09:08:11 -08:00
Sameer Kankute 48d1e769a8 Add azure/gpt-5.2-codex 2026-01-16 18:37:05 +05:30
Sameer KankuteandGitHub 5782832b82 Merge pull request #19199 from BerriAI/litellm_fix_stability_issues1 
[Fix] Bedrock stability model usage issues
 2026-01-16 18:17:11 +05:30
Sameer Kankute c76b527281 Fix model map 2026-01-16 17:17:21 +05:30
Sameer KankuteandGitHub f3ca05112e Merge pull request #19206 from BerriAI/main 
merge main
 2026-01-16 15:22:16 +05:30
Sameer Kankute 4d45574fc5 fix Updated all 27 occurrences of mode: image_edit to mode: image_edits 2026-01-16 14:47:06 +05:30
Emerson GomesandGitHub e8fa8c5fa1 fix gcp glm-4.7 pricing (#19172) 2026-01-15 18:35:40 -08:00
拐爷&&老拐瘦GitHubClaude Opus 4.5
 		92827ead65 Add pricing for volcengine models (deepseek-v3-2, glm-4-7, kimi-k2-thinking) (#19076) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-16 03:30:34 +05:30