566adebdec
update model_prices_and_context_window.json ( #17376 )
...
* update model_prices_and_context_window.json
* update
* update
2025-12-02 22:06:51 -08:00
ae633184f7
Add model price & details for Bedrock model global.anthropic.claude-opus-4-5-20251101-v1:0 ( #17380 )
2025-12-02 22:02:57 -08:00
f22bc0aab2
Support Deepseek 3.2 with Reasoning ( #17384 )
...
* Add openrouter/deepseek/deepseek-v3.2
* Added deepseek-provided v3.2
* Allow reasoning effort param for openrouter models that support it
* Added tests
2025-12-02 22:00:19 -08:00
31cad8e6e6
feat: Add Nova lite 2 reasoning support with reasoningConfig ( #17371 )
2025-12-02 16:33:07 -08:00
10d56e7c46
add new deepseek-v3p2 ( #17395 )
2025-12-02 16:19:34 -08:00
6c188c5ae2
[Feat] New model/provider - Adds support for Google Cloud Chirp3 HD on /speech ( #17391 )
...
* docs vertex tts
* place vertex ai types in file
* use VertexAITextToSpeechConfig
* use vertex_voice_dict
* refactor docs
* docs vertex ai chirp
* TestVertexAITextToSpeechConfig
* new provider vertex ai chirp3
* test_litellm_speech_vertex_ai_chirp
* add vertex_ai/chirp cost trackign
2025-12-02 15:36:23 -08:00
6e8e3b30f9
Update Databricks model pricing and add new models (including databricks pricing test). ( #17277 )
...
* update databricks pricing and add DBU<>USD test
* Refactor test_databricks_pricing.py
Removed unnecessary sys.path modification and cleaned up comments.
2025-12-01 20:06:47 -08:00
965406c643
feat(provider): add Z.AI (Zhipu AI) as built-in provider ( #17307 )
...
* feat(provider): add Z.AI (Zhipu AI) as built-in provider
Add support for Z.AI GLM models as a native OpenAI-compatible provider.
- Add "zai" to openai_compatible_providers list
- Add ZAI enum to LlmProviders
- Add provider URL resolution for https://api.z.ai/api/paas/v4
- Add 8 GLM models with pricing to model cost maps:
- glm-4.6 (200K context, $0.6/$2.2 per 1M tokens)
- glm-4.5, glm-4.5v, glm-4.5-x, glm-4.5-air, glm-4.5-airx
- glm-4-32b-0414-128k
- glm-4.5-flash (free tier)
- Add unit tests for provider integration
Closes #17289
* docs: add Z.AI provider documentation
- Add zai.md with usage examples, model list, and pricing
- Add to sidebars.js navigation
2025-12-01 19:56:47 -08:00
be920d75d3
Add claude-opus-4-5 alias ( #17313 )
...
Similar to `claude-sonnet-4-5`.
2025-12-01 18:25:26 -08:00
f434ca61ec
add kimi-k2-instruct-0905 ( #17328 )
2025-12-01 14:14:41 -08:00
71f41352fa
Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support
...
(Bug)Migrate Anthropic provider to azure ai
2025-11-28 08:14:14 +05:30
edfc35ddac
[Feature]: Add Provider publicai.co ( #17230 )
...
* init PublicAIChatConfig
* add publicai
* init public ai
* add publicai
* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
5fc950ec05
migrate anthropic provider to azure ai provider
2025-11-27 19:47:54 +05:30
48eb34a875
fix cos tracking
2025-11-26 18:26:07 -08:00
32617d1e72
Add OpenRouter Opus 4.5 ( #17144 )
2025-11-26 15:45:45 -08:00
d987593855
[Feat] Add audio transcriptions for WatsonX ( #17160 )
...
* feat: add IBMWatsonXAudioTranscriptionConfig
* init IBMWatsonXAudioTranscriptionConfig
* add inits
* test_watsonx_transcription_url_and_headers
* docs watsox audio
* docs watsonx audi
* docs
2025-11-26 14:15:49 -08:00
0f59e5fa3a
add fireworks_ai/accounts/fireworks/models/glm-4p6 ( #17154 )
2025-11-26 11:28:28 -08:00
fcf9ab4f7f
Add embed-multilingual-light-v3.0 costing
2025-11-26 16:12:34 +05:30
70a1325847
docs: more doc cleanup
2025-11-25 15:01:22 -08:00
e0396e5fa7
Merge pull request #17082 from BerriAI/main
...
merge main
2025-11-25 18:49:52 +05:30
afe540e88d
Fix auth issue
2025-11-25 18:26:25 +05:30
a807fe4450
add claude opus 4.5 ( #17043 )
...
* add claude opus 4.5
* Apply suggestion from @Chesars
Co-authored-by: Cesar Garcia <128240629+Chesars@users.noreply.github.com >
---------
Co-authored-by: Cesar Garcia <128240629+Chesars@users.noreply.github.com >
2025-11-24 14:30:36 -08:00
9817347013
fix govcloud
2025-11-22 10:46:12 -08:00
0ed443f3bd
fix claude-sonnet-4-5-20250929-v1:0
2025-11-22 10:02:15 -08:00
eb10dd497d
fix bedrock model info
2025-11-22 09:41:15 -08:00
661117678c
Revert "remove deprecated embedding model ( #16724 )" ( #16970 )
...
This reverts commit b9bc903536
2025-11-22 09:34:53 -08:00
7b05a5f9ae
Add full information to vertex_ai/gemini-2.5-flash-image key ( #16882 )
...
Co-authored-by: IQHL (Hans Jacob Landelius) <iqhl@novnordisk.com >
2025-11-21 20:02:02 -08:00
703f619e08
feat(bedrock): Add Claude 4.5 to US Gov Cloud ( #16957 )
...
* feat(bedrock): Add Claude 4.5 to US Gov Cloud
* Adding west and tests
2025-11-21 19:06:26 -08:00
58a56babd9
test fixes for masker
2025-11-21 17:41:35 -08:00
1c65800f4a
Feat: add support for Grok 4.1 Fast models ( #16936 )
...
* feat: Add support for Grok 4.1 Fast models
Add new xAI Grok 4.1 Fast models optimized for high-performance agentic tool calling:
- xai/grok-4-1-fast (alias for grok-4-1-fast-reasoning)
- xai/grok-4-1-fast-reasoning (with reasoning capabilities)
- xai/grok-4-1-fast-reasoning-latest
- xai/grok-4-1-fast-non-reasoning (without reasoning for faster responses)
- xai/grok-4-1-fast-non-reasoning-latest
Features:
- Context window: 2,000,000 tokens
- Pricing: $0.20/1M input, $0.50/1M output tokens
- Cached tokens: $0.05/1M tokens
- Supports: Function calling, Structured outputs, Vision, Audio input, Web search, Reasoning
Fixes #16927
* docs: Add comprehensive Grok models documentation
- Add 'Supported Models' section highlighting new Grok 4.1 Fast models
- Include comparison guide for reasoning vs non-reasoning models
- Add complete model family table (Grok 4.1, 4, 3, Code, 2)
- Add features legend explaining capabilities
- Remove pricing details (link to xAI docs instead for current rates)
- Improve documentation clarity and consistency
Related to #16927
* docs: Minor corrections to xai.md
2025-11-21 15:57:55 -08:00
22ef7ab070
feat: Add support for Gemini 3 Pro Image model ( #16938 )
...
Add gemini-3-pro-image-preview model configuration for Google's new
image generation model (aka "Nano Banana Pro 🍌 ").
Model details:
- Input: $2.00/1M tokens (text), $0.0011/image
- Output: $12.00/1M tokens (text), $0.134/image (1K/2K)
- Context: 65k input / 32k output tokens
- Capabilities: structured outputs, web search, caching, thinking
- No function calling support
- Available on both Gemini API and Vertex AI
Added variants:
- gemini-3-pro-image-preview (base, uses Vertex AI)
- gemini/gemini-3-pro-image-preview (Gemini API)
- vertex_ai/gemini-3-pro-image-preview (Vertex AI)
Source: https://ai.google.dev/gemini-api/docs/pricing
Fixes : #16925
2025-11-21 15:55:25 -08:00
01ea6c8948
[New model] Add GLM 4.6 from together.ai ( #16942 )
...
* new model - add together_ai/zai-org/GLM-4.6
* together_ai/zai-org/GLM-4.6
2025-11-21 14:39:52 -08:00
1812ebae70
fix: Correct Cerebras GPT-OSS-120B model name ( #16939 )
...
Change model identifier from cerebras/openai/gpt-oss-120b to
cerebras/gpt-oss-120b to match Cerebras API requirements.
The Cerebras API only accepts 'gpt-oss-120b' as the model ID, not
'openai/gpt-oss-120b'. The previous name was causing "Model does not
exist" errors when users tried to use it.
Tested with real API calls to confirm:
- cerebras/gpt-oss-120b → sends 'gpt-oss-120b' → ✅ works
- cerebras/openai/gpt-oss-120b → sends 'openai/gpt-oss-120b' → ❌ fails
Fixes #16924
2025-11-21 14:20:31 -08:00
be9f2e026c
feat(pricing): Add Gemini 3 Pro Preview for OpenRouter ( #16905 )
2025-11-21 08:52:25 -08:00
c3143e388e
Add thought signature support to v1/messages api ( #16812 )
...
* Add thought signature support to v1/messages api
* update the thinking level handling logic
* update the thinking level handling logic
* Add streaming support
* fix intalling litellm error
2025-11-19 20:24:31 -08:00
6fc7397dde
Add Vertex AI Image Edit Support ( #16828 )
...
* Add vertex ai image edit support
* Fix lint errors
2025-11-19 18:39:28 -08:00
36c9fede4e
Add azure gpt-5.1 models ( #16817 )
2025-11-19 18:37:08 -08:00
ffe00f4034
Revert "make all gpt-5 and reasoning models to responses by default ( #16766 )" ( #16849 )
...
This reverts commit 149f308451
2025-11-19 13:32:58 -08:00
149f308451
make all gpt-5 and reasoning models to responses by default ( #16766 )
2025-11-18 20:31:59 -08:00
eb301a7f87
Add Azure models 2025 11 to cost maps ( #16762 )
...
* add gpt-realtime models for azure
* update backup models w/ azure realtime
* add azure gpt-5.1 models to cost map
* add gpt-audio azure models to cost map
* add gpt-4o-transcribe-diarize azure model cost
2025-11-18 19:58:06 -08:00
9ec31bdd5b
fix: correct wrong system message handling for gemma ( #16767 )
2025-11-18 11:35:56 -08:00
a032b077db
update veo 3 pricing and add prod models ( #16781 )
2025-11-18 11:29:45 -08:00
acf206bec6
Add Day 0 gemini-3-pro-preview support ( #16719 )
...
* Add thinking signature support for gemini
* Add docs related to thinking signature
* remove double base64 import
* fix mypy errors
* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy
* Add new gemini 3 model and features
* Add docs related to gemini 3
* Update gemini 3 pricing
* fix llm translation tests
* fix mapped tests
2025-11-18 09:44:45 -08:00
355eff8723
fix haiku-4-5 bedrock configs ( #16732 )
2025-11-17 19:52:01 -08:00
b9bc903536
remove deprecated embedding model ( #16724 )
2025-11-17 18:46:20 -08:00
20ba3fce70
Add deepseek-v3p1-terminus and kimi-k2-instruct in model map for fireworks ai ( #16720 )
2025-11-17 18:30:32 -08:00
f9ecf56715
Update Azure Pricing ( #16371 )
...
* add azure eu & us gpt-5 pricing
* add azure us gpt-4.1 pricing
* fix azure/o3-2025-04-16 to match azure/o3
* add azure us o3 pricing
2025-11-15 19:36:13 -08:00
a2e3b942dc
Vector store files Stable Release ( #16643 )
...
* Add support for vector store files endpoints (#16490 )
* Add base code for vector store integration
* fix azure related tests and linting error
* fix mypy errors
* Add vector store files documentation
* fix mapped tests
* Add bytedance and ideogram support in fal ai (#16636 )
* Add fal ai flux pro v1.1 support (#16578 )
* Add fal ai flux pro v1.1 support
* Add tests and docs
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com >
2025-11-15 13:00:33 -08:00
1dac777346
Add Vertex Kimi-K2-Thinking ( #16671 )
...
* Add Vertex Kimi-K2-Thinking
* Update model_prices_and_context_window.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* Update litellm/model_prices_and_context_window_backup.json
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-11-14 16:49:48 -08:00
b1922e19f8
Voyageai pricing and doc update ( #16641 )
...
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Refresh VoyageAI models and prices and context
* Updating the available VoyageAI models in the docs
* Updating the available VoyageAI models in the docs
* Updating the model prices and the docs
2025-11-14 14:09:11 -08:00
Mariano Hielpos