Commit Graph
30881 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub 73715ab417 Merge pull request #19556 from BerriAI/litellm_fix_gemini_batch_jan22
Fix: generation config empty for batch
2026-01-22 19:44:26 +05:30
Sameer KankuteandGitHub d893bfd371 Merge pull request #19464 from BerriAI/litellm_staging_01_21_2026
Litellm staging 01 21 2026
2026-01-22 19:44:18 +05:30
Sameer Kankute f312bf23d0 Fix:test_multiple_function_call 2026-01-22 19:34:54 +05:30
Sameer KankuteandGitHub 96a20161a8 Merge pull request #19565 from BerriAI/litellm_staging_01_21_2026_fixes
Litellm staging 01 21 2026 fixes
2026-01-22 19:30:56 +05:30
Sameer Kankute 2fefafc4aa fix: mypy error 2026-01-22 19:26:40 +05:30
Sameer Kankute ab9c840924 fix: mypy error 2026-01-22 19:25:21 +05:30
Sameer Kankute 991fee056f Fix batch tests 2026-01-22 19:23:32 +05:30
Yuta SaitoandSameer Kankute 1657af81eb feat: display mcp output on the play ground 2026-01-22 19:23:32 +05:30
Yuta SaitoandSameer Kankute 8a622c51f5 feat: Add MCP tools response to chat completions 2026-01-22 19:23:32 +05:30
Sameer Kankute 0cc52c7582 comment code not used 2026-01-22 19:15:15 +05:30
Sameer Kankute 5a7a364edc fix: mypy error 2026-01-22 19:07:34 +05:30
Sameer Kankute b729622bf5 Fix: generationConfig removal from tests 2026-01-22 19:00:37 +05:30
Sameer Kankute 7c874efeab Fix: Httpx timeout test failures 2026-01-22 18:49:34 +05:30
Sameer Kankute 0afb2cb568 Fix: Responses API usage field type mismatch 2026-01-22 18:40:04 +05:30
Sameer Kankute 110e2c69d4 Fix : test_anthropic_via_responses_api 2026-01-22 18:28:56 +05:30
Sameer Kankute caab7821bd Fix: imagegeneration@006 has been deprecated 2026-01-22 18:24:59 +05:30
Sameer Kankute e8bfab25b3 Fix mypy error in litellm_staging_01_21_2026 2026-01-22 18:07:00 +05:30
Sameer KankuteandGitHub ad1edd38d5 Merge branch 'main' into litellm_staging_01_21_2026 2026-01-22 17:56:40 +05:30
Sameer Kankute 4d20c8fbc0 feat: Limit stop sequence as per openai spec 2026-01-22 17:52:13 +05:30
Sameer Kankute 24faca9bcf Add support for output formatfor bedrock invoke via v1/messages 2026-01-22 16:36:03 +05:30
Sameer Kankute 18240662db Add custom vertex ai mapping to the output 2026-01-22 15:18:24 +05:30
Sameer Kankute c374345e12 Fix: generation config empty for batch 2026-01-22 14:32:44 +05:30
YutaSaitoandGitHub b7b26492a8 Merge pull request #19553 from BerriAI/litellm_feat_completions_mcp_output_ui
[feat] display mcp output on the play ground
2026-01-22 16:14:30 +09:00
Yuta Saito 59edd90228 feat: display mcp output on the play ground 2026-01-22 16:11:56 +09:00
YutaSaitoandGitHub 27e494cba6 Merge pull request #19552 from BerriAI/litellm_feat_completions_mcp_output
[feat] Add MCP tools response to chat completions
2026-01-22 16:03:25 +09:00
Yuta Saito ed67bf2705 feat: Add MCP tools response to chat completions 2026-01-22 15:32:04 +09:00
yuneng-jiangandGitHub 5ea031eaf6 Merge pull request #19543 from BerriAI/litellm_model_select_team
[Feature] UI - Create Team: Reusable Model Select
2026-01-21 21:11:09 -08:00
Ishaan JaffandGitHub a117509f93 [Fix] UI Cost Estimator - Fix model dropdown (#19529)
* add cost estimator

* ui fix show errors

* test_estimate_cost_resolves_router_model_alias
2026-01-21 20:19:40 -08:00
houdataaliandGitHub ebcc37dfdf add redisvl dependency to the root requiremnts.tx (#19417) 2026-01-21 20:12:07 -08:00
Cesar GarciaandGitHub 815e6fcf76 docs: update Claude Code integration guides (#19415)
* docs: document Claude Code default models and env var overrides

- Update config example with current Claude Code 2.1.x model names
- Add section documenting default models (sonnet/haiku) that Claude Code requests
- Document env var overrides (ANTHROPIC_DEFAULT_SONNET_MODEL, etc.)
- Show how model_name alias can route to any provider (Bedrock, Vertex, etc.)

* Update docs

Removed warning about changing model names in Claude Code versions.

* docs: add 1M context support and improve Claude Code quickstart guide

- Add comprehensive 1M context window documentation
- Document [1m] suffix usage and shell escaping requirements
- Clarify that LiteLLM config should NOT include [1m] in model names
- Add standalone claude_code_1m_context.md guide
- Improve model selection documentation with environment variables
- Add section on default models used by Claude Code v2.1.14
- Add troubleshooting for 1M context issues
- Reorganize to emphasize environment variables approach

Addresses GitHub issue #14444

* docs: reorder model selection options - prioritize --model over env vars

- Move command line/session model selection to Option 1 (most reliable)
- Move environment variables to Option 2
- Add note that env vars may be cached from previous session
- Emphasize that --model always uses exact model specified

* docs: reorganize 1M context section - separate command line from env vars

- Split 1M context examples into two clear sections
- Show command line usage first (--model and /model)
- Show environment variables as alternative approach
- Improves readability and emphasizes most reliable method

* docs: remove misleading default models section from website tutorial

- Remove 'Default Models Used by Claude Code' section (misleading)
- Remove claim that config must match exact default model names
- Update config comment to be more general
- Add claude-opus-4-5-20251101 to example config
- Keep authentication section as-is

* docs: correct model selection in website tutorial

- Remove incorrect claim that Claude Code automatically uses proxy models
- Add explicit model selection examples with --model and /model
- Show environment variables as alternative approach
- Remove misleading comment about 'multiple configured'

* docs: add 1M context section to website tutorial

- Add section on using [1m] suffix for 1 million token context
- Include warning about shell escaping (quotes required)
- Explain how Claude Code handles [1m] internally
- Add /context verification command
- Note that LiteLLM config should NOT include [1m]

* docs: add tip about using .env for API keys

- Add note that ANTHROPIC_API_KEY can be stored in .env file
- Clarifies alternative to exporting environment variables
2026-01-21 20:11:06 -08:00
Harshit JainandGitHub 746414eb9b Fix/per service ssl override v2 (#19538)
* refactor(ssl): support per-service SSL verification overrides

* add test cases for ssl
2026-01-21 20:10:04 -08:00
davida-psandGitHub 7777aeb695 fixing prompt-security's guardrail implementation (#19374)
* Consolidated change

* fix(prompt_security): update message processing to persist sanitized files and filter for API calls

* fix per krrishdholakia suggestion
2026-01-21 20:09:40 -08:00
Ishaan JaffandGitHub ab606c9a73 [Feat] Add Structured output for /v1/messages with Anthropic API, Azure Anthropic API, Bedrock Converse (#19545)
* fix: add AnthropicMessagesRequestOptionalParams

* add _update_headers_with_anthropic_beta

* fix output format tests

* test_structured_output_e2e

* TestAnthropicAPIStructuredOutput

* test_structured_output_e2e

* fix BASE

* TestAzureAnthropicStructuredOutput

* fix: Bedrock Converse

* add nthropic Messages Pass-Through Architecture

* fix: bedrock invoke output_format

* fix: transform_anthropic_messages_request for vertex anthropic

* TestBedrockInvokeStructuredOutput

* docs anthropic vertex

* docs fix

* docs fix
2026-01-21 20:09:18 -08:00
jay prajapatiandGitHub 363b0cc132 fix(azure): preserve content_policy_violation details for images (#19328) (#19372)
Azure OpenAI Images (DALL·E 3) returns policy violations as a structured payload under body["error"], including inner_error.content_filter_results and revised_prompt.

LiteLLM previously:
- Failed to extract nested error messages (get_error_message only handled body["message"])
- Missed policy violation detection when error strings were generic
- Dropped inner_error details when raising ContentPolicyViolationError

This change:
- Extracts nested Azure error fields (code/type/message + inner_error)
- Detects policy violations via structured error codes
- Passes an OpenAI-style error body + provider_specific_fields to preserve details

Tests:
- python3 -m pytest tests/test_litellm/llms/azure/test_azure_exception_mapping.py
- python3 -m pytest tests/test_litellm/litellm_core_utils/test_exception_mapping_utils.py

Fixes #19328
2026-01-21 20:06:51 -08:00
Sameer KankuteandGitHub 3794f86af0 Merge pull request #19502 from Chesars/docs/base-model-openai-dated-versions
docs(custom_pricing): add base_model usage for OpenAI dated model versions
2026-01-22 09:19:12 +05:30
Sameer KankuteandGitHub 36f3250016 Merge pull request #19500 from Chesars/fix/audio-model-pricing
fix(pricing): correct audio token costs for gpt-4o-audio-preview models
2026-01-22 09:18:55 +05:30
Sameer KankuteandGitHub 967bc82e53 Merge pull request #19509 from Chesars/add-gpt-audio-models
Add gpt-audio and gpt-audio-mini models to pricing
2026-01-22 09:18:11 +05:30
Ishaan JaffandGitHub d5e912322f [Fix] VertexAI Pass through - Ensure only anthropic betas are forwarded down to LLM API (#19542)
* fix ALLOWED_VERTEX_AI_PASSTHROUGH_HEADERS

* test_vertex_passthrough_forwards_anthropic_beta_header

* fix test_vertex_passthrough_forwards_anthropic_beta_header

* test_vertex_passthrough_does_not_forward_litellm_auth_token

* fix utils

* Using Anthropic Beta Features on Vertex AI

* test_forward_headers_from_request_x_pass_prefix
2026-01-21 19:12:04 -08:00
yuneng-jiang d1172562bc fixing build 2026-01-21 18:29:08 -08:00
yuneng-jiang f737429ad9 create team model select 2026-01-21 18:21:42 -08:00
yuneng-jiangandGitHub 9fe2822cf0 Merge pull request #19540 from BerriAI/litellm_ui_e2e_internal_viewer_tests
[Infra] UI - E2E Tests: Internal Viewer Sidebar
2026-01-21 18:15:16 -08:00
yuneng-jiang e406ebf0dd Model Select for Create Team 2026-01-21 18:14:45 -08:00
yuneng-jiangandGitHub 6b6785bc4f Merge pull request #19539 from BerriAI/litellm_models_scope
[Feature] Adding Optional scope Param to /models
2026-01-21 17:41:22 -08:00
yuneng-jiang 4497f2de5c e2e test internal viewer sidebar 2026-01-21 17:39:02 -08:00
yuneng-jiangandGitHub e877b08314 Merge pull request #18995 from BerriAI/litellm_e2e_create_key_test
[Infra] UI - E2E Test: Create Key With All Team Models
2026-01-21 16:46:49 -08:00
yuneng-jiangandGitHub c6b157832b Merge pull request #19296 from BerriAI/litellm_esca_reissue
[Reissue: Fix] /user/new Privilege Escalation
2026-01-21 16:46:34 -08:00
yuneng-jiangandGitHub 1a0faaff0d Merge pull request #19468 from BerriAI/litellm_ui_team_select_001
[Fix] UI - MCP Servers: MCP Tools Tab Resetting to Overview
2026-01-21 16:46:19 -08:00
yuneng-jiang 6723b30d03 Adding scope to /models 2026-01-21 16:40:31 -08:00
Alexsander HamirandGitHub 2620b9f041 Cut chat_completion latency by ~21% by reducing pre-call processing time (#19535) 2026-01-21 16:05:29 -08:00
4106d24215 feat: add GMI Cloud provider support (#19376)
* feat: add GMI Cloud provider support

Add GMI Cloud as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 16 models (Claude, GPT, DeepSeek, Gemini, etc.)
- Sidebar entry for docs navigation

* Add gmi_cloud to provider_endpoints_support.json

Add provider entry to pass CI validation check that ensures all
providers in openai_like/providers.json are documented.

* Fix provider key: gmi_cloud -> gmi

Match the provider key with providers.json

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-21 15:48:15 -08:00