6fc7397dde
Add Vertex AI Image Edit Support ( #16828 )
...
* Add vertex ai image edit support
* Fix lint errors
2025-11-19 18:39:28 -08:00
36c9fede4e
Add azure gpt-5.1 models ( #16817 )
2025-11-19 18:37:08 -08:00
95caa2e3de
bump openai 2.8.0
2025-11-19 17:47:18 -08:00
e1005cb9d3
Use LiteLLM key alias as fallback Noma applicationId in NomaGuardrail ( #16832 )
...
* Use auth key name if there are no app id in in headers or in extra_data
* use key alias instead of key name
* Fix
* last priority key alias
* Fix
* Add tests
2025-11-19 17:44:23 -08:00
d389b9dd66
bump litellm enterprise
2025-11-19 16:56:50 -08:00
9622829fa1
Fix vector store create issue ( #16804 )
2025-11-19 16:53:20 -08:00
cd6256f64a
[Feat] Prompt Management - Add UI for editing the prompts ( #16853 )
...
* v0 for prompt management
* v0
* clean up view of prompt editor
* commit editor view
* refactor prompt editor view
* ui - refactor prompt editor
* add move message
* add prompt editor view
* fix allow viewing dotprompt file
* add dotprompt_content
* handleSave for Prompt
* ui fix build fail
* ui fix build
2025-11-19 16:26:11 -08:00
ffe00f4034
Revert "make all gpt-5 and reasoning models to responses by default ( #16766 )" ( #16849 )
...
This reverts commit 149f308451
2025-11-19 13:32:58 -08:00
98d2dbd711
Bump js-yaml from 3.14.1 to 3.14.2 ( #16802 )
...
Bumps [js-yaml](https://github.com/nodeca/js-yaml ) from 3.14.1 to 3.14.2.
- [Changelog](https://github.com/nodeca/js-yaml/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nodeca/js-yaml/compare/3.14.1...3.14.2 )
---
updated-dependencies:
- dependency-name: js-yaml
dependency-version: 3.14.2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-19 13:23:44 -08:00
6477740b8c
bump proxy extras
2025-11-19 13:23:16 -08:00
c7cf18cf67
[Feat] Prompt Management - Allow storing prompt version in DB ( #16848 )
...
* test_dotprompt_auto_detection_with_model_only
* fix _auto_detect_prompt_management_logger
* test_dotprompt_with_prompt_version
* add v1, v2 tests
* add _compile_prompt_helper
* fix _compile_prompt_helper
* test_dotprompt_with_prompt_version
* test_dotprompt_with_prompt_version, test_get_prompt_with_version
* add version in schema
* feat add _get_prompt_spec_for_db_prompt
* add _get_prompt_spec_for_db_prompt
* feat add _get_prompt_spec_for_db_prompt
* update prompt table
* add version in prompt DB
* test_get_prompt_spec_for_db_prompt_with_versions
2025-11-19 13:19:56 -08:00
98dd866b26
feat(github-copilot): Add Responses API support for gpt-5.1-codex model ( #16845 )
...
- Implement GithubCopilotResponsesAPIConfig for /responses endpoint
- Add support for models requiring responses API (e.g., gpt-5.1-codex)
- Auto-detect vision requests and set X-Initiator header
- Follow OpenAI Responses API compatibility pattern
- Add comprehensive unit tests (16 tests passing)
Fixes #16820
2025-11-19 13:17:19 -08:00
3ebe489082
[Feat] Prompt Management - Add support for versioning prompts ( #16836 )
...
* test_dotprompt_auto_detection_with_model_only
* fix _auto_detect_prompt_management_logger
* test_dotprompt_with_prompt_version
* add v1, v2 tests
* add _compile_prompt_helper
* fix _compile_prompt_helper
* test_dotprompt_with_prompt_version
* test_dotprompt_with_prompt_version, test_get_prompt_with_version
2025-11-19 13:16:03 -08:00
1f8fe007a1
[Feat] Prompt Management - Allow specifying just prompt_id in a request to a model ( #16834 )
...
* test_dotprompt_auto_detection_with_model_only
* fix _auto_detect_prompt_management_logger
* test_dotprompt_auto_detection_with_model_only
2025-11-19 10:20:58 -08:00
5f94b372f8
Migration job labels ( #16831 )
...
* Add dynamic pod labels and annotations to migrations job
* Bump chart version to 0.4.8
2025-11-19 09:53:21 -08:00
08246bf908
fix: fix broken doc link
2025-11-19 08:35:38 -08:00
b92cc2b2f9
fix(bedrock): Ensure consistent chunk IDs in Bedrock streaming responses ( #16596 )
...
* ensure consistent chunk IDs in streaming responses
* use native conversationId for consistent stream chunk IDs
2025-11-18 20:37:21 -08:00
149f308451
make all gpt-5 and reasoning models to responses by default ( #16766 )
2025-11-18 20:31:59 -08:00
5f463cef64
Fix edit logging settings not appearing ( #16798 )
2025-11-18 20:31:34 -08:00
34cc532d8d
Make sure that user inherits team permissions ( #16639 )
2025-11-18 20:14:42 -08:00
ab8704f60d
Change placeholder for Azure in Add Model ( #16597 )
2025-11-18 20:13:48 -08:00
2e007505da
fix(spend-logs): trim logged response strings ( #16654 )
...
* fix(spend-logs): trim logged response strings
- route spend-log responses through the existing string sanitizer so oversized base64/text fields are truncated before persistence
- add unit tests covering the truncation path and the feature flag
Note: embeddings-specific truncation (numeric vectors) is still pending and will be handled separately.
* remove unnecessary comment
* add: sanitization unit test for embeddings
* fix: simplify sanatization logic
I overcomplicated a simple change for lack of understanding, fixed.
2025-11-18 20:12:49 -08:00
69fcedb6d9
[Fix] UI - Add css to truncate long request ids in request viewer ( #16665 )
...
* Add css to truncate long request ids in request viewer
* Show tooltip with entire request id when request id is truncated
2025-11-18 20:12:19 -08:00
4167a64853
fix: Support GPT-5.1 reasoning.effort='none' in proxy ( #16745 )
...
* fix: Add support for GPT-5.1 reasoning.effort='none' parameter
- Override Reasoning type to include 'none' effort value
- Maintains compatibility with semantic-router (requires openai <2.0.0)
- GPT-5.1 defaults to reasoning.effort='none' as of OpenAI SDK 2.8.0
- Override can be removed once semantic-router supports OpenAI SDK 2.x
Fixes #16741
* feat: Update to OpenAI SDK 2.8+ and Python 3.9+
- Update minimum Python version from 3.8.1 to 3.9 (3.8 EOL Oct 2024)
- Update OpenAI SDK requirement from >=1.99.5 to >=2.8.0
- Update semantic-router to >=0.1.12 with Python >=3.9,<3.14 constraint
- Update resend to >=0.8.0 (allows 2.x versions)
- Revert custom Reasoning TypedDict - now using native type from OpenAI SDK 2.8+
OpenAI SDK 2.8.0 natively supports reasoning.effort='none' for GPT-5.1,
eliminating the need for our custom type override.
* chore: Update poetry.lock with OpenAI SDK 2.8.1 and dependencies
2025-11-18 20:06:50 -08:00
9e93d65ee2
Add extra_body support for response api params from chat completion ( #16765 )
2025-11-18 20:05:47 -08:00
eb301a7f87
Add Azure models 2025 11 to cost maps ( #16762 )
...
* add gpt-realtime models for azure
* update backup models w/ azure realtime
* add azure gpt-5.1 models to cost map
* add gpt-audio azure models to cost map
* add gpt-4o-transcribe-diarize azure model cost
2025-11-18 19:58:06 -08:00
afc9a763cb
Fix IBM Guardrails optional params, add extra_headers field ( #16771 )
...
Signed-off-by: Rob Geada <rob@geada.net >
2025-11-18 19:55:40 -08:00
5e70c78b94
fix(cost-tracking): support base_model lookup in litellm_metadata for Responses API ( #16778 )
...
Cost tracking was failing for Responses API when using custom deployment names
with base_model configuration. The issue occurred because:
- Chat Completions API stores model_info in 'metadata'
- Responses API stores model_info in 'litellm_metadata'
- Cost calculator only checked 'metadata', missing Responses API costs
Changes:
- Updated _get_base_model_from_metadata() to check both metadata locations
- Added comprehensive unit tests covering all scenarios
- Maintains backward compatibility (metadata takes precedence)
Fixes #16772
2025-11-18 19:53:18 -08:00
137c6b03f7
Deactivate delete button on model table for config models ( #16787 )
2025-11-18 19:51:59 -08:00
d0e806d1b3
Add additional model settings to chat models in test key ( #16793 )
2025-11-18 19:49:16 -08:00
fe05e33723
Fix e2e ui playwright test ( #16799 )
2025-11-18 17:56:40 -08:00
7b9c409760
Mock tremor's tooltip to fix flaky tests ( #16786 )
2025-11-18 17:40:50 -08:00
ff90585bfe
Break e2e_ui_testing into build, unit, and e2e steps ( #16783 )
2025-11-18 17:40:32 -08:00
c3c6cef6d8
[Fix] Fixes Swagger UI resolver errors for chat completion endpoints caused by Pydantic v2 $defs not being properly exposed in the OpenAPI schema. ( #16784 )
...
* fix add_request_body_to_paths
* test_move_defs_to_components
2025-11-18 17:39:28 -08:00
2880cb45a2
[Fix] AI Gateway Auth - Ensure Team Tags works when using JWT Auth ( #16797 )
...
* fix setting team_metadata
* test_team_metadata_with_tags_flows_through_jwt_auth
2025-11-18 17:36:38 -08:00
70e1e83102
feat(managed_files.py): support /delete for files + feat(managed_batches): support /cancel for batches ( #16387 )
...
* feat(managed_files.py): initial commit fixing managed file delete on litellm
* fix(managed_files.py): fix file delete
* feat(batches_endpoints/endpoints.py): fix cancelling a batch
ensures managed batches works
---------
Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com >
2025-11-18 17:36:26 -08:00
35ab0e109c
[Docs] SSO - Manage User Roles via Azure App Roles ( #16796 )
...
* add img 2
* add app roles
* docs
2025-11-18 16:00:36 -08:00
e2fc225201
[Feat] SSO - Ensure role from SSO provider is used when a user is inserted onto LiteLLM ( #16794 )
...
* test_apply_user_info_values_sso_role_takes_precedence
* fix SSO
2025-11-18 15:35:38 -08:00
97bb899f52
Bump js-yaml in /tests/proxy_admin_ui_tests/ui_unit_tests ( #16755 )
...
Bumps [js-yaml](https://github.com/nodeca/js-yaml ) from 3.14.1 to 3.14.2.
- [Changelog](https://github.com/nodeca/js-yaml/blob/master/CHANGELOG.md )
- [Commits](https://github.com/nodeca/js-yaml/compare/3.14.1...3.14.2 )
---
updated-dependencies:
- dependency-name: js-yaml
dependency-version: 3.14.2
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-18 11:38:54 -08:00
f3344a0d07
Fix videos tagging ( #16770 )
2025-11-18 11:37:05 -08:00
0908208076
chore: cleanup repo and improve AI docs ( #16775 )
...
* chore: remove development setup files from repository
Removes VERTEX_ENV_SETUP.md and setup_vertex_env.sh from the
repository as they are not referenced in documentation or tests.
These files were added in PR #15824 alongside the VertexAI Search
feature. The setup information is already well-documented in the
official docs at:
docs/my-website/docs/pass_through/vertex_ai_search_datastores.md
* docs: add poetry run python usage to CLAUDE.md and AGENTS.md
2025-11-18 11:36:27 -08:00
9ec31bdd5b
fix: correct wrong system message handling for gemma ( #16767 )
2025-11-18 11:35:56 -08:00
a032b077db
update veo 3 pricing and add prod models ( #16781 )
2025-11-18 11:29:45 -08:00
f9ec353b80
[Feature] UI - Allow setting base_url in API reference docs ( #16674 )
...
* Allow setting base_url in API reference docs
* Add logic to change base url for test key page
2025-11-18 11:27:28 -08:00
acf206bec6
Add Day 0 gemini-3-pro-preview support ( #16719 )
...
* Add thinking signature support for gemini
* Add docs related to thinking signature
* remove double base64 import
* fix mypy errors
* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy
* Add new gemini 3 model and features
* Add docs related to gemini 3
* Update gemini 3 pricing
* fix llm translation tests
* fix mapped tests
2025-11-18 09:44:45 -08:00
4dbbec233c
Snowflake provider support: added embeddings, PAT, account_id ( #15727 )
...
* added oauth mcp to docs
* added azure ai/grok-4 model family
* Revert "added oauth mcp to docs"
This reverts commit 950b7cef44f14b2db1429f6fbd32548a7c95d325.
* fix: arize ui integration
* need to remove a file
This reverts commit d6c877b73ac763464f204b77135f3786342373b7.
* snowflake support PAT, account_id and embeddings
* format
* test embeddings
* format
* complete test
* fix: add arize from ui
* updated clarifai functions to openai compatible (#15615 )
* fix: npm build errors
* update tests
* SnowflakeBaseConfig moved to utils
* rename pat_key => api_ke
* key_type=PAT => 'pat/key'
* fix if api_key is None
* doc update
* doc update
---------
Co-authored-by: mubashir1osmani <mubashir.osmani777@gmail.com >
Co-authored-by: Mubashir Osmani <ilikewafflesomcuh@gmail.com >
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
Co-authored-by: mogith-pn <143642606+mogith-pn@users.noreply.github.com >
2025-11-17 20:27:46 -08:00
070db16f87
this yaml actually works ( #16757 )
2025-11-17 20:09:44 -08:00
86ada061ec
fix: prompt injection not working ( #16701 )
2025-11-17 20:04:57 -08:00
775740275c
Correct ui build ( #16702 )
...
* Remove unused import of darkStyles
* Fix typo in onAutoRotationChange prop
2025-11-17 20:04:38 -08:00
52337961dc
fix(openai-video): inherit BaseVideoConfig to enable async content response ( #16708 )
2025-11-17 20:04:10 -08:00
Sameer Kankute