Commit Graph
23608 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub d5c61cc526 docs - openweb show how to include reasoning content (#13060) 2025-07-28 15:25:47 -07:00
Christoph KoehlerandGitHub 8f7d896e26 fix: add X-Initiator header for GitHub Copilot to reduce premium requests (#13016)
- Implement X-Initiator header logic in GithubCopilotConfig.validate_environment()
- Set header to "agent" when messages contain agent or tool roles, "user" otherwise
- Reduces unnecessary premium Copilot API usage for non-user calls

Fixes #12859
2025-07-28 09:55:24 -07:00
Krrish Dholakia 2da6d457ef test: update logic to fix for unit tests 2025-07-28 07:38:58 -07:00
Krrish Dholakia 8d49dd66cb build: update ui build 2025-07-27 11:50:56 -07:00
Krrish Dholakia 39b7ce5388 refactor(create_key_button.tsx): cleanup read only option (confusing) 2025-07-27 11:49:56 -07:00
Krrish Dholakia 3359464624 fix(proxy_settings_endpoints.py): fix clearing SSO settings 2025-07-27 11:13:40 -07:00
Krrish Dholakia 1b7f7ba643 build: build new ui 2025-07-27 11:08:27 -07:00
Krish DholakiaandGitHub 94aa6b0b5d Bulk User Edit - additional improvements - edit all users + set 'no-default-models' on all users (#12925)
* feat(bulk_user_update/): support updating all users on proxy

* fix(bulk_edit_user.tsx): persist user settings when 'add to team' clicked

* fix(team_endpoints.py): bulk add all proxy users to team

supports flow from UI to add all existing users to a team

* fix: minor fixes

* feat(user_edit_view.tsx): support setting no default model on user edit

allows preventing users from calling models outside team scope

* fix(user_edit_view.tsx): prevent triggering submit when 'cancel' is clicked

* refactor(internal_user_endpoints.py): refactor to reduce function size
2025-07-27 10:12:30 -07:00
Krish DholakiaandGitHub 1737cf4257 VertexAI - camelcase optional params for image generation + Anthropic - streaming, always ensure assistant role set on only first chunk (#12889)
* fix(vertex_ai/image_generation): transform `_` param to camelcase

Fixes https://github.com/BerriAI/litellm/issues/12690

* test(test_vertex_image_generation.py): add unit tests

* fix(streaming_handler.py): assert only 1 assistant chunk in stream

Fixes https://github.com/BerriAI/litellm/issues/12616

* fix(streaming_handler.py): fix check
2025-07-27 10:09:43 -07:00
Krrish Dholakia ff0b40a22b test: fix test 2025-07-27 09:52:22 -07:00
Krish DholakiaandGitHub e8a374fc47 Litellm release notes 07 27 2025 p1 (#13027)
* docs(index.md): initial commit for v1.74.9-stable release note

* docs(index.md): add more cost tracking models

* docs(index.md): add new llm api endpoints + mcp gateway features

* docs: add logging/guardrail improvements

* docs(index.md): complete initial draft

* build(model_prices_and_context_window.json): fix or pricing

* build(model_prices_and_context_window.json): fix or pricing
2025-07-27 09:46:25 -07:00
Ishaan Jaff 2c38dc0de7 test_router_auto_router 2025-07-26 13:33:53 -07:00
Jugal D. BhattandGitHub b921e22594 [MCP Gateway] Litellm mcp multi header propagation (#13003)
* change alias-> server_name

* add server alias uses

* add tests

* schema

* ruff fix

* fix alias for config

* fix tests

* add alias

* fix tests

* add multi server header support

* add and fix tests

* fix tests

* fix tests

* add a common util

* ruff fix

* fix ruff

* fix tests

* fix migration

* mypy fix

* change server py
v1.74.9.rc-draft
2025-07-26 11:45:14 -07:00
Krish DholakiaandGitHub eed0cf2ee9 UI SSO - fix reset env var when ui_access_mode is updated (#13011)
* fix(ui_sso.py): fix form action on login when sso is enabled

* fix: multiple fixes - fix resetting env var in proxy config + add key to exception message on key decryption

fixes issue where env vars would be reset

* refactor(proxy_server.py): cleanup redundant decryption line

* fix(proxy_setting_endpoints.py): show saved ui access mode

allows admin to know what they'd previously stored in db
2025-07-26 11:42:41 -07:00
Krish DholakiaandGitHub 4b50566d6d [FEAT] Model-Guardrails: Add on UI (#13006)
* feat(proxy_server.py): working guardrails on streaming output

ensures guardrail actually raises an error if flagged during streaming output

* test: add unit tests

* feat(advanced_settings.tsx): add guardrails option as ui component on model add

enables setting guardrails on model add

* feat(add_model_tab.tsx): fix add model form

* feat(model_info_view.tsx): support adding guardrails on model update

* fix(add_model_tab.tsx/): working health check when guardrails selected

* fix(proxy_server.py): fix yield
2025-07-26 11:42:03 -07:00
Jugal D. BhattandGitHub 586b1ec8b4 [Vector Store] make vector store permission management OSS (#12990)
* add vector store on ui behind enterprise in vector store

* remove enterprise
2025-07-26 11:13:49 -07:00
Matthias DittrichandGitHub 9211158e73 Fixup ollama model listing (again) (#13008) 2025-07-26 11:07:49 -07:00
Jugal D. BhattandGitHub 10595ea077 [MCP Gateway] add Litellm mcp alias for prefixing (#12994)
* change alias-> server_name

* add server alias uses

* add tests

* schema

* ruff fix

* fix alias for config

* fix tests

* add alias

* fix tests

* fix tests

* add a common util

* ruff fix

* fix migration
2025-07-25 17:57:52 -07:00
Jugal D. BhattandGitHub c7774ba495 add fix for redaction (#13005) 2025-07-25 17:48:48 -07:00
Emerson GomesandGitHub dc8c14b504 Fix issue writing db (#13001) 2025-07-25 17:27:13 -07:00
Krish DholakiaandGitHub d6423d913d build: update pip package (#12998) 2025-07-25 16:23:53 -07:00
Krrish Dholakia 5ad116ae89 feat(proxy_server.py): support checking full str on streaming guardrails post call hook
ensures streaming guardrails are actually useful
2025-07-25 15:49:50 -07:00
Krrish Dholakia e5d68e5222 feat(proxy/utils.py): support model level guardrails on stream event
enables guardrails to work with streaming
2025-07-25 15:37:27 -07:00
Jugal D. BhattandGitHub d1b63566ac remove features from enterprise (#12988) 2025-07-25 10:55:28 -07:00
Jugal D. BhattandGitHub c66b288bcf [LLM Translation] fix query params for realtime api intent (#12838)
* fix query params for realtime api intent

* fix my py

* Add typed dict

* remove typed dict

* fix comments

* add test

* add test

* added proxt log revert

* add real time q params
2025-07-25 10:09:53 -07:00
Jugal D. BhattandGitHub c2833e693e clean and verify key before inserting (#12840)
* clean and verify key

* change checking logic

* Add unit test
2025-07-25 10:09:28 -07:00
Jugal D. BhattandGitHub b4da29c83e [LLM Translation] Add bytedance/ui-tars-1.5-7b on openrouter (#12882)
* add bytedance model

* add source
2025-07-25 10:09:14 -07:00
Krish DholakiaandGitHub 23d562b1a2 build(github/manual_pypi_publish.yml): manual workflow to publish pip package - used for pushing dev releases (#12985)
* build(github/manual_pypi_publish.yml): manual workflow to publish pip package - used for pushing dev releases

* ci: remove redundant file
2025-07-25 09:26:47 -07:00
Ishaan Jaff 0f015a2f68 docs fix link 2025-07-25 09:08:18 -07:00
Ishaan Jaff 8f86355361 fix ci/cd testing 2025-07-25 09:05:27 -07:00
Ishaan Jaff 1a15bd4885 docs auto router 2025-07-25 09:04:27 -07:00
Ishaan Jaff f2e9834dc6 docs - auto router on litellm proxy 2025-07-25 08:58:54 -07:00
Ishaan Jaff 7bb48ffaf9 docs auto routing 2025-07-25 08:50:16 -07:00
Ishaan Jaff 50574c0c3e docs - auto routing 2025-07-25 07:31:39 -07:00
Ishaan Jaff 20450bfe94 fix mapped test 2025-07-25 07:24:42 -07:00
Ishaan Jaff ecfafd1243 docs update 2025-07-25 07:19:32 -07:00
Ishaan Jaff 7745f61fb1 docs update 2025-07-25 07:19:20 -07:00
Ishaan Jaff 9c76ccd92c docs Health Check Server 2025-07-25 07:17:26 -07:00
Krish DholakiaandGitHub 6d3ce76e1c Guardrails - support model-level guardrails (#12968)
* fix(custom_guardrail.py): initial logic for model level guardrails

* feat(custom_guardrail.py): working pre call guardrails

* fix(custom_guardrails.py): check if custom guardrails set before running event hook

* test(test_custom_guardrail.py): add unit tests for async pre call deployment hook on custom guardrail

* feat(custom_guardrail.py): add post call processing support for guardrails

allows model based guardrails to run on the post call event for that model only

* fix(utils.py): only run if call type is in enum

* test: update unit tests to work
2025-07-24 22:38:03 -07:00
Krish DholakiaandGitHub dd607cd301 Show global retry policy on UI (#12969)
* fix(router.py): return global retry policy on `get/config/callbacks`

Partial fix for https://github.com/BerriAI/litellm/issues/12855

* fix(model_dashboard.tsx): accept global retry policy

Fixes https://github.com/BerriAI/litellm/issues/12855

* fix(model_dashboard.tsx): update global retry policy, if that's what was edited
2025-07-24 22:37:15 -07:00
Dmitriy AlergantandGitHub 0cc320cc0a GuardrailsAI: use validatedOutput to allow usage of "fix" guards. Previously "fix" guards had no effect in llmOutput mode. (#12891) 2025-07-24 22:07:06 -07:00
sings-to-bees-on-wednesdaysandGitHub eb96fb78bc fix(auth_utils): make header comparison case-insensitive (#12950)
If the user specified in the configuration e.g. "user_header_name:
X-OpenWebUI-User-Email", here we were looking for a dict key
"X-OpenWebUI-User-Email" when the dict actually contained
"x-openwebui-user-email".

Switch to iteration and case insensitive string comparison instead to
fix this.

This fixes customer budget enforcement when the customer ID is passed
in as a header rather than as a "user" value in the body.
2025-07-24 22:06:12 -07:00
Cole McIntoshandGitHub 3ca65b3064 feat: Update model pricing and context window configurations (#12910)
- Adjusted input and output cost per token for existing models.
- Added new model configuration for "openrouter/qwen/qwen3-coder" with specified token limits and costs.
2025-07-24 21:57:15 -07:00
GastonandGitHub 6cfaf674e4 Fix: Shorten Gemini tool_call_id for Azure compatibility (#12941) 2025-07-24 21:52:16 -07:00
Murad KhafizovandGitHub 650ae0ef88 Added documentation about metadata exposed over the /v1/models endpoint (#12942) 2025-07-24 21:51:16 -07:00
Santosh DhaladhuliandGitHub d9d53466e8 [Feat] Add inpainting support and corresponding tests for Amazon Nova Canvas (#12949) 2025-07-24 21:46:06 -07:00
Ishaan Jaff fdb2ebf344 bump: version 1.74.8 → 1.74.9 2025-07-24 21:27:15 -07:00
Ishaan Jaff d892e969ab ui new build 2025-07-24 21:27:06 -07:00
Ishaan Jaff 91eee78a8c Revert "EditAutoRouterTabProps"
This reverts commit 2835d3a3743e6411b9914a0b01381050e2273ad7.
2025-07-24 21:26:01 -07:00
Ishaan Jaff 0630b52044 EditAutoRouterTabProps 2025-07-24 21:26:01 -07:00