Commit Graph

2088 Commits

Author SHA1 Message Date
yuneng-jiang 6c79240cd6 Merge pull request #17108 from BerriAI/litellm_user_table_sort_ui
[Feature] UI - User Table Sort by All
2025-11-25 21:35:27 -08:00
yuneng-jiang e9ab20631f Merge pull request #17098 from BerriAI/litellm_broken_links_ui
[Feature] UI - Disable edit, delete, info, for dynamically generated spend tags
2025-11-25 21:34:39 -08:00
yuneng-jiang 7227747a6f Improve Wording for Config Models in Model Table (#17100) 2025-11-25 19:25:23 -08:00
yuneng-jiang 3da9974a87 Tests 2025-11-25 15:54:55 -08:00
yuneng-jiang db587926a4 Sorting changes, pending tests and loading state 2025-11-25 14:46:46 -08:00
yuneng-jiang 44cde2e48f Disable edit, delete, info, for dynamically generated spend tags 2025-11-25 12:03:01 -08:00
yuneng-jiang babee43dde Merge pull request #17068 from BerriAI/litellm_additional_delete_resource_modal
[Feature] Change Delete Modals to Common Component
2025-11-24 20:58:46 -08:00
yuneng-jiang 3aba6d96fd [Fix] UI - Add No Default Models for Team and User Settings (#17037)
* Add No Default Models to Team and User settings

* Removing unused imports

* Adding to Create User and Team flow
2025-11-24 20:53:17 -08:00
yuneng-jiang d53bc7b9a0 Change modals to reusable component 2025-11-24 20:37:33 -08:00
YutaSaito f5a3349fef feat: add UI support for configuring tool permission guardrails (#17050)
* feat: add UI support for configuring tool permission guardrails

* chore: rename UI/Docs references to "LiteLLM Tool Permission Guardrail"
2025-11-24 17:13:07 -08:00
Lior Drihem 62b84d6aad Prompt security litellm (#16365)
* add prompt security guardrails provider

* cosmetic

* small

* add file sanitization and update context window

* add pdf and OOXML files support

* add system prompt support

* add tests and documentation

* remove print

* fix PLR0915 Too many statements (96 > 50)

* cosmetic

* fix mypy error

* Fix failed tests due to naming conflict of responses directory with same-named pip package

* Fix mypy error: use 'aembedding' instead of 'embeddings' for async embedding call type

* Fix: Install enterprise package into Poetry virtualenv for tests

The GitHub Actions workflow was installing litellm-enterprise to system Python
using 'python -m pip install -e .', but tests run in Poetry's virtualenv using
'poetry run pytest'. This caused ImportError for enterprise package types.

Changed to 'poetry run pip install -e .' so the package is available in the
same virtualenv where pytest executes.

Fixes enterprise test collection errors in GitHub Actions CI.

* Move Prompt Security guardrail tests to tests/test_litellm/

Per reviewer feedback, move test_prompt_security_guardrails.py from
tests/guardrails_tests/ to tests/test_litellm/proxy/guardrails/ so
it will be executed by GitHub Actions workflow test-litellm.yml.

This ensures the Prompt Security integration tests run in CI.

---------

Co-authored-by: Ori Tabac <oritabac@prompt.security>
Co-authored-by: Vitaly Neyman <vitaly@prompt.security>
2025-11-24 11:44:20 -08:00
yuneng-jiang adfdcf1d61 [Fix] UI - Hide Default Team Settings From Proxy Admin Viewers (#16900)
* Add fallback in sort to prevent NoneType and str comparison

* Hide Default Team Settings from Proxy Admin Viewers

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-11-23 22:01:38 -08:00
YutaSaito f37d6480ec feat: add UI support for registering MCP OAuth2 auth_type (#17007) 2025-11-23 21:54:01 -08:00
yuneng-jiang 02873cf992 Minor cosmetic changes for buttons, add notification for delete team (#16984) 2025-11-22 19:24:25 -08:00
yuneng-jiang 16a5178527 Ensure unique keys in navbar menu items (#16987) 2025-11-22 19:20:01 -08:00
yuneng-jiang 5da77ac40a [Fix] Revert UI - Organization Usage (#16980)
* Revert "[Feature] UI - Organization Usage in Usage Tab (#16614)"

This reverts commit 4de182c98f.

* Networking Changes
2025-11-22 16:02:12 -08:00
Krish Dholakia e11d34eb69 Permission Management - disable global guardrails by key/team (#16983)
* feat(teams.py): param for disabling guardrails by team

allows use-case where you don't run global guardrails for team - only run team-specific guardrails

* feat(custom_guardrail.py): add support for disabling global guardrails

only run guardrails requested for in the request/key/team

* feat: support adding disable_global_guardrails to metadata if present in key/team metadata

* feat(create_key_button.tsx): new disable global guardrails field

* feat(key_edit_view.tsx): support disabling global guardrails on key edit

* feat(teams.tsx): add disable global guardrails on create team on UI

* feat(team_info.tsx): allow disabling global guardrails on team update
2025-11-22 15:43:50 -08:00
yuneng-jiang f7f4320e12 Revert to console outputs to reduce noise (#16981) 2025-11-22 15:26:45 -08:00
Ishaan Jaffer 7cf1d306f2 fix ui unit tests fuck this test why is it so flaky 2025-11-22 14:55:29 -08:00
Ishaan Jaffer 919465280d fix ui build 2025-11-22 14:48:15 -08:00
Ishaan Jaffer e8ba4e3fa4 fix ui unit tests 2025-11-22 14:32:10 -08:00
Ishaan Jaffer c6b8f19adc ui unit tests fix 2025-11-22 14:05:59 -08:00
Krish Dholakia ac3aa74c22 (feat) Anthropic - support Structured Outputs output_format for Claude 4.5 sonnet and Opus 4.1 + Arize Phoenix - root span logging (#16949)
* feat(anthropic/chat/transformations): for claude-4-5-sonnet and opus-4-1 support passing structured output to anthropic api

* docs: document new feature

* fix: fix output format

* fix: cleanup

* fix(transformation.py): conditionally pass in json tool call

* fix: support ARIZE_SPACE_ID instead of ARIZE_SPACE_KEY

* docs(arize_integration.md): cleanup arize docs

* feat(callback_info_helpers.tsx): allow setting arize space id via ui

* fix: fix linting error

* fix(opentelemetry.py): working arize phoenix root span tracing
2025-11-22 12:08:26 -08:00
Ishaan Jaffer 3ba3faefb8 fix sec scan 2025-11-22 11:50:32 -08:00
Ishaan Jaffer ff99f93dfc fix req.txt 2025-11-22 11:46:17 -08:00
Ishaan Jaffer 1adaf043db fix TYPE_CHECKING + security 2025-11-22 10:59:17 -08:00
Ishaan Jaffer 2613b7b942 fix security 2025-11-22 10:16:33 -08:00
yuneng-jiang cfcd597b91 Fix tests (#16972) 2025-11-22 09:44:58 -08:00
yuneng-jiang 671c2199e9 [Infra] Building UI for Testing (#16968)
* Reusable Delete Resource Modal

* Fixed small typo

* Building UI for sanity tests
2025-11-22 09:04:55 -08:00
yuneng-jiang f56c7e1ef9 Change Bulk Invite User Roles to match backend (#16906) 2025-11-21 20:00:57 -08:00
Ishaan Jaff 34f0c3c4dc Remove cost tracking disabled tooltip in chat ui (#16953)
* Fix: Simplify cost tooltip in ResponseMetrics

Co-authored-by: ishaan <ishaan@berri.ai>

* Fix: Display cost metric correctly in ResponseMetrics

Co-authored-by: ishaan <ishaan@berri.ai>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-11-21 17:25:37 -08:00
yuneng-jiang 49e331329b Remove console logs and errors from model tab (#16455) 2025-11-21 16:45:11 -08:00
yuneng-jiang b6b8f46b36 Change Public Model Hub to use proxyBaseUrl (#16892) 2025-11-21 15:59:03 -08:00
YutaSaito 7c4ef090c1 docs: fix mcp url format (#16940)
* docs: fix mcp url format

* fix: update Cursor MCP example to use url instead of server_url
2025-11-21 15:43:26 -08:00
Ishaan Jaff fb38763eb4 [Feat] UI - Show "get code" section for prompt management + minor polish of showing version history (#16941)
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id

* fx info and delete lookup for prompts

* refactor prompt table

* - rename to prompt studio

* fix get_prompt_info

* fix endpoints

* add PromptCodeSnippets

* prompt info view

* add prompt info view

* show correct version for prompts

* fix version selector

* fix endpoints and version

* fix get_prompt_info

* fix version display
2025-11-21 14:00:33 -08:00
Ishaan Jaff c9ac1949ee [Fix] Prompt Management - UI, allow seeing model, prompt id for Prompt (#16932)
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id

* fx info and delete lookup for prompts

* refactor prompt table
2025-11-21 13:59:54 -08:00
yuneng-jiang 5dd2ee0bff Change /public fields to honor server root path (#16930) 2025-11-21 13:59:16 -08:00
yuneng-jiang 4b25398afe [Infra] CI/CD Fixes (#16937)
* Attempt CI/CD Fix

* Adding test for coverage

* Adding max depth to copilot and vertex

* Fixing mypy lint and docker database

* Fixing UI build issues

* Update playwright test
2025-11-21 13:58:19 -08:00
Ishaan Jaff 97d9da93e0 [Feat] Prompt Management - Allow viewing version history (#16901)
* TestPromptRequest

* add prompts/test endpoint for testing prompt

* TestPromptTestEndpoint

* feat: working v1 of this ui

* workig prompt endpoints

* add chat ui for prompts

* add conversation panel

* add init chat ui

* allow clicking edit prompt

* fix use get_base_prompt_id

* add endpoints for viewing prompt versions

* TestPromptVersioning

* add getPromptVersions

* add VersionHistorySidePanel

* allow viewing version history

* add version history
2025-11-21 08:54:52 -08:00
Ishaan Jaff 41566722af [Feat] UI - Prompt Management - Allow testing prompts with Chat UI (#16898)
* TestPromptRequest

* add prompts/test endpoint for testing prompt

* TestPromptTestEndpoint

* feat: working v1 of this ui

* workig prompt endpoints

* add chat ui for prompts

* add conversation panel

* add init chat ui
2025-11-21 08:53:18 -08:00
yuneng-jiang 9120a02474 Change favicon (#16837) 2025-11-19 20:38:22 -08:00
yuneng-jiang d22ea6f15f [Feature] UI - Model Compare (#16855)
* Temp commit for branch switching, Compare WIP

* Model Compare UI
2025-11-19 19:07:11 -08:00
Krish Dholakia 65ff1eff56 MCP Hub - publish/discover MCP Servers within a company (#16857)
* feat: initial commit adding 'public_mcp_servers' endpoint

allow admin to make mcp servers public for AI Hub

* feat: expose public endpoint for getting public mcp's

* feat: initial flow for making MCP servers public via LiteLLM proxy

* fix: fix message on make mcp public

* fix: indicate existing public mcp servers are public, when making mcp servers public

* style: have a public column indicating if mcp server has been made public

* feat: expose new MCP Hub

* feat: include usage examples for mcp hub
2025-11-19 19:06:21 -08:00
Krrish Dholakia 2d7365c795 refactor: refactor ai hub for internal users to show public model page
more useful than just seeing models they know they have access to
2025-11-19 18:50:10 -08:00
Ishaan Jaff cd6256f64a [Feat] Prompt Management - Add UI for editing the prompts (#16853)
* v0 for prompt management

* v0

* clean up view of prompt editor

* commit editor view

* refactor prompt editor view

* ui - refactor prompt editor

* add move message

* add prompt editor view

* fix allow viewing dotprompt file

* add dotprompt_content

* handleSave for Prompt

* ui fix build fail

* ui fix build
2025-11-19 16:26:11 -08:00
yuneng-jiang 5f463cef64 Fix edit logging settings not appearing (#16798) 2025-11-18 20:31:34 -08:00
yuneng-jiang ab8704f60d Change placeholder for Azure in Add Model (#16597) 2025-11-18 20:13:48 -08:00
yuneng-jiang 69fcedb6d9 [Fix] UI - Add css to truncate long request ids in request viewer (#16665)
* Add css to truncate long request ids in request viewer

* Show tooltip with entire request id when request id is truncated
2025-11-18 20:12:19 -08:00
yuneng-jiang 137c6b03f7 Deactivate delete button on model table for config models (#16787) 2025-11-18 19:51:59 -08:00
yuneng-jiang d0e806d1b3 Add additional model settings to chat models in test key (#16793) 2025-11-18 19:49:16 -08:00