Commit Graph
328 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 36cc98254c [Fix] Parallel Request Limiter v3 - ensure Lua scripts can execute on redis cluster (#14968)
* use hashtag slots for rate limiting logic

* redis_startup_nodes fix

* test_execute_redis_batch_rate_limiter_script_cluster_compatibility

* async_increment_tokens_with_ttl_preservation
2025-09-26 18:15:57 -07:00
Ishaan JaffandGitHub 628cd13755 [Feat] UI - Allow scheduling key rotations when creating virtual keys (#14960)
* fix design of key reset interval

* fix: LiteLLM_VerificationToken

* fix key manager

* add key_rotation_at

* ui fix

* fix ui view

* set key_rotation_at  on creation

* add key_rotation_at

* fix info

* fix: _set_key_rotation_fields

* fix KeyRotationManager

* fix key edit view

* test_update_key_fn_auto_rotate_enable

* fix KeyRotationManager
2025-09-26 16:24:40 -07:00
Ishaan Jaff ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Ishaan Jaffer 539d10f9cb test fix 2025-09-26 11:06:26 -07:00
Alexsander HamirandGitHub eaa04cd8ce fix: use fastuuid helper (#14903)
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
Arshdeep Singh 471f011ae5 fix: add return type annotation for full mypy compliance 2025-09-25 12:52:12 -04:00
Arshdeep Singh 8193f56876 fix: remove print statement to pass ruff linting checks 2025-09-25 12:39:49 -04:00
Arshdeep Singh 39683cc3d8 fix: remove unused custom_recognizers variable to pass linting 2025-09-25 12:31:08 -04:00
Arshdeep Singh 8364da014f style: format code with black 2025-09-25 12:23:44 -04:00
Arshdeep Singh 82ec42993f fix(presidio): enable custom PII entities with Union type 2025-09-25 12:16:22 -04:00
Ishaan Jaffer b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan JaffandGitHub ded823a3a3 [Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
Krish DholakiaandGitHub 37ea89eff0 Merge pull request #14821 from hazyone/fix-13380
Fix: support claude code auth via subscription (anthropic)
2025-09-23 22:52:32 -07:00
Krish DholakiaandGitHub d59dec39d0 Merge pull request #14826 from Jetemple/sso-clear-button-fix
fix: SSO "Clear" button writes empty values instead of removing SSO config
2025-09-23 22:49:47 -07:00
Ishaan JaffandGitHub f4ecf3ca72 [Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway (#14836)
* fix: error msg from updating key

* fix _create_new_cli_key

* fix validate_key_team_change

* fix interface for chat

* ruff fix

* fix auth for keys

* get_litellm_gateway_api_key

* fix chat

* test fix

* linting fix

* fix mypy

* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer a48273740d test fix 2025-09-23 17:46:09 -07:00
Ishaan Jaffer 79a6feb7ac generate_mock_mcp_server_config_record 2025-09-23 17:33:11 -07:00
Ishaan Jaffer aaebd83f31 test fixes 2025-09-23 16:07:01 -07:00
Ishaan Jaffer 5fc70396ad test fix 2025-09-23 15:50:11 -07:00
Ishaan Jaffer 7e64df92a5 test_cli_sso_callback_regenerate_existing_key 2025-09-23 15:42:07 -07:00
Ishaan Jaffer bb6fb445c0 ui test fix 2025-09-23 14:34:08 -07:00
Ishaan Jaffer a88d774f94 Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools"
This reverts commit 7216983f48, reversing
changes made to e377e30e95.
2025-09-23 14:14:43 -07:00
Jack Temple 1585a1ba8e fix: SSO clear button now properly clears settings instead of creating empty encrypted values 2025-09-23 14:35:53 -05:00
hazyone 96aed6a4d4 test added 2025-09-23 20:16:05 +02:00
Krish DholakiaandGitHub e912b89549 Merge branch 'main' into feat/remove-servername-prefix-mcp_tools 2025-09-22 22:43:12 -07:00
Krish DholakiaandGitHub b7803bcbb0 Merge pull request #14778 from otaviofbrito/chore/fix-vllm-pasthrough
fix vllm passthrough
2025-09-22 22:40:15 -07:00
Uzair AliandGitHub 3e9540f589 feat: enable custom fields in mcp_info configuration (#14794)
Allow proxy admins to add arbitrary metadata fields to MCP servers
in config.yaml under mcp_servers.<server>.mcp_info, similar to how
model_info already works.

Changes:
- Changed MCPInfo from TypedDict to Dict[str, Any] for flexibility
- Updated load_servers_from_config to preserve all custom fields
- Updated add_update_server to handle arbitrary fields from database
- Added comprehensive unit tests covering all scenarios
2025-09-22 21:15:35 -07:00
Krish DholakiaandGitHub 0a1c1a27a7 Merge pull request #14787 from BerriAI/litellm_dev_09_22_2025_p1
docs(provider_specific_params.md): fix docs
2025-09-22 17:45:57 -07:00
Krrish Dholakia 70cd9d3d4e test: fix unit test to work on github action 2025-09-22 17:38:11 -07:00
Ishaan JaffandGitHub fa20abfe48 [Feat] Proxy CLI Auth - Allow re-using cli auth token (#14780)
* fix: cli auth with SSO okta

* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME

* fix: get_litellm_cli_user_api_key_auth

* use existing_key CLI

* fix: use existing key

* test auth commands

* test_cli_sso_callback_regenerate_vs_create_flow
2025-09-22 10:07:16 -07:00
Otavio Brito ffd9117357 fix failing test 2025-09-22 11:06:11 -03:00
Otavio Brito 33a11c4b07 fix vllm passthrough 2025-09-22 10:09:02 -03:00
Ishaan Jaffer 4b876ea9ca test_sanitize_request_body_for_spend_logs_payload_mixed_types 2025-09-20 12:33:37 -07:00
Ishaan Jaffer ed5c9f1c69 test fixes for mapped tests 2025-09-19 18:01:36 -07:00
Krish DholakiaandGitHub 6142c3ac3d Merge pull request #14738 from BerriAI/litellm_dev_09_19_2025_p1
UI SSO - consider token info endpoint on generic SSO route for access control groups
2025-09-19 17:58:37 -07:00
Ishaan Jaffer c3f150b13d mcp test fix 2025-09-19 17:41:15 -07:00
Krrish Dholakia 7694e9f6a9 test: refactoring + testing 2025-09-19 17:20:15 -07:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
90ee9e4587 [Feat] Dynamic Rate Limiter v3 - fixes to ensure priority routing works as expected (#14734)
* fix: dynamic limiter v3

* fix: dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3 in init litellm_logging

* feat: add dynamic limiter v3 in init litellm_logging

* fix: priority rate limiting

* Potential fix for code scanning alert no. 3397: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix: priority rate limiting

* fix: ruff

* fix: mypy lint

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-19 16:04:45 -07:00
Yuta Saito 7d93856c93 fix: correct mistake introduced during conflict resolution 2025-09-20 06:44:06 +09:00
Yuta Saito a8059f80f4 feat: remove server_name prefix from list_tools when only one server is present (#14504) 2025-09-19 18:29:43 +09:00
Krish DholakiaandGitHub ad6ba8f5c5 Merge pull request #14695 from uc4w6c/fix/mcp-gateway-tools-list
Fix/mcp gateway tools list
2025-09-18 23:40:14 -07:00
= 14b3cc2f95 Update test_bedrock_guardrails.py 2025-09-18 19:48:16 -07:00
= ed4bd504ea Revert "removed unnecessary test"
This reverts commit ad663e5240.
2025-09-18 19:45:13 -07:00
= ad663e5240 removed unnecessary test 2025-09-18 19:37:15 -07:00
= a3f0a3c05f Update test_bedrock_guardrails.py 2025-09-18 15:51:42 -07:00
= 911918474a removed duplicate code 2025-09-18 15:49:16 -07:00
Yuta Saito 7f8b1d0708 test: fix failing tests after conflict resolution 2025-09-19 07:48:37 +09:00
= 917c8bb43c Update test_bedrock_guardrails.py 2025-09-18 15:42:41 -07:00
= a86b9a1808 check for AWS exceptions despite a 200 response 2025-09-18 15:42:36 -07:00
Yuta Saito 654f1d3290 fix: stop including spec_version in MCP server registration inserts 2025-09-19 07:06:15 +09:00