Krrish Dholakia
63cb2764fe
test: fix raise
2025-10-04 16:11:22 -07:00
Krrish Dholakia
2d1000c461
test: update tests
2025-10-04 15:31:25 -07:00
Krish Dholakia and GitHub
a9037ab61f
Merge branch 'main' into litellm_dev_10_03_2025_p1
2025-10-04 15:23:31 -07:00
Krish Dholakia and GitHub
75e3f4e10d
Merge pull request #15120 from BerriAI/litellm_dev_10_01_2025_p2
...
(feat) Support 'guaranteed_throughput' when setting limits on keys belonging to a team
2025-10-04 15:22:47 -07:00
Krrish Dholakia
814e49df06
test: update tests
2025-10-04 14:39:50 -07:00
Ishaan Jaff and GitHub
ec9cdf783a
Revert "Add streamGenerateContent cost tracking in passthrough ( #15199 )" ( #15202 )
...
This reverts commit 8095de506a
2025-10-04 14:37:02 -07:00
Sameer Kankute and GitHub
8095de506a
Add streamGenerateContent cost tracking in passthrough ( #15199 )
...
* Add streamgenerate cost tracking for gemini provider
* add cost tracking test
2025-10-04 12:31:25 -07:00
Ishaan Jaffer
c38c5d20cc
test dynamic rate limiter 3
2025-10-04 12:06:13 -07:00
Ishaan Jaff and GitHub
f78608082c
[Feat] Dynamic Rate Limiter v3 - fixes for detecting saturation + fixes for post saturation behavior ( #15192 )
...
* fix: test case 1, model hits saturation
* fix: _check_rate_limits test case 2
* fix: _get_priority_allocation
* test_default_priority_shared_pool
* fix: No Rate Limiting when low saturatation
* fix: correctly use model_saturation_check
* fixes priority_descriptors
* fix: tune default PriorityReservationSettings
2025-10-04 10:45:17 -07:00
Krrish Dholakia
3816d3b36f
test: add unit testing
2025-10-03 17:27:49 -07:00
Krrish Dholakia
c043ad6c2b
fix: replace list in for set in
...
faster
2025-10-03 17:17:20 -07:00
Krrish Dholakia
69edc546c0
fix(mcp_server_manager.py): don't return an invalid server id on list servers
...
Prevents user from hitting 'server not found' error, even when they see it being listed on litellm ui
2025-10-03 17:15:15 -07:00
Yuta Saito
359aaa947f
test: fix test_mcp_server.py
2025-10-04 08:18:15 +09:00
Krish Dholakia and GitHub
3095f43e92
Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var
...
feature/add max requests env var
2025-10-03 15:30:15 -07:00
rishiganesh2002 and GitHub
d36c8d6bbe
[Feat] MCP Gateway Fine-grained Tools Addition ( #15153 )
...
* feat: UI to add specific tools under creating MCP connection
* chore: pydantic + prisma changes
* feat: adding specific MCP tools now works
* fix: allowed tools filtering
* chore: filtered list to mcp server cost config
* chore: update Readme
* chore: refactor the filtering
* test: Added tests
When the allowed_tests is null, empty list or populated
* chore: resolve the proxy issue
* feat: updating MCP tool filtering
2025-10-03 10:16:29 -07:00
Ishaan Jaff and GitHub
d538cf489a
[Feat] Fixes to dynamic rate limiter v3 - add saturatation detection ( #15119 )
...
* test cases dynamic rate limits
* fix _handle_generous_mode
* docs add readme
* use configs for vars
* fix debug
* add comment
* test_dynamic_rate_limiter_v3.py
* test_concurrent_pre_call_hooks_stress
2025-10-01 18:35:34 -07:00
Krrish Dholakia
757436f302
test: add unit test
2025-10-01 17:51:10 -07:00
Krrish Dholakia
a83238a2db
test: add unit tests
2025-10-01 17:02:05 -07:00
Ishaan Jaff and GitHub
388761f52d
[Fix] LiteLLM UI - Ensure OTEL settings are saved in DB after set on UI ( #15118 )
...
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
* test_add_callback_from_db_to_in_memory_litellm_callbacks
* fix otel
* fix: fix _add_callback_from_db_to_in_memory_litellm_callbacks
2025-10-01 15:33:22 -07:00
Ishaan Jaff and GitHub
e73d053de3
[Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes ( #15115 )
...
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints
* fix: is_registered_pass_through_route
* docs fix
2025-10-01 14:09:01 -07:00
Sameer Kankute and GitHub
7ec7e5332c
Add generateContent cost tracking ( #15014 )
2025-10-01 09:03:45 -07:00
Krish Dholakia and GitHub
1503435d91
Merge pull request #15029 from henryhwang/gemini-adapter-fixes
...
feat(gemini): Add full support for native Gemini API translation
2025-09-30 21:19:18 -07:00
Ishaan Jaff and GitHub
73bfef1a1f
Revert "[Feature]: Replace HTTPException with ParallelRequestLimitError in pa…" ( #15095 )
...
This reverts commit 71b9b58fa9
2025-09-30 21:17:04 -07:00
Henry Wang
acc23b9757
fix issue from pr review
2025-10-01 11:57:10 +08:00
Henry H Wang and GitHub
7c4439ba0a
Merge branch 'BerriAI:main' into gemini-adapter-fixes
2025-10-01 09:53:51 +08:00
Krish Dholakia and GitHub
c475723c67
Merge pull request #15044 from BerriAI/litellm_dev_09_29_2025_p1
...
MCP - enforce server permissions on call tools + Teams - add model specific tpm/rpm limits to teams on LiteLLM
2025-09-30 15:32:53 -07:00
Krish Dholakia and GitHub
5619d350b6
Merge pull request #15074 from Jetemple/custom-logo-fix
...
Make UI theme settings publicly accessible for custom branding
2025-09-30 15:26:00 -07:00
Ishaan Jaff and GitHub
0476a33d9f
[Bug Fix] Passthrough API Endpoints - Ensure query params are forwarded from origin url to downstream request ( #15087 )
...
* test_pass_through_request_query_params_forwarding
* fix: pass_through_request
* test_azure_openai_assistants_e2e_operations_stream
* test_azure_openai_assistants_e2e_operations_stream
2025-09-30 15:01:38 -07:00
Ishaan Jaff and GitHub
69a464fc97
[Fix Security] Ensure OCI secret fields not shared on /models and /v1/models endpoints ( #15085 )
...
* fix: remove_sensitive_info_from_deployment
* fix: remove_sensitive_info_from_deployment
* test_model_info_v1_oci_secrets_not_leaked
2025-09-30 14:55:54 -07:00
71b9b58fa9
[Feature]: Replace HTTPException with ParallelRequestLimitError in parallel_request_limiter_v3 ( #15033 )
...
* Initial plan
* Implement ParallelRequestLimitError custom exception to replace HTTPException
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
* Add ParallelRequestLimitError to litellm main module exports
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-30 13:57:14 -07:00
Krrish Dholakia
0cd61a6a6a
fix: simplify testing
2025-09-30 12:37:25 -07:00
Jack Temple
7212116d8c
test: add UI theme settings retrieval and update tests
2025-09-30 10:01:44 -05:00
Henry Wang
d838c96ffb
fix test issues from pr review
2025-09-30 16:05:17 +08:00
f22fd4cddd
Fix: Add /v1/messages/count_tokens to Anthropic routes for non-admin user access ( #15034 )
...
* Initial plan
* Fix: Add /v1/messages/count_tokens to Anthropic routes for user access
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-29 18:16:52 -07:00
ebf72f5eb9
[Fix] Parallel Request Limiter v3 - use well known redis cluster hashing algorithm ( #15052 )
...
* test_keyslot_for_redis_cluster
* fix _is_redis_cluster
* Update litellm/proxy/hooks/parallel_request_limiter_v3.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-09-29 18:12:44 -07:00
Ishaan Jaffer
f303860881
Revert "test_keyslot_for_redis_cluster"
...
This reverts commit 52de33787b
2025-09-29 16:42:15 -07:00
Ishaan Jaffer
52de33787b
test_keyslot_for_redis_cluster
2025-09-29 16:41:32 -07:00
Krrish Dholakia
9ed83d44e3
test: remove unnecessary test
2025-09-29 13:35:34 -07:00
Sameer Kankute and GitHub
3ab1c31e4e
(Feat) Add cost tracking for Vertex AI Passthrough /predict endpoint ( #15019 )
...
* Add cost tracking for passthrough for predict endpoint
* restore file
2025-09-29 13:19:04 -07:00
Krrish Dholakia
bc6e6e7a28
fix(auth_checks.py): add auth checks to mcp server on call tools
2025-09-29 13:13:10 -07:00
Henry Wang
99a884019b
test(gemini): Add unit tests for Google GenAI adapter
...
This commit adds a comprehensive suite of unit tests for the Google GenAI adapter to ensure compliance with the project's contribution guidelines.
The new tests cover four main areas:
- Request parameter translation
- Streaming response handling
- Router methods for Google GenAI
- Proxy endpoints for Google GenAI
Additionally, this commit includes minor formatting and linting fixes identified during development.
2025-09-29 18:51:35 +08:00
Krish Dholakia and GitHub
0d738b2899
Merge pull request #14986 from uc4w6c/fix/remove-servername-prefix-mcp_tools-tests
...
Fix/remove servername prefix mcp tools tests
2025-09-28 18:00:23 -07:00
Krrish Dholakia
f32b0364c4
fix: fix tests
2025-09-28 17:55:46 -07:00
Yuta Saito
dae7d08ff2
Revert "Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools""
...
This reverts commit a88d774f94
2025-09-29 07:12:24 +09:00
TobiMayr
3c99d2236a
feature/add max requests env var
2025-09-28 19:18:56 +01:00
Krish Dholakia and GitHub
c328b4a036
Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
...
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia
53d0cbb1b7
fix: update tests + logic for passing multiple headers
2025-09-28 09:09:11 -07:00
Krrish Dholakia
526156ed9d
feat(mcp/): allows admin to prevent llm's from accidentally deleting github repo's even if user is allowed to do this
2025-09-27 19:36:11 -07:00
Ishaan Jaffer
35c14f7178
Revert "Merge pull request #14821 from hazyone/fix-13380"
...
This reverts commit 37ea89eff0aede742db5
2025-09-27 18:52:59 -07:00
Krrish Dholakia
0ff7177373
feat(user_api_key_auth_mcp.py): pass extra headers from clientside straight through - allow multiple clientside headers
...
Closes LIT-952
2025-09-27 17:11:06 -07:00
Krrish Dholakia