Eddie Richter
929510ef5d
Adding unit tests and documentation
2025-09-30 12:12:24 -06:00
Krish Dholakia and GitHub
fd1a986596
Merge pull request #15013 from serializer/patch-1
...
[bug]: Update request handling for original exceptions
2025-09-29 21:59:26 -07:00
Krish Dholakia and GitHub
79d071c25c
Merge pull request #15022 from BerriAI/litellm_gemini_tool_search
...
Ignore type param for gemini tools
2025-09-29 21:57:50 -07:00
Krish Dholakia and GitHub
9a44fcdc32
Merge pull request #15050 from uc4w6c/fix/regression-mcp-protocol-version
...
fix: resolve regression with duplicate Mcp-Protocol-Version header
2025-09-29 21:53:00 -07:00
Ishaan Jaff and GitHub
708c0bd78d
[Feat] Return Cost for Responses API Streaming requests ( #15053 )
...
* test_basic_openai_responses_api_streaming
* _transform_chat_completion_usage_to_responses_usage
* ResponseAPIUsage.cost
* test fixes for anthropic cost with /responses
* fix mypy typng
2025-09-29 19:47:04 -07:00
Ishaan Jaffer
f1578b49e2
vertex_httpx_mock_post
2025-09-29 18:25:54 -07:00
f22fd4cddd
Fix: Add /v1/messages/count_tokens to Anthropic routes for non-admin user access ( #15034 )
...
* Initial plan
* Fix: Add /v1/messages/count_tokens to Anthropic routes for user access
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-29 18:16:52 -07:00
ebf72f5eb9
[Fix] Parallel Request Limiter v3 - use well known redis cluster hashing algorithm ( #15052 )
...
* test_keyslot_for_redis_cluster
* fix _is_redis_cluster
* Update litellm/proxy/hooks/parallel_request_limiter_v3.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-09-29 18:12:44 -07:00
Ishaan Jaff and GitHub
f6d7683261
[Feat] LiteLLM Overhead metric tracking - Add support for tracking litellm overhead on cache hits ( #15045 )
...
* test_litellm_overhead
* vertex track overhead
* fix config.yaml used for testing
* test_litellm_overhead_stream
* add update_response_metadata for caching handler
* add CachingDetails
* fix update_response_metadata import
* add CachingDetails metrics
* add CachingDetails
* test_litellm_overhead_cache_hit
* test_litellm_overhead_cache_hit
* test_litellm_overhead_cache_hit
2025-09-29 17:33:27 -07:00
Ishaan Jaffer
f303860881
Revert "test_keyslot_for_redis_cluster"
...
This reverts commit 52de33787b
2025-09-29 16:42:15 -07:00
Ishaan Jaffer
52de33787b
test_keyslot_for_redis_cluster
2025-09-29 16:41:32 -07:00
Alexsander Hamir and GitHub
d4830e34e5
fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency ( #15046 )
...
* fix: remove redundant deep copy
set_model_list already does the deep copy at the beginning of the call.
* fix: remove unused model_list arguments
The `model_list` parameter was being passed to classes that did not use it.
* fix: reduce per-request memory and time from O(N×M) to O(N)
No need to create a whole array for a simple look up.
* add: missing test
* fix: remove unused parameter
2025-09-29 15:49:46 -07:00
Ishaan Jaffer
e0172b86e2
test_litellm_overhead_non_streaming
2025-09-29 15:48:32 -07:00
Yuta Saito
5359a0d6a6
fix: test
2025-09-30 07:25:32 +09:00
Ishaan Jaff and GitHub
619577d4e8
[Feat] Add litellm overhead metric for VertexAI ( #15040 )
...
* test_litellm_overhead
* vertex track overhead
* fix config.yaml used for testing
* test_litellm_overhead_stream
* add update_response_metadata for caching handler
* Revert "add update_response_metadata for caching handler"
This reverts commit f2a891f2b448b878a5dbf4b5b0a6166c807b3705.
2025-09-29 15:15:25 -07:00
Sameer Kankute and GitHub
3ab1c31e4e
(Feat) Add cost tracking for Vertex AI Passthrough /predict endpoint ( #15019 )
...
* Add cost tracking for passthrough for predict endpoint
* restore file
2025-09-29 13:19:04 -07:00
Ishaan Jaff and GitHub
4dc23e8079
Revert "feat: improve vertex AI/gemini api_base handling for proxy services (…" ( #15042 )
...
This reverts commit ff2d19e4ca
2025-09-29 13:03:46 -07:00
Zero Clover and GitHub
ff2d19e4ca
feat: improve vertex AI/gemini api_base handling for proxy services ( #15039 )
2025-09-29 12:12:32 -07:00
Shubham Pathak
3f312d0527
Added test
2025-09-29 21:43:31 +05:30
Sameerlite
58955a0348
Ignore type param for gemini tools
2025-09-29 16:32:21 +05:30
Krish Dholakia and GitHub
0d738b2899
Merge pull request #14986 from uc4w6c/fix/remove-servername-prefix-mcp_tools-tests
...
Fix/remove servername prefix mcp tools tests
2025-09-28 18:00:23 -07:00
Krish Dholakia and GitHub
e7939b0521
Merge pull request #14983 from abhijitjavelin/main
...
Feat: Add Javelin standalone guardrails integration for LiteLLM Proxy
2025-09-28 17:59:07 -07:00
Krrish Dholakia
f32b0364c4
fix: fix tests
2025-09-28 17:55:46 -07:00
Yuta Saito
be5010a675
test: fix tests
2025-09-29 07:21:32 +09:00
Yuta Saito
dae7d08ff2
Revert "Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools""
...
This reverts commit a88d774f94
2025-09-29 07:12:24 +09:00
Krish Dholakia and GitHub
c328b4a036
Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
...
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia
53d0cbb1b7
fix: update tests + logic for passing multiple headers
2025-09-28 09:09:11 -07:00
Krrish Dholakia
9403efa511
test: fix tests
2025-09-28 08:54:15 -07:00
Krrish Dholakia
1256dd53d9
test: update tests
2025-09-28 08:53:11 -07:00
Abhijit L
0d7256cd4e
fix: reject status code and tests.
2025-09-28 16:56:28 +05:30
Abhijit L
8169c61a48
fix: tests
2025-09-28 15:46:38 +05:30
Ishaan Jaff
7052108d19
test_completion_azure
2025-09-27 22:44:46 -07:00
Ishaan Jaff
32ed5ae2b9
test_completion_cost
2025-09-27 22:43:51 -07:00
Krrish Dholakia
340262c85f
feat(server.py): only show allowed mcp tools
2025-09-27 20:57:12 -07:00
Krrish Dholakia
526156ed9d
feat(mcp/): allows admin to prevent llm's from accidentally deleting github repo's even if user is allowed to do this
2025-09-27 19:36:11 -07:00
abhijitjavelin and GitHub
aedcedb2b6
Merge branch 'BerriAI:main' into main
2025-09-28 07:53:06 +05:30
Ishaan Jaffer
35c14f7178
Revert "Merge pull request #14821 from hazyone/fix-13380"
...
This reverts commit 37ea89eff0aede742db5
2025-09-27 18:52:59 -07:00
Ishaan Jaffer
ce57f59531
test_gemini_pass_through_endpoint
2025-09-27 17:17:12 -07:00
Krrish Dholakia
0ff7177373
feat(user_api_key_auth_mcp.py): pass extra headers from clientside straight through - allow multiple clientside headers
...
Closes LIT-952
2025-09-27 17:11:06 -07:00
Ishaan Jaffer
9c9b71f62e
fix bedrock end of life img gen models
2025-09-27 17:02:48 -07:00
Ishaan Jaffer
0ec7dace79
test_embedding
2025-09-27 16:57:27 -07:00
Krrish Dholakia
82948b9a1a
test: update test
2025-09-27 16:30:52 -07:00
Krrish Dholakia
0560cb5cfe
fix(openai/image_edit/transformation.py): fix passing multiple images to openai
2025-09-27 16:03:17 -07:00
Ishaan Jaffer
6d74f33043
test azure instruct
2025-09-27 15:01:25 -07:00
Ishaan Jaffer
a6ea8a5984
test_openai_stream_options_call
2025-09-27 15:01:25 -07:00
Ishaan Jaffer
5077e36f1b
test_completion_azure
2025-09-27 15:01:25 -07:00
Ishaan Jaffer
73c32c01a4
test_chat_azure_stream
2025-09-27 15:01:25 -07:00
Krish Dholakia and GitHub
a7470b3291
Merge pull request #14982 from BerriAI/litellm_ci_cd_linting_fixes_09_29_2025_p2
...
Litellm ci cd linting fixes 09 29 2025 p2
2025-09-27 14:41:39 -07:00
Krrish Dholakia
4e283aa13b
fix: fix linting errors
2025-09-27 14:25:05 -07:00
Ishaan Jaffer
5d7694293f
fix passthru tests
2025-09-27 14:24:55 -07:00
Eddie Richter