Jugal D. Bhatt and GitHub
900c7f45c0
[MCP Gateway] Litellm mcp pre and during guardrails ( #13188 )
...
* add guardrail support
* add guardrail support
* guardrails for MCP
* added changes
* add mcp guardrails
* added test
* add ui
* fix guardrail form
* working with cursor
* remvoe print
* fix mcp servertests
* fix mypy and remove console logs
* fix mypy and remove console logs
* fix mypy tests
2025-08-01 20:02:25 -07:00
Jugal D. Bhatt and GitHub
5db4862cbf
[MCP Gateway] Litellm mcp client list fail ( #13114 )
...
* fix headers
* fix test
* fix ruff
* added try except for catching errors which lead to client failures
* fix mypy
* fix ruff
* fix tests
* fix python error
* fix test
* fix test
* fixed the MCP Call Tool result
2025-07-30 15:23:19 -07:00
Jugal D. Bhatt and GitHub
eb8a338d9b
[MCP Guardrails] move pre and during hooks to ProxyLoggin ( #13109 )
...
* move pre and during hooks t o ProxyLoggin
* fix lint
* fix ruff
* fix tests
2025-07-30 13:58:41 -07:00
Ishaan Jaff
1af0743e58
Revert "Revert "[MCP Gateway] Add protocol headers ( #13062 )""
...
This reverts commit acd915f2db
2025-07-29 18:14:31 -07:00
Ishaan Jaff
acd915f2db
Revert "[MCP Gateway] Add protocol headers ( #13062 )"
...
This reverts commit 8de24bab7c
2025-07-29 17:26:00 -07:00
Jugal D. Bhatt and GitHub
8de24bab7c
[MCP Gateway] Add protocol headers ( #13062 )
...
* Add protocol headers
* fix mypy
* fix tests
* fix tests
2025-07-29 16:03:23 -07:00
Jugal D. Bhatt and GitHub
ae9a02d7d5
[MCP gateway] add pre and during call hooks init ( #13067 )
...
* add hook init
* add during hook
* added logging
2025-07-29 11:06:58 -07:00
Jugal D. Bhatt and GitHub
b921e22594
[MCP Gateway] Litellm mcp multi header propagation ( #13003 )
...
* change alias-> server_name
* add server alias uses
* add tests
* schema
* ruff fix
* fix alias for config
* fix tests
* add alias
* fix tests
* add multi server header support
* add and fix tests
* fix tests
* fix tests
* add a common util
* ruff fix
* fix ruff
* fix tests
* fix migration
* mypy fix
* change server py
2025-07-26 11:45:14 -07:00
Jugal D. Bhatt and GitHub
10595ea077
[MCP Gateway] add Litellm mcp alias for prefixing ( #12994 )
...
* change alias-> server_name
* add server alias uses
* add tests
* schema
* ruff fix
* fix alias for config
* fix tests
* add alias
* fix tests
* fix tests
* add a common util
* ruff fix
* fix migration
2025-07-25 17:57:52 -07:00
Jugal D. Bhatt and GitHub
a7d0b122b9
[MCP Gateway] List tools from access list for keys ( #12657 )
...
* fix tools fetch for keys
* add unit test
2025-07-16 14:28:53 -07:00
Jugal D. Bhatt and GitHub
b3a214bce7
[MCP Gateway] Allow MCP access groups to be added via the config LIT-312 ( #12654 )
...
* allow mcp access groups to be added via the config
* fix code and doc quality
* fix mypy
* create helpers:
2025-07-16 13:57:43 -07:00
Ishaan Jaff and GitHub
2d6751a396
[Feat] MCP Gateway - allow using MCPs with all LLM APIs when using /responses with LiteLLM ( #12546 )
...
* add MCPResponsesAPIHelper
* rename LiteLLM_Proxy_MCP_Handler
* aresponses_api_with_mcp
* mock_responses_api_response
* test response with litellm proxy MCP
* add _should_use_litellm_mcp_gateway
* fix transform_mcp_tool_to_openai_responses_api_tool
* use correct _transform_mcp_tools_to_openai
* fix config.yaml
* fixes for native MCP handling
* docs MCP with litellm proxy
* aresponses_api_with_mcp
* fix linting
* fix mypy
* fix linting
* test_aresponses_api_with_mcp_mock_integration
* docs How it works when server_url="litellm_proxy"
2025-07-15 14:06:31 -07:00
Ishaan Jaff and GitHub
50b106be11
[MCP Gateway] Ensure we use the same param for specifying groups ( #12561 )
...
* just use 1 param for mcp groups
* fix just use 1 param for access groups
* test_get_tools_from_mcp_servers
* docs access groups
* group MCPs
* test fix
* fix screenshots on docs
* TestMCPAccessGroupsE2E
* update img
* fix MCP connect
2025-07-12 16:41:58 -07:00
Jugal D. Bhatt and GitHub
9fe9e1cd6e
[MCP Gateway] Allow mcp access groups on test key and tool calls ( #12529 )
...
* added mcp tools on internal user and divide it by teams
* add support for server api call
* Added frontend for test key
* added tools used output
* fix ui for servers
* All servers to personal
* change columns format
* revert ui logic
* Added vertical align
* fix mapped tests
* fix lint
* fix lint
* remove extra file
* fix ui test
* comments fixes
* change query type
* change query type
* mcp acces group init
* add ability to change server display on ui through access groups
* Mcp access group names UI (#12486 )
* Added ui changes to reflect mcp_access_groups
* fix edit mcp page
* change to string array (#12491 )
* change to string array
* Remove print
* add ability to change server display on ui through access groups
* Litellm mcp access groups accesses (#12498 )
* added mcp access groups for keys and teams
* added access groups above servers
* fixed ruff
* fixed mypy
* revert couple changes
* fix test
* fixed double asterisks
* Litellm mcp groups UI (#12522 )
* add ui for teams
* fix object permissions
* fix mcp servers test object permission
* remove print
* add helper method
* add tests + remove logs
* add mcp access group servers to test key
* add mcp access group support for headers
* lint fix
* add tests and helper function
* fixed test
* change list -> List
* tests
2025-07-12 10:36:42 -07:00
Ishaan Jaff and GitHub
35bfa7c9ee
[MCP Gateway] - Allow using custom post call MCP hook for cost tracking ( #12469 )
...
* add async_post_mcp_tool_call_hook to custom logger
* instrument call_mcp_tool
* add async_post_mcp_tool_call_hook
* fixes for MCP tests
* test fix MCP tests
* allow adding custom cost for MCP response
* fix LiteLLM_MCPTextContent
* add MCPPostCallResponseObject
* fix _handle_local_mcp_tool
* async_post_mcp_tool_call_hook
* fix typing loc
* fix call_mcp_tool
* fix server.py
* fix MCPPostCallResponseObject
* async_post_mcp_tool_call_hook
* docs mcp cost hook
* fix import path
2025-07-09 18:41:08 -07:00
Ishaan Jaff and GitHub
5cad0dd94b
[Feat] Add MCP Cost Tracking ( #12385 )
...
* fix MCP_TOOL_NAME_PREFIX
* test_mcp_cost_tracking
* init MCPCostCalculator
* add call_mcp_tool
* calculate_mcp_tool_call_cost
* add MCPServerCostInfo
* add mcp_server_cost_info
* add mcp_server_cost_info
* pass through litellm_logging_obj
* logged_standard_logging_payload
* fix logging MCP tool call
* test_mcp_cost_tracking_per_tool
* fix NewMCPServerRequest
* fix add_update_server
* add MCP info to schema.prisma
* fix create_mcp_server
* working custom cost per call
* fix mcp server cost
* fix MCPCostCalculator
* TestMCPCostCalculator
2025-07-07 21:08:10 -07:00
Jugal D. Bhatt and GitHub
62946e58d2
Segregate MCP tools on connections using headers ( #12296 )
...
* Add get tools segregation
* add ui changes (#12302 )
* resolve comments
* add mapped tests
* remove advanced settings (#12323 )
2025-07-04 11:45:51 -07:00
Jugal D. Bhatt and GitHub
df161f1e45
Litellm mcp tool prefix ( #12289 )
...
* prefix all server tools from the backend
* change var name
* fix tests
2025-07-03 11:39:37 -07:00
Jugal Bhatt
27e6ef5f39
added error handling for MCP tools not found
2025-07-01 17:12:01 -07:00
b90d3ca8d0
[Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers ( #11890 ) ( #11891 )
...
* initial mcp auth with special header (#11890 )
Co-authored-by: wagnerjt <wagnerjt@github.com >
* add mcp auth header
* fixes MCP client for litellm proxy
* fixes loc of MCP types
* fixes use MCP client for auth to MCPs
* fix organization
* fix mcp auth header
* add MCP auth header to litellm auth
* fixes for MCP auth
* Add MCP auth to list tools
* fix MCP call tool
* fixes for MCP auth header
* tests for MCP transport
* TestMCPClientUnitTests
* docs MCP auth
* fix types
* docs fix
* fix MCP auth import
* fix code qa check
* test fix mcp auth token check
---------
Co-authored-by: wagnerjt <wagnerjt@github.com >
2025-06-19 20:07:08 -07:00
Ishaan Jaff and GitHub
a8196159b9
[Bug Fixes] MCP - using MCPs defined on config.yaml + fix for MCP error Team doesn't exist in cache ( #11824 )
...
* fix - dont allow missing team to block MCP list response
* use HTTP as default transport
* _generate_stable_server_id
* fix list MCP servers
* ui fix
* test_list_mcp_servers_empty_result
* test_generate_stable_server_id
* _generate_stable_server_id
* fix code QA
* fix code QA
2025-06-17 16:25:12 -07:00
19a8b23644
[Feat] Add Authentication + Permission Management for MCP List, Call Tool Ops ( #11682 )
...
* add basic auth checks for MCP
* working MCP auth
* fix MCP
* add get_allowed_mcp_servers for key, team
* add get_allowed_mcp_servers
* TOOLS FROM MCP SERVERS
* fix - working context vars for handling auth to MCPs
* fix imports
* working _get_allowed_mcp_servers_for_key
* TestUserAPIKeyAuthMCP
* test_user_api_key_auth_mcp
* fix code qa check
* fix imports
* test_mcp_server.py
* fix: fix - working permission mgmt
* Update litellm/proxy/_experimental/mcp_server/auth/user_api_key_auth_mcp.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-06-13 10:13:51 -07:00
7947139913
[Feat] MCP expose streamable https endpoint for LiteLLM Proxy ( #11645 )
...
* feat - add https mcp support
* fixes for MCP http integration
* fix code QA
* bump mcp dep
* test_mcp_server_manager_https_server
* test mcp server https
* fix linting error
* bump mcp in poetry
* fix import streamablehttp_client
* fix streamablehttp_client
* fix streamablehttp_client
* add streamablehttp_client
* add simple https server
* working mounted app
* working HTTPS mcp streamable
* fix code QA check
* feat: add MCP Server
* fix - init just as fastapi app
* add LITELLM_MCP_SERVER_DESCRIPTION
* fix importing / init litellm app
* Update litellm/proxy/_experimental/mcp_server/server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* Update litellm/proxy/_experimental/mcp_server/server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* Update server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* fixes based on review + code check
* fix linting
* test_streamable_http_mcp_handler_mock
* fix python 3.13 install
* fix deps test
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-06-12 16:32:04 -07:00
Ishaan Jaff and GitHub
02b02c739b
[Feat] MCP - Add support for streamablehttp_client MCP Servers ( #11628 )
...
* feat - add https mcp support
* fixes for MCP http integration
* fix code QA
* bump mcp dep
* test_mcp_server_manager_https_server
* test mcp server https
* fix linting error
* bump mcp in poetry
* fix import streamablehttp_client
* fix streamablehttp_client
* fix streamablehttp_client
* add streamablehttp_client
2025-06-11 17:09:46 -07:00
9a6d5c119e
feat: Allow Adding MCP Servers Through LiteLLM UI ( #11208 )
...
* feat: MCP Servers with CRUD operations (#10699 )
* feat: mcp CRUD operations with authn/authz
* feat: mcp server UI
* mcp server page with overview, mcp tools, and settings page
* Adding MCP Server flow
* prisma generate before test
* UI callbacks add/remove with api server refetch
* test fix: poetry run prisma
* feat: mcp server db and config connection
* fix: MCPTool filter on description when not present
* feat: mcp on UI and integrated with list tools
* feat: Update mcp server endpoint
* tests: Unit and integration tests for mcp management endpoints
* fix: docs and ensuring global_mcp_manage up to date
* ui: remove the mcp tools view
* fix: ruff lint
* fix: unit -> integration test area
* fix(ui): remove left nav menu of previous tools
---------
Co-authored-by: wagnerjt <wagnerjt@github.com >
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
* fix: sync DB MCP tools with in memory
* fix: sync DB MCP tools with in memory
* fix: stop using prisma.models
* fix: code qa check
* fix: import MCP
* fix: code QA checks
* fix: code QA checks
* fixes - only list tools for the specific MCP server
* fix: only list MCP tools for selected server
* fix linting error
---------
Co-authored-by: Tyler Wagner <wagnerjt@users.noreply.github.com >
Co-authored-by: wagnerjt <wagnerjt@github.com >
2025-05-28 16:29:27 -07:00
Ishaan Jaff
194327bb7c
test fixes
2025-03-29 18:34:58 -07:00
Ishaan Jaff
4e106ce217
fix test
2025-03-29 17:11:46 -07:00
Ishaan Jaff
a1ec0dd0e2
add testing mcp server
2025-03-29 12:52:46 -07:00
Ishaan Jaff
8a71f129bf
ci_cd_server_path
2025-03-21 19:06:29 -07:00
Ishaan Jaff
19d6051dba
test mcp agent
2025-03-21 17:48:16 -07:00
Ishaan Jaff
6fb2ae8731
docs mcp docs update
2025-03-21 17:21:40 -07:00
Ishaan Jaff
b8b7e5e6cf
clean up
2025-03-21 14:39:05 -07:00
Ishaan Jaff
147787b9e0
call_openai_tool on MCP client
2025-03-21 14:36:32 -07:00
Ishaan Jaff
bbf1962540
fix llm responses
2025-03-21 10:50:55 -07:00
Ishaan Jaff
1a56bb5bdd
transform_mcp_tool_to_openai_tool
2025-03-21 10:49:06 -07:00
Ishaan Jaff
d3279d114e
litellm MCP client 1
2025-03-21 10:32:51 -07:00
Ishaan Jaff
d61febc053
change location of MCP client
2025-03-21 10:30:57 -07:00
Ishaan Jaff
177e72334c
simple MCP interface
2025-03-21 10:11:06 -07:00
