Jugal D. Bhatt
62946e58d2
Segregate MCP tools on connections using headers ( #12296 )
...
* Add get tools segregation
* add ui changes (#12302 )
* resolve comments
* add mapped tests
* remove advanced settings (#12323 )
2025-07-04 11:45:51 -07:00
Jugal D. Bhatt
df161f1e45
Litellm mcp tool prefix ( #12289 )
...
* prefix all server tools from the backend
* change var name
* fix tests
2025-07-03 11:39:37 -07:00
Jugal Bhatt
27e6ef5f39
added error handling for MCP tools not found
2025-07-01 17:12:01 -07:00
Ishaan Jaff
b90d3ca8d0
[Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers ( #11890 ) ( #11891 )
...
* initial mcp auth with special header (#11890 )
Co-authored-by: wagnerjt <wagnerjt@github.com >
* add mcp auth header
* fixes MCP client for litellm proxy
* fixes loc of MCP types
* fixes use MCP client for auth to MCPs
* fix organization
* fix mcp auth header
* add MCP auth header to litellm auth
* fixes for MCP auth
* Add MCP auth to list tools
* fix MCP call tool
* fixes for MCP auth header
* tests for MCP transport
* TestMCPClientUnitTests
* docs MCP auth
* fix types
* docs fix
* fix MCP auth import
* fix code qa check
* test fix mcp auth token check
---------
Co-authored-by: wagnerjt <wagnerjt@github.com >
2025-06-19 20:07:08 -07:00
Ishaan Jaff
a8196159b9
[Bug Fixes] MCP - using MCPs defined on config.yaml + fix for MCP error Team doesn't exist in cache ( #11824 )
...
* fix - dont allow missing team to block MCP list response
* use HTTP as default transport
* _generate_stable_server_id
* fix list MCP servers
* ui fix
* test_list_mcp_servers_empty_result
* test_generate_stable_server_id
* _generate_stable_server_id
* fix code QA
* fix code QA
2025-06-17 16:25:12 -07:00
Ishaan Jaff
19a8b23644
[Feat] Add Authentication + Permission Management for MCP List, Call Tool Ops ( #11682 )
...
* add basic auth checks for MCP
* working MCP auth
* fix MCP
* add get_allowed_mcp_servers for key, team
* add get_allowed_mcp_servers
* TOOLS FROM MCP SERVERS
* fix - working context vars for handling auth to MCPs
* fix imports
* working _get_allowed_mcp_servers_for_key
* TestUserAPIKeyAuthMCP
* test_user_api_key_auth_mcp
* fix code qa check
* fix imports
* test_mcp_server.py
* fix: fix - working permission mgmt
* Update litellm/proxy/_experimental/mcp_server/auth/user_api_key_auth_mcp.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-06-13 10:13:51 -07:00
Ishaan Jaff
7947139913
[Feat] MCP expose streamable https endpoint for LiteLLM Proxy ( #11645 )
...
* feat - add https mcp support
* fixes for MCP http integration
* fix code QA
* bump mcp dep
* test_mcp_server_manager_https_server
* test mcp server https
* fix linting error
* bump mcp in poetry
* fix import streamablehttp_client
* fix streamablehttp_client
* fix streamablehttp_client
* add streamablehttp_client
* add simple https server
* working mounted app
* working HTTPS mcp streamable
* fix code QA check
* feat: add MCP Server
* fix - init just as fastapi app
* add LITELLM_MCP_SERVER_DESCRIPTION
* fix importing / init litellm app
* Update litellm/proxy/_experimental/mcp_server/server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* Update litellm/proxy/_experimental/mcp_server/server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* Update server.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
* fixes based on review + code check
* fix linting
* test_streamable_http_mcp_handler_mock
* fix python 3.13 install
* fix deps test
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-06-12 16:32:04 -07:00
Ishaan Jaff
02b02c739b
[Feat] MCP - Add support for streamablehttp_client MCP Servers ( #11628 )
...
* feat - add https mcp support
* fixes for MCP http integration
* fix code QA
* bump mcp dep
* test_mcp_server_manager_https_server
* test mcp server https
* fix linting error
* bump mcp in poetry
* fix import streamablehttp_client
* fix streamablehttp_client
* fix streamablehttp_client
* add streamablehttp_client
2025-06-11 17:09:46 -07:00
Ishaan Jaff
9a6d5c119e
feat: Allow Adding MCP Servers Through LiteLLM UI ( #11208 )
...
* feat: MCP Servers with CRUD operations (#10699 )
* feat: mcp CRUD operations with authn/authz
* feat: mcp server UI
* mcp server page with overview, mcp tools, and settings page
* Adding MCP Server flow
* prisma generate before test
* UI callbacks add/remove with api server refetch
* test fix: poetry run prisma
* feat: mcp server db and config connection
* fix: MCPTool filter on description when not present
* feat: mcp on UI and integrated with list tools
* feat: Update mcp server endpoint
* tests: Unit and integration tests for mcp management endpoints
* fix: docs and ensuring global_mcp_manage up to date
* ui: remove the mcp tools view
* fix: ruff lint
* fix: unit -> integration test area
* fix(ui): remove left nav menu of previous tools
---------
Co-authored-by: wagnerjt <wagnerjt@github.com >
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
* fix: sync DB MCP tools with in memory
* fix: sync DB MCP tools with in memory
* fix: stop using prisma.models
* fix: code qa check
* fix: import MCP
* fix: code QA checks
* fix: code QA checks
* fixes - only list tools for the specific MCP server
* fix: only list MCP tools for selected server
* fix linting error
---------
Co-authored-by: Tyler Wagner <wagnerjt@users.noreply.github.com >
Co-authored-by: wagnerjt <wagnerjt@github.com >
2025-05-28 16:29:27 -07:00
Ishaan Jaff
194327bb7c
test fixes
2025-03-29 18:34:58 -07:00
Ishaan Jaff
4e106ce217
fix test
2025-03-29 17:11:46 -07:00
Ishaan Jaff
a1ec0dd0e2
add testing mcp server
2025-03-29 12:52:46 -07:00
Ishaan Jaff
8a71f129bf
ci_cd_server_path
2025-03-21 19:06:29 -07:00
Ishaan Jaff
19d6051dba
test mcp agent
2025-03-21 17:48:16 -07:00
Ishaan Jaff
6fb2ae8731
docs mcp docs update
2025-03-21 17:21:40 -07:00
Ishaan Jaff
b8b7e5e6cf
clean up
2025-03-21 14:39:05 -07:00
Ishaan Jaff
147787b9e0
call_openai_tool on MCP client
2025-03-21 14:36:32 -07:00
Ishaan Jaff
bbf1962540
fix llm responses
2025-03-21 10:50:55 -07:00
Ishaan Jaff
1a56bb5bdd
transform_mcp_tool_to_openai_tool
2025-03-21 10:49:06 -07:00
Ishaan Jaff
d3279d114e
litellm MCP client 1
2025-03-21 10:32:51 -07:00
Ishaan Jaff
d61febc053
change location of MCP client
2025-03-21 10:30:57 -07:00
Ishaan Jaff
177e72334c
simple MCP interface
2025-03-21 10:11:06 -07:00