9e02a38002
add schema.prisma
2026-01-23 13:16:58 -08:00
809b4cb310
Revert "Revert "[Feature] Deleted Keys and Deleted Teams Table""
2026-01-16 14:25:23 -08:00
034e3a6d44
Revert "[Feature] Deleted Keys and Deleted Teams Table"
2026-01-17 06:46:41 +09:00
830f2deb0d
ensuring this still works PENDING PROXY EXTRAS
2026-01-15 17:24:31 -08:00
5ff768e5e0
Merge remote-tracking branch 'origin' into litellm_deleted_keys_team
2026-01-15 15:55:18 -08:00
140ce5fce2
Merge remote-tracking branch 'origin' into litellm_key_team_routing_config
2026-01-07 11:08:01 -08:00
ccfffc5de9
Add endpoint to aggregate activity tables
2026-01-06 15:54:03 -08:00
1b7b42628d
Add/update for router_settings in keys / teams
2026-01-05 16:19:42 -08:00
f1d77ae14d
feat: allow_all_keys to mcp server
2026-01-05 15:49:09 +09:00
35f9a75d55
feat: add UI support for configuring meta URLs
2026-01-02 15:07:37 +09:00
2a4f883e78
Merge remote-tracking branch 'origin' into litellm_deleted_keys_team
2025-12-19 11:36:27 -08:00
09b5ee9428
[Feat] Unified Skills API - works across Anthropic, Vertex, Azure, Bedrock ( #18232 )
...
* init LiteLLM_SkillsTable
* init LiteLLMSkillsTransformationHandler
* init LiteLLMSkillsTransformationHandler
* init skills
* init SkillsInjectionHook
* init litellm skills handler
* _fetch_skill_from_db
* LiteLLMSkillsTransformationHandler
* add _prisma_skill_to_litellm
* use SkillPromptInjectionHandler
* refactor skills handler
* add slack GIF
* test_skill_code_execution_via_deployment_hook
* init readme
* test_get_skill_sdk
* test skills in DB
* fix code qa
* init with containers param
* SkillsInjectionHook
* fix type
* convert_skill_to_anthropic_tool, get_litellm_code_execution_tool_anthropic
* fix messages skills handler
* test_slack_gif_skill_creates_gif
* init SkillsInjectionHook
* clean async_pre_call_hook
* fixes
* working unified skills API! yeet
* fix mypy linting
* LiteLLM_SkillsTable
* llm-sandbox==0.3.31
* fix
2025-12-19 18:55:59 +05:30
305a177135
Schema changes
2025-12-18 15:39:33 -08:00
da81ab6d97
Merge pull request #17758 from BerriAI/litellm_managed_files_target_storage
...
Add v0 support for target storage
2025-12-12 22:26:34 +05:30
7b1cef86a7
Add support for target_storage param
2025-12-11 15:08:17 +05:30
91056c1d7e
Merge remote-tracking branch 'origin' into litellm_daily_agent_table
2025-12-10 20:47:58 -08:00
059fedbed5
[Feat] Agent Gateway - Track agent_id in SpendLogs ( #17795 )
...
* add agent_id in metadata in spend logs
* add agent_id in SpendLogsPayload
* add agent_id in SpendLogsPayload
* add _set_agent_id_on_logging_obj
* add agent id tracking in SpendLogs
* add agent id in spend logs
* fix create_a2a_client
* test_asend_message_passes_agent_id_to_callback
* test_get_logging_payload_includes_agent_id_from_kwargs
* test_asend_message_streaming_triggers_callbacks
* fix asend_message_streaming
* asend_message_streaming
* A2AStreamingIterator
* _handle_stream_message
* test_asend_message_streaming_propagates_metadata
2025-12-10 16:09:56 -08:00
1cad479297
Daily Agent Usage Table WIP
2025-12-10 11:50:52 -08:00
e4442c2946
Change UI Settings to a dedicated table
2025-12-09 11:19:53 -08:00
cb18af542e
Merge pull request #17498 from BerriAI/litellm_customer_usage_backend
...
[Feature] Customer (end user) Usage
2025-12-05 15:31:08 -08:00
8f592088ed
[Feat] Agent Access Control - Enforce Allowed agents by key, team + add agent access groups on backend ( #17502 )
...
* init schema.prisma
* init LiteLLM_ObjectPermissionTable with agents and agent_access_groups
* TestAgentRequestHandler
* refatctor agent list
* add AgentRequestHandler
* fix agent access controls by key/team
* feat - new migration for LiteLLM_AgentsTable
* fix add LiteLLM_ObjectPermissionBase with agent and agent groups
* add agent routes to llm api routes
* add agent routes as llm route
2025-12-04 16:31:00 -08:00
562afb208d
v0 customer usage, pending tests + extras version bump
2025-12-04 12:30:08 -08:00
dd72ff3abf
Add organization_id to spend logs table
2025-11-22 12:54:49 -08:00
6029a24baa
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-20 20:19:16 -08:00
c7cf18cf67
[Feat] Prompt Management - Allow storing prompt version in DB ( #16848 )
...
* test_dotprompt_auto_detection_with_model_only
* fix _auto_detect_prompt_management_logger
* test_dotprompt_with_prompt_version
* add v1, v2 tests
* add _compile_prompt_helper
* fix _compile_prompt_helper
* test_dotprompt_with_prompt_version
* test_dotprompt_with_prompt_version, test_get_prompt_with_version
* add version in schema
* feat add _get_prompt_spec_for_db_prompt
* add _get_prompt_spec_for_db_prompt
* feat add _get_prompt_spec_for_db_prompt
* update prompt table
* add version in prompt DB
* test_get_prompt_spec_for_db_prompt_with_versions
2025-11-19 13:19:56 -08:00
f36cbccd56
Merge remote-tracking branch 'origin' into litellm_org_usage
2025-11-15 16:28:12 -08:00
8097fafc05
Agents - support agent registration + discovery (A2A spec) ( #16615 )
...
* fix: initial commit adding types
* refactor: refactor to include agent registry
* feat(agents/): endpoints.py
working endpoint for agent discovery
* feat(agent_endpoints/endpoints.py): add permission management logic to agents endpoint
* feat: public endpoint for showing publicly discoverable agents
* feat: make /public/agent_hub discoverable
* feat(agent_endpoints/endpoints.py): working create agent endpoint
adds dynamic agent registration to the proxy
* feat: working crud endpoints
* feat: working multi-instance create/delete agents
* feat(migration.sql): add migration for agents table
2025-11-14 18:23:30 -08:00
94da5c076c
Add Daily Org Spend Table, read path, and write path
2025-11-12 18:22:26 -08:00
67478a9074
[Fix] Litellm tags usage add request_id ( #16111 )
...
* Add request_id into tag spend
* Linting
2025-11-11 18:53:48 -08:00
6eb74bd62a
Feat/persist mcp credentials in db ( #16308 )
...
* feat: persist mcp credentials in db
* feat: remove Auth Value field from MCP Tool Testing Playground
* fix: test
2025-11-07 19:22:49 -08:00
8e27b6c0b4
[MCP] configure static mcp header ( #16179 )
...
* feat: configure extra mcp headers in ui
* doc: static header
* build: add new migration file
* chore: add missing image file
* fix: test
2025-11-03 21:06:36 -08:00
6637beb247
fix: minor fixes + dep updates
2025-11-01 13:45:42 -07:00
43aacf2dc0
(feat) Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API ( #16160 )
...
* feat(vector_store_endpoints/endpoints.py): add new index_create endpoint
allows admin to create a virtual index, to do permission management for
* feat(key_management_endpoints.py): enable setting allowed_vector_store_indexes on keys
proxy admin can enable dev to create an index on a vector stor
* feat: initial commit adding vector store index passthrough logic to litellm
* feat: add vector store table
* fix(azure_ai/transformation.py): fix headers
* feat: track read/write endpoints by vector store integration
enables permissions by index to work
* fix: azure_ai/vector_stores/search
document the vector store endpoints correctly
ensures permission management works as expected
* fix(proxy/utils.py): improve error message
* docs(azure_ai_vector_stores_passthrough.md): document azure ai passthrough vector store support
* docs(create.md): document azure ai support via passthrough for vector store create
* fix: fix code qa errors
* fix: document new allowed_vector_store_indexes endpoint
2025-11-01 12:01:32 -07:00
c59a0c9681
[Feat] UI - Allow setting cache settings on UI ( #16143 )
...
* add LiteLLM_CacheConfig
* add CacheSettingsField
* add UI cache saver
* feat add cache_settings_router
* fix schema
* fix ssl_check_hostname
* refactor into utils
* add groups for field names
* add test_connection in base cache
* add test_connection inredis and redis cluster
* feat _decrypt_db_variables
* add cache settings endpoints
* test_test_cache_connection_calls_cache_test_connection_with_params
* fix: add switch_on_llm_response_caching
* feat use CacheSettingsManager
* feat use CacheSettingsManager
* TestCacheSettingsManager
* fix update_config
* Cache Field test
2025-10-31 17:43:59 -07:00
720ba865fb
[Infra] Litellm Backend SSO Changes ( #16029 )
...
* SSO Backend changes
* Encrypt and Decrypt, load into os env
* Linting and addressing comments
2025-10-30 14:32:08 -07:00
d8ea1665c7
[Feat] - [Backend] Search APIs - Allow storing configured Search APIs in DB ( #15862 )
...
* add LiteLLM_SearchToolsTable
* init SearchToolRegistry
* fix add SearchToolRegistry
* fix add SearchToolRegistry
* fix handling search tool management
* fix search imports
* fix registry
* init search tools in memory
* fix init tools in mem
* fix TypedDict def
* add new SCHEMA
* bump proxy extras
* add LiteLLM_SearchToolsTable_search_tool_name_key
* bump extras with migration
* fix working CRUD Ops
* fix: _init_search_tools_in_db
2025-10-23 17:57:49 -07:00
527c8f59fa
[Feat] Tag Management - Add support for setting tag based budgets ( #15433 )
...
* feat: add LiteLLM_TagTable
* fix: use new table for tag management
* fix - allow setting budgets for tags
* working tag creation
* fix schema.prisma
* add tag info
* ui fixes
* ui fix tag info
* TAG_CACHE_IN_MEMORY_TTL_SECONDS
* add Litellm_EntityType
* fix get_aggregated_db_spend_update_transactions
* fix: _update_entity_spend_in_db
* fix _tag_max_budget_check
* add tag budget check
* add tag_list_transactions
* test_get_tag_objects_batch
* test_update_tag_db_without_prisma_client
* fix get_tags_from_request_body
* get_tags_from_request_body
* fix get_tags_from_request_body
* fix spend tracking utils
* get_tags_from_request_body
* test_get_tags_from_request_body_with_metadata_tags
* feat: add _update_tag_cache spend tracking
* fix _PROXY_track_cost_callback
* test_tag_cache_update_multiple_tags
* fix tag info
* docs fix
* docs tag budgets
* doc fix
* docs fix
* fix tag budget
* docs tag budgets
* docs fix
* ruff fix
2025-10-10 19:24:50 -07:00
930f88078e
[MCP Gateway] Backend - Allow storing allowed tools by team/key ( #15243 )
...
* add mcp_tool_permissions column to LiteLLM_ObjectPermissionTable
* add mcp_tool_permissions
* add LiteLLM_ObjectPermissionTable
* test key/team mgmt
* fix code QA check
* fix check_tool_permission_for_key_team
* test_key_tool_permission_allows_permitted_tool
* test_list_tools_filters_by_key_team_permissions
* fix _get_tools_from_mcp_servers
* fix logger.debug
* fix check_tool_permission_for_key_team
* fix: filter_tools_by_key_team_permissions
* fix _get_team_object_permission
* fix _set_object_permission
* fix handle_update_object_permission_common
* fix add allowed tools to keys
* test add key/team level tool permissions for MCPs
2025-10-06 18:49:32 -07:00
39cac8e58a
build(ui/): show updated schema.prisma
2025-10-03 19:07:50 -07:00
d36c8d6bbe
[Feat] MCP Gateway Fine-grained Tools Addition ( #15153 )
...
* feat: UI to add specific tools under creating MCP connection
* chore: pydantic + prisma changes
* feat: adding specific MCP tools now works
* fix: allowed tools filtering
* chore: filtered list to mcp server cost config
* chore: update Readme
* chore: refactor the filtering
* test: Added tests
When the allowed_tests is null, empty list or populated
* chore: resolve the proxy issue
* feat: updating MCP tool filtering
2025-10-03 10:16:29 -07:00
628cd13755
[Feat] UI - Allow scheduling key rotations when creating virtual keys ( #14960 )
...
* fix design of key reset interval
* fix: LiteLLM_VerificationToken
* fix key manager
* add key_rotation_at
* ui fix
* fix ui view
* set key_rotation_at on creation
* add key_rotation_at
* fix info
* fix: _set_key_rotation_fields
* fix KeyRotationManager
* fix key edit view
* test_update_key_fn_auto_rotate_enable
* fix KeyRotationManager
2025-09-26 16:24:40 -07:00
ea8d0bb7d5
fix: re-add scheduled rotations
2025-09-26 11:40:46 -07:00
b1e56c55ad
merge
2025-09-24 22:11:37 -07:00
ded823a3a3
[Feat] Initial support for scheduled key rotations ( #14877 )
...
* add KeyRotationSettings
* add KeyRotationManager
* add key rotation manager
* add KeyRotationManager
* fix _initialize_spend_tracking_background_jobs
* fix add_key_rotation_fields
* fixes
* new fields in schema
* update schema
* fix fixes for init key rotation manager
* fixes for init key rotation manager
* fix KeyRotationManager
* tests for key rotation
* fix key_rotation_settings
* fix KeyRotationManager
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix fixes for init key rotation manager
* ruff check fix
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix _initialize_spend_tracking_background_jobs
* docs fix
* docs auto rotate
* schema fix
* bump proxy extras
* fix config.yml
2025-09-24 21:37:56 -07:00
654f1d3290
fix: stop including spec_version in MCP server registration inserts
2025-09-19 07:06:15 +09:00
3119064e94
Prompt Management - add prompts on UI ( #13240 )
...
* fix(create_key_button.tsx): add prompts on UI
* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`
* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx
* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users
prevent accidental clicking
* fix(create_key_button.tsx): disable premium features behind flag, prevent errors
* feat(prompts.tsx): add new ui component to view created prompts
enables viewing prompts created on config
* feat(prompt_info.tsx): add component for viewing the prompt information
* feat(prompt_endpoints.py): support converting dotprompt to json structure + accept json structure in promptmanager
allows prompt manager to work with api endpoints
* test(test_prompt_manager.py): add unit tests for json data input
* feat(dotprompt/__init__.py): add prompt data to dotpromptmanager
* fix(prompt_endpoints.py): working crud endpoints for prompt management
* feat(prompts/): support `prompt_file` for dotprompt
allows to precisely point to the prompt file a prompt should use
* feat(proxy/utils.py): resolve prompt id correctly
resolves user sent prompt id with internal prompt id
* feat(schema.prisma): initial pr with db schema for prompt management table
allows post endpoints to work with backend
* feat(prompt_endpoints.py): use db in patch_prompt endpoint
* feat(prompt_endpoints.py): use db for update_prompt endpoint
* feat(prompt_endpoints.py): use db on prompt delete endpoint
* build(schema.prisma): add prompt tale to schema.prisma in litellm-proxy-extras
* build(migration.sql): add new sql migration file
* fix(init_prompts.py): fix init
* feat(prompt_info_view.tsx): show the raw prompt template on ui
allows developer to know the prompt template they'll be calling
* feat(add_prompt_form.tsx): working ui add prompt flow
allows user to add prompts to litellm via ui
* build(ui/): styling fixes
* build(ui/): prompts.tsx
styling improvements
* fix(add_prompt_form.tsx): styling improvements
* build(prompts.tsx): styling improvements
* build(ui/): styling improvements
* build(ui/): fix ui error
* fix: fix ruff check
* docs: document new api params
* test: update tests
2025-08-02 22:33:37 -07:00
e324f76859
[MCP Gateway] add health check endpoints for MCP ( #13106 )
...
* add health check endpoints for MCP
* add import
* Clean up endpopints
* fix ruff
2025-07-30 20:40:44 +05:30
10595ea077
[MCP Gateway] add Litellm mcp alias for prefixing ( #12994 )
...
* change alias-> server_name
* add server alias uses
* add tests
* schema
* ruff fix
* fix alias for config
* fix tests
* add alias
* fix tests
* fix tests
* add a common util
* ruff fix
* fix migration
2025-07-25 17:57:52 -07:00
3051a9c68a
[Bug Fix] QA - Use PG Vector Vector Store with LiteLLM ( #12716 )
...
* store in generic litellm params
* handle storing litellm_params_json
* add litellm_params
* update file loc
* fix startup issue
* ui fix litellm_params
* fix typing
* fix adding PG Vector
* use litellm params
* fix transform_search_vector_store_request
* fix transform
* fix URL
* test fix
* test_pg_vector_search_request_construction
2025-07-18 08:41:18 -07:00
bccbe921e4
build - sync all schema.prisma files
2025-07-11 20:25:26 -07:00
Ishaan Jaffer