Krish DholakiaandGitHub 7c392475e6 Control Plane + Data Plane support (#12601) ...

* feat(route_checks.py): allow admin to disable proxy management endpoints on instance

useful for preventing multiple instances from doing admin actions

* docs(scaling_multiple_instances.md): add architecture doc on scaling multiple litellm instances

provide guidance on scaling proxy

* docs(scaling_multiple_instances.md): add doc on scaling across multiple regions for litellm

* fix(route_checks.py): allow disabling llm api endpoints on an instance

allows pure admin instance to exist

* refactor(enterprise/route_checks.py): refactor env var checks

* refactor: finish refactoring

* docs(control_plane_and_data_plane.md): refactor docs

* test: update tests

2025-07-14 21:31:56 -07:00

..

_experimental/mcp_server

[MCP Gateway] Ensure we use the same param for specifying groups (#12561)

2025-07-12 16:41:58 -07:00

anthropic_endpoints

test fixes

2025-06-25 18:42:06 -07:00

auth

Control Plane + Data Plane support (#12601)

2025-07-14 21:31:56 -07:00

client

test fix creds test

2025-07-03 22:01:52 -07:00

common_utils

Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533)

2025-07-12 10:13:07 -07:00

db

build(VLLM-Passthrough-with-loadbalancing-support-(enables-using-model-list-for-VLLM-/classify-endpoint)): Closes #11205

2025-05-31 09:00:04 -07:00

experimental/mcp_server

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

guardrails

[Feat] - New guardrail - OpenAI Moderations API (#12519)

2025-07-11 11:25:45 -07:00

health_endpoints

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

hooks

test_pre_call_hook_team_rpm_limits

2025-07-11 15:52:21 -07:00

image_endpoints

Feat: add add azure endpoint for image endpoints (#11482)

2025-06-06 10:38:37 -07:00

management_endpoints

Team Members - reset budget, if duration set + Prometheus - support tag based metrics (#12534)

2025-07-11 22:54:16 -07:00

management_helpers

[MCP Gateway] access group UI object permission fix (#12523)

2025-07-11 18:25:40 -07:00

middleware

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

openai_files_endpoint

fix(proxy): Add managed_files hook to test_mock_create_audio_file

2025-06-26 10:42:25 -06:00

pass_through_endpoints

[Feat] UI QA: Pass through endpoints (#11939)

2025-06-20 18:35:38 -07:00

spend_tracking

MCP - usage tracking (#12397)

2025-07-08 22:08:16 -07:00

test_configs

Litellm fix GitHub action testing (#11163)

2025-05-26 14:41:42 -07:00

ui_crud_endpoints

Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533)

2025-07-12 10:13:07 -07:00

test_caching_routes.py

[Bug Fix] Ensure /redis/info works on GCP Redis (#11732)

2025-06-14 15:35:09 -07:00

test_common_request_processing.py

[Feat] DD Trace - Add instrumentation for streaming chunks (#11338)

2025-06-02 16:48:39 -07:00

test_custom_proxy.py

Custom Root Path Improvements: don't require reserving /litellm route (#11460)

2025-06-05 16:36:47 -07:00

test_health_check_functions.py

Implement health check backend API and storage functionality - fix ci/cd (#11852)

2025-06-18 06:57:08 -07:00

test_litellm_pre_call_utils.py

[Feat] Add Arize Team Based Logging (#12264)

2025-07-02 17:15:35 -07:00

test_proxy_cli.py

add ciphers in command and pass to hypercorn for proxy (#11916)

2025-06-20 14:45:48 -07:00

test_proxy_server.py

Prevent writing default user setting updates to yaml (error in non-root env) + Use central team member budget when max_budget_in_team set on UI (#12533)

2025-07-12 10:13:07 -07:00

test_proxy_types.py

Litellm dev 06 06 2025 p1 (#11496)

2025-06-07 09:12:16 -07:00

test_proxy_utils.py

[Security Bug Fix] Ensure only LLM API route fails get logged on Langfuse (and other loggers) (#12308)

2025-07-04 14:42:42 -07:00

test_route_llm_request.py

Update mistral 'supports_response_schema' field + Fix ollama embedding (#12024)

2025-06-25 07:20:13 -07:00

test_spend_log_cleanup.py

[Feat] Make batch size for maximum retention in spend logs a controllable parameter (#11459)

2025-06-05 17:11:51 -07:00

test_team_member_update.py

fix mapped tests (#12320)

2025-07-04 10:04:43 -07:00