litellm

_experimental/mcp_server

feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482 )

2026-06-02 12:52:10 -07:00

a2a

feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860 )

2026-05-29 20:50:42 -07:00

agent_endpoints

feat(agents): add LangFlow agent provider with A2A session bridging (#28963 )

2026-06-02 14:45:56 -07:00

anthropic_endpoints

test: isolate proxy master_key/prisma_client module globals between tests

2026-04-23 15:31:16 -07:00

auth

fix(auth): preserve 401 status for expired JWTs in OTel traces (#29510 )

2026-06-02 16:33:16 -07:00

client

fix: scope CLI stored token to base_url to prevent cross-domain credential leakage (#26945 )

2026-05-01 12:11:32 -07:00

common_utils

fix(reset_budget): write only {spend, budget_reset_at} and stop pre-zeroing counter (#29358 )

2026-05-30 17:48:16 -07:00

db

feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557 )

2026-05-16 09:25:17 -07:00

discovery_endpoints

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

experimental/mcp_server

…

google_endpoints

Gemini managed agents support (#28270 )

2026-05-19 16:02:03 -07:00

guardrails

Litellm oss staging (#29492 )

2026-06-02 08:48:10 -07:00

health_endpoints

feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439 )

2026-06-02 16:30:44 -07:00

hooks

feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482 )

2026-06-02 12:52:10 -07:00

image_endpoints

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

management_endpoints

feat(proxy): add per-MCP-server RPM rate limiting for keys and teams (#29482 )

2026-06-02 12:52:10 -07:00

management_helpers

feat(mcp/auth): additive key access-group grants + opt-in member assignment (#29313 )

2026-05-30 17:35:31 -07:00

memory

Litellm memory improvements v2 (#26541 )

2026-04-25 19:03:43 -07:00

middleware

fix(proxy): point /metrics 401 at the opt-out flag

2026-05-08 18:09:14 -07:00

openai_files_endpoint

Merge remote-tracking branch 'origin/litellm_internal_staging' into litellm_yj_apr17

2026-04-17 17:36:40 -07:00

pass_through_endpoints

fix: missing span for guardrail passthrough (#29552 )

2026-06-03 01:25:15 +00:00

policy_engine

fix(guardrails): return HTTP 400 for litellm content filter blocks (#28418 )

2026-05-30 14:28:46 -07:00

prompts

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

proxy_server

tests(proxy_server): surface current behavior in tests (#29309 )

2026-05-29 23:17:24 -07:00

public_endpoints

feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860 )

2026-05-29 20:50:42 -07:00

rag_endpoints

fix: harden /key/update authorization checks (#27878 )

2026-05-14 04:16:04 +00:00

realtime_endpoints

test: isolate proxy master_key/prisma_client module globals between tests

2026-04-23 15:31:16 -07:00

response_api_endpoints

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

shutdown

feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439 )

2026-06-02 16:30:44 -07:00

spend_tracking

fix(proxy): strip NUL bytes from spend log payloads to prevent PostgreSQL 22P05 (#29515 )

2026-06-02 12:07:11 -07:00

test_configs

…

types_utils

chore(proxy): also scrub guardrail callbacks / module paths from DB overlay

2026-05-14 01:24:51 +00:00

ui_crud_endpoints

chore(ci): merge dev branch (#28657 )

2026-05-25 13:48:47 -07:00

utils

test(proxy/utils): pin ProxyLogging behavior (#29485 )

2026-06-02 17:45:39 -07:00

vector_store_endpoints

fix(proxy): restrict vector store index create/delete to proxy admins (#29202 )

2026-05-30 15:10:21 -07:00

__init__.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

conftest.py

feat(proxy): native /health/drain preStop hook for graceful shutdown (#29439 )

2026-06-02 16:30:44 -07:00

test_aiohttp_cleanup_closed.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_aiohttp_session_recovery.py

…

test_api_key_masking_in_errors.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_audio_speech_prometheus_hooks.py

…

test_batch_expiry.py

fix(proxy): strip LiteLLM policy tracking from OpenAI batch metadata (#28425 )

2026-05-26 11:35:42 -07:00

test_batch_metadata_none_fix.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_batch_retrieve_bedrock.py

fix(proxy/batches): forward model to retrieve_batch for bedrock

2026-04-29 22:48:03 +02:00

test_budget_reservation.py

fix(proxy): gate image-gen reservation strictly on model mode

2026-05-09 09:16:27 -07:00

test_caching_routes.py

…

test_chat_completion_metadata.py

…

test_common_request_processing.py

perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289 )

2026-05-23 12:15:59 -07:00

test_component_allowlists.py

feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557 )

2026-05-16 09:25:17 -07:00

test_cors_config.py

refactor: extract _get_cors_config() for testability, fix no-op CORS tests

2026-04-11 22:24:04 +05:30

test_custom_proxy.py

…

test_dynamic_mcp_route.py

feat(mcp): support MCP access group names in URL-based namespacing (#27726 )

2026-05-13 20:20:38 -07:00

test_empty_model_list.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_enforce_user_param.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_fallback_management_endpoints.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_fastapi_offline_routes.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_filter_models_by_team_access_group.py

fix: resolve access group names in _filter_models_by_team_id (#25224 )

2026-05-01 11:55:36 +05:30

test_health_check_functions.py

feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716 )

2026-05-13 09:49:05 -07:00

test_health_check_max_tokens.py

Litellm agent oss staging 05 11 2026 (#27733 )

2026-05-13 14:09:12 -07:00

test_langfuse_passthrough_security.py

chore(callbacks): guard dynamic integration hosts

2026-04-30 14:27:19 -07:00

test_lazy_openapi_snapshot.py

[Fix] Tests: Move Misplaced Import in Lazy OpenAPI Snapshot Test

2026-05-01 14:24:53 -07:00

test_litellm_pre_call_utils.py

fix(proxy): enforce tag budgets for key-level tags (#29108 )

2026-05-28 11:39:02 -07:00

test_max_budget_env_var.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_mcp_asgi_response.py

fix(mcp): surface upstream 401 for token-forwarding MCP servers (#27847 )

2026-05-13 12:03:36 -07:00

test_model_dump_with_preserved_fields.py

…

test_model_id_header_propagation.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_model_info_default_limits.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_model_level_guardrails.py

fix(proxy): run model-level post_call guardrails on streaming requests (#26922 )

2026-05-07 11:53:03 -07:00

test_openapi_schema_validation.py

fix(proxy): preserve HTTP operations when injecting WebSocket stubs into OpenAPI schema

2026-05-06 00:28:42 +02:00

test_pricing_field_strip.py

fix(proxy): move pricing strip below the litellm_metadata JSON-string parse

2026-05-03 02:04:05 +00:00

test_prometheus_cleanup.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_provider_url_destination_guard.py

chore(proxy): move URL-valued model/file_id guard from SDK to proxy

2026-05-02 02:17:46 +00:00

test_proxy_cli.py

Add granian as a ASGI compliant web server. Provider better throughput stability, (#26027 )

2026-05-21 19:08:37 -07:00

test_proxy_logging_hook_detection.py

perf: reduce per-request and per-chunk overhead across Anthropic streaming hot paths (#28289 )

2026-05-23 12:15:59 -07:00

test_proxy_server.py

fix(proxy): omit OpenAI [DONE] on google-genai streamGenerateContent (#29426 )

2026-06-01 14:38:19 -07:00

test_proxy_types.py

fix(otel): capture 401 error details in management endpoint spans (#29535 )

2026-06-02 16:40:30 -07:00

test_proxy_utils.py

feat(otel): typed semconv-aligned OpenTelemetry instrumentation (#28909 )

2026-05-29 23:15:27 -07:00

test_pyroscope.py

Implement normalize_nonempty_secret_str function to trim whitespace from secrets and treat empty values as unset. Update proxy_server to use this function for Grafana credentials. Enhance tests to validate the new normalization behavior.

2026-05-04 18:17:31 +00:00

test_redis_auth_cache_flag.py

refactor(proxy): replace DualCache with UserApiKeyCache for user API key management

2026-04-28 19:15:03 +00:00

test_response_model_sanitization.py

perf: eliminate per-request callback scanning on proxy hot path (#27858 )

2026-05-14 09:28:31 -07:00

test_route_a2a_models.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_route_llm_request.py

feat(proxy): fix vector store retrieve/list/update/delete without model (#27929 )

2026-05-15 04:37:59 -07:00

test_sensitive_route_auth.py

chore(proxy): guard sensitive public endpoints

2026-04-30 11:52:47 -07:00

test_shared_health_check.py

feat(proxy): skip disable_background_health_check models on GET /health when flag set (#27716 )

2026-05-13 09:49:05 -07:00

test_spend_log_cleanup.py

fix(proxy): keep spend log cleanup running after batch failures and surface DB errors (#27303 )

2026-05-06 18:39:15 +00:00

test_swagger_chat_completions.py

fix(proxy): avoid misleading multi-method operation ids

2026-04-30 20:44:14 -07:00

test_team_member_update.py

…

test_team_org_move.py

fix(team_endpoints): auto-add SSO team members to org on move (proxy admin only) (#26377 )

2026-04-24 08:36:25 -07:00

test_tools_allowlist_enforcement.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00

test_update_llm_router_resilience.py

style: run black formatter on files from main merge

2026-04-17 13:02:59 -07:00