Ryan Crabbe 86ec2fbf84 perf(proxy): batch 11 create_task() calls into 1 in update_database() ...

Replace 11 separate asyncio.create_task() calls per request with a
single batched task that runs all spend-update helpers sequentially.
This reduces task scheduling overhead at high RPS (11,000 -> 1,000
tasks/sec at 1K RPS) and cuts 5 copy.deepcopy(payload) calls to 1
shared copy.

Also fixes a mutation bug where the daily agent spend handler received
the raw payload without deepcopy, unlike all other daily helpers.

2026-02-24 10:04:43 -08:00

..

_experimental/mcp_server

Merge pull request #21992 from BerriAI/litellm_fix_oauth_mcp

2026-02-24 19:37:09 +05:30

agent_endpoints

tests

2026-02-13 22:01:28 -08:00

anthropic_endpoints

[Fix] 404 Not Found on /api/event_logging/batch endpoint (#20504)

2026-02-05 10:58:08 -08:00

auth

Revert "fix(vertex_ai): enable context-1m-2025-08-07 beta header (#21870)" (#21876)

2026-02-21 20:12:01 -08:00

client

add a new feature fix to expose the team alias when authenticating th… (#17725)

2025-12-10 10:10:28 -08:00

common_utils

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970)

2026-02-23 21:00:37 -08:00

db

perf(proxy): batch 11 create_task() calls into 1 in update_database()

2026-02-24 10:04:43 -08:00

discovery_endpoints

fix(azure): preserve content_policy_violation error details from Azure OpenAI (#20883)

2026-02-10 22:47:03 -08:00

experimental/mcp_server

…

google_endpoints

fix(proxy): handle agent parameter in /interactions endpoint (#19866)

2026-01-27 09:34:58 -08:00

guardrails

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970)

2026-02-23 21:00:37 -08:00

health_endpoints

fix: resolve flaky test failures in health, spend logs, and CLI tests (#21769)

2026-02-21 10:02:24 -08:00

hooks

fix(tests): isolate flaky tests - restore global state in setup/teardown (#21791)

2026-02-21 11:30:35 -08:00

image_endpoints

fixing core proxy tests

2026-02-12 17:54:32 -08:00

management_endpoints

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970)

2026-02-23 21:00:37 -08:00

management_helpers

[MCP Gateway] Litellm mcp fixes team control (#15304)

2025-10-07 16:48:00 -07:00

middleware

test: add backwards compatibility tests for PrometheusAuthMiddleware

2026-02-21 12:06:31 -08:00

openai_files_endpoint

fix(tests): isolate flaky files endpoint tests from global proxy state (#21788)

2026-02-21 11:20:32 -08:00

pass_through_endpoints

fix(tests): isolate auth in vertex passthrough and spend logs date range tests (#21824)

2026-02-21 14:14:50 -08:00

policy_engine

Guardrail Policy Versioning (#21862)

2026-02-21 20:14:31 -08:00

prompts

fix(prompts): fix prompt info lookup and delete using correct IDs (#19358)

2026-01-20 12:28:34 -08:00

public_endpoints

/public/model_hub health information

2026-01-16 15:36:56 -08:00

rag_endpoints

tests and route permissions (#21508)

2026-02-18 16:58:38 -08:00

response_api_endpoints

Fix x-litellm-key-spend update

2025-12-12 11:44:51 +05:30

spend_tracking

fix(tests): isolate auth in vertex passthrough and spend logs date range tests (#21824)

2026-02-21 14:14:50 -08:00

test_configs

…

ui_crud_endpoints

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970)

2026-02-23 21:00:37 -08:00

vector_store_endpoints

test_delete_vector_store_checks_access

2026-01-31 12:05:09 -08:00

__init__.py

test fix

2025-10-17 10:46:42 -07:00

conftest.py

Add health endpoint tests to CI with database and Redis support (#17877)

2025-12-12 07:35:50 -08:00

test_aiohttp_cleanup_closed.py

fix(aiohttp): only set enable_cleanup_closed when required (#21897)

2026-02-23 21:06:29 -08:00

test_api_key_masking_in_errors.py

fix: mask API keys in error responses for invalid/malformed keys (#20289)

2026-02-12 19:58:05 +05:30

test_batch_metadata_none_fix.py

…

test_caching_routes.py

…

test_chat_completion_metadata.py

fix: propagate JWT auth metadata to OTEL spans (#19627)

2026-01-23 21:21:23 -08:00

test_common_request_processing.py

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970)

2026-02-23 21:00:37 -08:00

test_custom_proxy.py

fix(ui/): fix routing for custom server root path (#15701)

2025-10-23 13:59:29 -07:00

test_empty_model_list.py

Fixing tests and linting

2026-01-21 11:02:39 -08:00

test_enforce_user_param.py

Enforce support of enforce_user_param to openai post endpoints

2025-12-03 12:19:21 +05:30

test_fallback_management_endpoints.py

Add fallback endpoints support

2026-01-16 10:51:33 +05:30

test_fastapi_offline_routes.py

…

test_health_check_functions.py

Add background health checks to db

2025-12-05 14:27:37 +05:30

test_litellm_pre_call_utils.py

Guardrail Policy Versioning (#21862)

2026-02-21 20:14:31 -08:00

test_model_dump_with_preserved_fields.py

fix: address PR review comments for model_dump_with_preserved_fields

2026-02-21 10:48:10 -08:00

test_model_id_header_propagation.py

(fix) propagate x-litellm-model-id in responses (#16986)

2025-11-24 20:40:43 -08:00

test_proxy_cli.py

fix(tests): fix flaky test_use_prisma_db_push_flag_behavior (#21849)

2026-02-21 15:23:55 -08:00

test_proxy_server.py

Merge origin/main into litellm_fix_streaming_connection_pool_leak

2026-02-21 12:44:50 -08:00

test_proxy_types.py

…

test_proxy_utils.py

Fix date overflow/division by zero in proxy utils (#19527)

2026-01-21 21:09:57 -08:00

test_pyroscope.py

Fix CI/CD pyroscope test failure (#21219)

2026-02-14 12:07:20 -08:00

test_response_model_sanitization.py

fix(proxy): prevent provider-prefixed model leaks (#19943)

2026-01-28 22:26:38 -08:00

test_route_a2a_models.py

Fix test_route_a2a_model_bypasses_router

2026-02-05 09:47:05 +05:30

test_route_llm_request.py

Override router settings

2026-01-31 16:04:52 -08:00

test_shared_health_check.py

Add shared healthcheck

2025-10-09 22:18:05 +05:30

test_spend_log_cleanup.py

feat(proxy): cleanup spend logs cron verification, fix, and docs (#19085)

2026-01-14 22:14:48 +05:30

test_swagger_chat_completions.py

fix(tests): isolate flaky tests - restore global state in setup/teardown (#21791)

2026-02-21 11:30:35 -08:00

test_team_member_update.py

…