mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 18:16:34 +00:00

Files

T

Ryan Crabbe 86ec2fbf84 perf(proxy): batch 11 create_task() calls into 1 in update_database()

Replace 11 separate asyncio.create_task() calls per request with a
single batched task that runs all spend-update helpers sequentially.
This reduces task scheduling overhead at high RPS (11,000 -> 1,000
tasks/sec at 1K RPS) and cuts 5 copy.deepcopy(payload) calls to 1
shared copy.

Also fixes a mutation bug where the daily agent spend handler received
the raw payload without deepcopy, unlike all other daily helpers.

2026-02-24 10:04:43 -08:00

a2a_protocol

[Fix] A2a Agent Gateway Fixes - A2A agents deployed with localhost/internal URLs in their agent cards (e.g., http://0.0.0.0:8001/) (#20604 )

2026-02-06 15:02:34 -08:00

anthropic_interface/exceptions

…

caching

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

completion_extras

fix(responses-api): return finish_reason='tool_calls' when response.completed contains function_call items (#19745 )

2026-02-16 09:19:57 -08:00

containers

fix: add missing OpenAI chat completion params to OPENAI_CHAT_COMPLETION_PARAMS (#21360 )

2026-02-16 20:31:21 -08:00

enterprise

Fixes based on greptile reviews

2026-02-18 12:19:11 +05:30

expected_responses_api_request

[Feat] Adds support for server-side compaction on the OpenAI Responses API context_management (#21058 )

2026-02-12 10:00:30 -08:00

experimental_mcp_client

fix: FLAKY tests

2026-01-24 11:13:44 -08:00

google_genai

litellm_fix_mapped_tests_core: fix test isolation and mock injection issues (#20209 )

2026-01-31 17:53:54 -08:00

images

…

integrations

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

interactions

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

litellm_core_utils

feat(realtime): guardrail hook for voice transcription (#21976 )

2026-02-23 21:04:40 -08:00

llms

fix(bedrock): pass timeout param to bedrock rerank http client (#22021 )

2026-02-24 09:32:11 -08:00

passthrough

…

proxy

perf(proxy): batch 11 create_task() calls into 1 in update_database()

2026-02-24 10:04:43 -08:00

responses

fix(test): add timeout to flush() call to prevent 300s hang in CI (#21819 )

2026-02-21 14:10:57 -08:00

router_strategy

test(router): add coverage tests for _is_complexity_router_deployment and init_complexity_router_deployment (#21848 )

2026-02-21 15:21:10 -08:00

router_utils

feat: add session_id to have better routing

2026-02-21 18:45:50 +05:30

secret_managers

fix(tests): isolate flaky files endpoint tests from global proxy state (#21788 )

2026-02-21 11:20:32 -08:00

test_router

Revert "Merge pull request #21957 from jquinter/fix/flaky-rpm-limit-test"

2026-02-24 09:52:50 -03:00

types

Add pipeline flow builder UI for guardrail policies (#21188 )

2026-02-13 20:06:03 -08:00

vector_stores

litellm_fix_mapped_tests_core: fix test isolation and mock injection issues (#20209 )

2026-01-31 17:53:54 -08:00

__init__.py

…

conftest.py

fix(tests): restore disable_aiohttp_transport and force_ipv4 in isolate_litellm_state

2026-02-17 21:18:49 -03:00

log.txt

…

readme.md

…

test_a2a_registry_lookup.py

[Feat] Use A2A registered agents with /chat/completions (#20362 )

2026-02-03 15:25:38 -08:00

test_acompletion_session_reuse_e2e.py

…

test_add_deployment_no_master_key.py

…

test_aembedding_session_reuse_e2e.py

…

test_anthropic_beta_headers_filtering.py

Make tests run with local beta header mapping json

2026-02-13 22:31:42 +05:30

test_azure_video_router.py

…

test_claude_haiku_4_5_config.py

…

test_claude_opus_4_6_config.py

Fix au.anthropic.claude opus 4 6 v1 (#20731 )

2026-02-16 14:15:37 -08:00

test_constants.py

[Release - 02/10/2026] v1.81.10-nightly

2026-02-10 16:26:30 -08:00

test_container_router.py

…

test_cost_calculation_log_level.py

fix(tests): use record.getMessage() instead of record.message for LogRecord

2026-02-18 11:46:32 -03:00

test_cost_calculator.py

perf: optimize completion_cost() — eliminate enum overhead, reduce function call indirection

2026-02-21 12:14:55 -08:00

test_deepseek_model_metadata.py

fix(model-info): sync DeepSeek model metadata and add bare-name fallback (#20885 )

2026-02-11 12:48:10 +05:30

test_eager_tiktoken_load.py

fix(main): use local tiktoken cache in lazy loading (#19774 )

2026-01-27 18:16:58 -08:00

test_exception_exports.py

fix: export PermissionDeniedError from litellm.__init__

2026-02-11 13:39:19 +01:00

test_exception_header_preservation.py

…

test_exception_mapping_request_attribute.py

…

test_filter_out_litellm_params.py

…

test_get_blog_posts.py

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

test_gpt_image_cost_calculator.py

Fix gpt-image-1.5 cost calculation not including output image tokens (#19515 )

2026-01-22 19:42:15 -08:00

test_groq_streaming_encoding.py

…

test_lazy_imports.py

…

test_logging.py

fix:Parse embedded JSON in the message field of logs (#20366 )

2026-02-10 16:13:33 +05:30

test_lowest_latency_zero_tokens.py

…

test_main.py

Fix : test_video_content_handler_uses_get_for_openai

2026-02-17 20:06:08 +05:30

test_model_param_helper.py

perf: cache _get_relevant_args_to_use_for_logging() at module level (#20077 )

2026-02-02 10:54:49 -08:00

test_model_response_normalization.py

…

test_nested_drop_params.py

…

test_redis.py

…

test_responses_api_bridge_non_stream.py

fix: Pydantic will fail to parse it because cached_tokens is required but not provided

2026-01-28 11:51:26 +05:30

test_responses_id_security.py

…

test_router_google_genai.py

…

test_router_model_cost_isolation.py

[Fix] prevent shared backend model key from being polluted by per-deployment custom pricing (#20679 )

2026-02-09 19:38:44 -08:00

test_router_per_deployment_num_retries.py

Bugfix/19481 num retries env var type (#19507 )

2026-01-22 19:39:58 -08:00

test_router_redis_init.py

fix: handle deprecated 'redis_db' arg to prevent crash (#19808 )

2026-02-02 18:18:05 +05:30

test_router_silent_experiment.py

litellm_fix(test): fix router silent experiment tests to properly mock async functions (#20140 )

2026-01-31 07:39:05 -08:00

test_router.py

Merge pull request #20374 from ryan-crabbe/perf/cache-access-groups

2026-02-21 12:25:45 -08:00

test_service_logger.py

fix(proxy): fix master key rotation Prisma validation errors (#21330 )

2026-02-16 15:13:05 -08:00

test_shared_session_integration.py

…

test_ssl_verify_unit.py

BUMP Enterprise PIP

2026-02-14 13:40:48 -08:00

test_streaming_connection_cleanup.py

fix: add debug logging to stream cleanup, improve tests

2026-02-14 17:31:39 -08:00

test_system_message_format_bug.py

…

test_utils.py

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

test_uuid_helper.py

…

test_video_generation.py

fix(ollama): thread api_base to get_model_info + graceful fallback (#21970 )

2026-02-23 21:00:37 -08:00

test_xai_responses_auto_routing.py

Add routing of xai chat completions to responses when web search options is present

2026-01-30 14:15:35 +05:30

readme.md

Testing for `litellm/`

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

Increase test coverage of litellm/
Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
test_<filename>.py maps to litellm/<filename>.py

readme.md

Testing for litellm/

File name conventions

Testing for `litellm/`