mirror of https://github.com/tiennm99/litellm.git synced 2026-08-02 06:22:48 +00:00

Files

T

Krish DholakiaandGitHub 26fd6d5362 Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619 )

* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming

2025-12-15 18:19:52 +05:30

a2a_protocol

[Feat] A2A Gateway - allow adding Azure Foundry Agents on UI (#17909 )

2025-12-12 16:38:04 -08:00

caching

fix(redis): handle float redis_version from AWS ElastiCache Valkey (#16207 )

2025-11-04 19:20:00 -08:00

completion_extras

Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619 )

2025-12-15 18:19:52 +05:30

containers

[Fix] Containers API - Allow using LIST, Create Containers using custom-llm-provider (#17740 )

2025-12-09 17:00:35 -08:00

enterprise

Sendgrid integration + bump enterprise package

2025-12-09 19:34:09 -08:00

experimental_mcp_client

refactor: drop MCPClient.connect and use run_with_session lifecycle (#16696 )

2025-11-15 17:54:27 -08:00

google_genai

[Oct Staging Branch] (#15460 )

2025-10-17 17:52:25 -07:00

integrations

[Fix] CI/CD - Fix failing proxy and core integration tests (#17926 )

2025-12-13 10:11:01 -08:00

litellm_core_utils

Fix: Add Gemini context window exception mapping (#17751 )

2025-12-09 18:24:13 -08:00

llms

Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619 )

2025-12-15 18:19:52 +05:30

passthrough

fix test claude-sonnet-4-5-20250929

2025-10-31 18:13:29 -07:00

proxy

Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619 )

2025-12-15 18:19:52 +05:30

responses

[QA] Cursor Integration x LiteLLM (#17855 )

2025-12-13 12:49:45 -08:00

router_strategy

fix: Prevent AttributeError for _get_tags_from_request_kwargs (#14735 )

2025-09-19 15:21:02 -07:00

router_utils

fix(router): handle tools=None in filter_web_search_deployments (#17684 )

2025-12-08 18:36:46 -08:00

secret_managers

[Feat] Add Custom Secret Manager - Allow users to define and write a custom secret manager (#16297 )

2025-11-05 17:20:26 -08:00

types

Gemini models: capture image_tokens and support cost_per_output_image_token in costs calculations (#16912 )

2025-11-21 19:59:24 -08:00

vector_stores

Add vector store support for ragflow

2025-12-03 15:29:47 +05:30

__init__.py

…

conftest.py

Perf speed up pytest (#15951 )

2025-10-27 19:43:40 -07:00

log.txt

fix: fix linting errors

2025-09-27 14:25:05 -07:00

readme.md

…

test_acompletion_session_reuse_e2e.py

[Fix] - Sessions not being shared (#15388 )

2025-10-09 16:57:40 -07:00

test_add_deployment_no_master_key.py

fix: remove strict master_key check in add_deployment (#16453 )

2025-11-10 19:23:13 -08:00

test_aembedding_session_reuse_e2e.py

[Fix] - shared session parsing and usage issue (#15440 )

2025-10-10 19:26:53 -07:00

test_azure_video_router.py

Litellm sameer oct staging (#15806 )

2025-10-24 12:17:22 -07:00

test_claude_haiku_4_5_config.py

fix haiku-4-5 bedrock configs (#16732 )

2025-11-17 19:52:01 -08:00

test_constants.py

tes numeric constants

2025-10-29 18:23:38 -07:00

test_container_router.py

Add E2E Container API Support (#16136 )

2025-11-01 14:03:51 -07:00

test_cost_calculation_log_level.py

…

test_cost_calculator.py

fixed flex tier pricing (#17748 )

2025-12-09 18:10:51 -08:00

test_exception_mapping_request_attribute.py

Added test

2025-09-29 21:43:31 +05:30

test_filter_out_litellm_params.py

[Bug Fix] Exa Search API - ensure request params are sent to Exa AI (#15855 )

2025-10-23 11:56:30 -07:00

test_groq_streaming_encoding.py

…

test_logging.py

…

test_lowest_latency_zero_tokens.py

fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046 )

2025-09-29 15:49:46 -07:00

test_main.py

fix(ocr): add missing ocr and aocr to CallTypes enum (#17435 )

2025-12-03 21:28:13 -08:00

test_nested_drop_params.py

feat: Replace jsonpath-ng with custom minimal parser for additional_drop_params

2025-12-09 17:30:30 +05:30

test_redis.py

fix: Apply max_connections configuration to Redis async client (#15797 )

2025-10-22 09:19:08 -07:00

test_responses_id_security.py

test_encrypt_response_id_success

2025-11-14 17:28:15 -08:00

test_router_google_genai.py

test(gemini): Add unit tests for Google GenAI adapter

2025-09-29 18:51:35 +08:00

test_router.py

Add aws_bedrock_runtime_endpoint into Credential Types (#17053 )

2025-11-24 20:48:51 -08:00

test_shared_session_integration.py

feat: Add shared_session parameter for aiohttp ClientSession reuse

2025-09-19 01:46:53 -07:00

test_system_message_format_bug.py

…

test_utils.py

fix(cache): handle string content in is_cached_message (#17853 )

2025-12-12 03:59:52 -08:00

test_uuid_helper.py

Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941 )

2025-09-26 09:14:20 -07:00

test_video_generation.py

fix: respect videos content db creds

2025-12-10 23:00:01 +05:30

readme.md

Testing for `litellm/`

This directory 1:1 maps the the litellm/ directory, and can only contain mocked tests.

The point of this is to:

Increase test coverage of litellm/
Make it easy for contributors to add tests for the litellm/ package and easily run tests without needing LLM API keys.

File name conventions

litellm/proxy/test_caching_routes.py maps to litellm/proxy/caching_routes.py
test_<filename>.py maps to litellm/<filename>.py

readme.md

Testing for litellm/

File name conventions

Testing for `litellm/`