Krish DholakiaandGitHub 26fd6d5362 Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619) ...

* fix(unified_guardrails.py): send all chunks on completion of final stream

* feat(generic_guardrail_api.py): handle tool call response on streaming LLM responses

* fix(anthropic/chat/guardrail_translation): initial commit adding anthropic tool response streaming guardrails

enables guardrail checks on tool response from llm's to work via `/v1/messages`

* feat(anthropic/): working guardrail checks on tool response from LLMs

ensures guardrail checks on anthropic /v1/messages works as expected

* feat(responses/guardrail_translation): support tool call response guardrails on streaming for /v1/responses

ensures complete coverage of tool call responses

* refactor(openai.py): refactor to use consistent pydantic model for responses api tool response on streaming

enables non-openai model tool call response to work correctly with guardrail checks on /v1/responses

* test: update tests

* fix: fix linting error

* fix: fix failing tests

* fix: fix import errors

* fix(openai/chat/guardrail_transformation): fix final chunk returned on streaming

2025-12-15 18:19:52 +05:30

..

_experimental/mcp_server

fix: add MCP auth header propagation

2025-12-15 07:45:35 +09:00

agent_endpoints

Merge pull request #17781 from BerriAI/litellm_daily_agent_table

2025-12-11 15:01:50 -08:00

anthropic_endpoints

test fixes

2025-06-25 18:42:06 -07:00

auth

[Feat] JWT Auth - auth allow selecting team_id from request header (#17884)

2025-12-12 10:18:20 -08:00

client

add a new feature fix to expose the team alias when authenticating th… (#17725)

2025-12-10 10:10:28 -08:00

common_utils

Working setting generic callbacks on UI

2025-12-05 14:37:48 -08:00

db

Merge pull request #16764 from BerriAI/litellm_tag_spend_dedupe

2025-12-11 15:20:16 -08:00

discovery_endpoints

Change is_sso_configured to auto_redirect_to_sso

2025-12-03 15:48:50 -08:00

experimental/mcp_server

…

google_endpoints

fix: Preserve systemInstructions for vertex ai generate content request

2025-12-11 09:52:32 +05:30

guardrails

Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619)

2025-12-15 18:19:52 +05:30

health_endpoints

fix: remove dependency on database and redis from health test (#17880)

2025-12-12 08:21:48 -08:00

hooks

[Fix] CI/CD – Clean Up Performance PR Changes & others (#17838)

2025-12-11 12:50:03 -08:00

image_endpoints

test fix

2025-10-17 10:46:42 -07:00

management_endpoints

async def test_update_team_guardrails_with_org_id():

2025-12-13 16:24:58 -08:00

management_helpers

[MCP Gateway] Litellm mcp fixes team control (#15304)

2025-10-07 16:48:00 -07:00

middleware

…

openai_files_endpoint

Merge pull request #17758 from BerriAI/litellm_managed_files_target_storage

2025-12-12 22:26:34 +05:30

pass_through_endpoints

Guardrails API - support LLM tool call response checks on /chat/completions, /v1/responses, /v1/messages on regular + streaming calls (#17619)

2025-12-15 18:19:52 +05:30

prompts

TestPromptVersionsEndpoint

2025-11-21 16:21:13 -08:00

public_endpoints

Merge remote-tracking branch 'origin' into litellm_add_model_fix_team_admin

2025-11-27 17:32:09 -08:00

response_api_endpoints

Fix x-litellm-key-spend update

2025-12-12 11:44:51 +05:30

spend_tracking

[Fix] CI/CD – Clean Up Performance PR Changes & others (#17838)

2025-12-11 12:50:03 -08:00

test_configs

…

ui_crud_endpoints

Merge pull request #17668 from BerriAI/litellm_sso_config_2

2025-12-11 15:17:33 -08:00

vector_store_endpoints

Fix vector store configuration synchronization failure

2025-12-05 11:46:14 +05:30

__init__.py

test fix

2025-10-17 10:46:42 -07:00

conftest.py

Add health endpoint tests to CI with database and Redis support (#17877)

2025-12-12 07:35:50 -08:00

test_batch_metadata_none_fix.py

Fix issue #13995: Handle None metadata in batch requests (#13996)

2025-08-27 14:51:09 -07:00

test_caching_routes.py

[Bug Fix] Ensure /redis/info works on GCP Redis (#11732)

2025-06-14 15:35:09 -07:00

test_common_request_processing.py

Fix x-litellm-key-spend update

2025-12-12 11:44:51 +05:30

test_custom_proxy.py

fix(ui/): fix routing for custom server root path (#15701)

2025-10-23 13:59:29 -07:00

test_enforce_user_param.py

Enforce support of enforce_user_param to openai post endpoints

2025-12-03 12:19:21 +05:30

test_fastapi_offline_routes.py

[Bug Fix] - Get Routes (#13466)

2025-08-09 12:52:23 -07:00

test_health_check_functions.py

Add background health checks to db

2025-12-05 14:27:37 +05:30

test_litellm_pre_call_utils.py

Fix key model alias (#16896)

2025-11-20 16:05:49 -08:00

test_model_id_header_propagation.py

(fix) propagate x-litellm-model-id in responses (#16986)

2025-11-24 20:40:43 -08:00

test_proxy_cli.py

feature/add max requests env var

2025-09-28 19:18:56 +01:00

test_proxy_server.py

fix: MCP OAuth callback routing and URL handling (#17789)

2025-12-11 08:22:59 -08:00

test_proxy_types.py

Litellm dev 06 06 2025 p1 (#11496)

2025-06-07 09:12:16 -07:00

test_proxy_utils.py

fix(ui/): fix routing for custom server root path (#15701)

2025-10-23 13:59:29 -07:00

test_route_llm_request.py

Fix create, search vector store error (#13285)

2025-08-06 11:15:17 -07:00

test_shared_health_check.py

Add shared healthcheck

2025-10-09 22:18:05 +05:30

test_spend_log_cleanup.py

Fix/gemini api key environment variable support (#12507)

2025-07-29 15:56:01 -07:00

test_swagger_chat_completions.py

[Bug Fix] Allow using Swagger for /chat/completions (#13469)

2025-08-09 15:35:45 -07:00

test_team_member_update.py

fix mapped tests (#12320)

2025-07-04 10:04:43 -07:00