litellm/tests at fcabf9b602ade7a6986c46b360c2aa67b30fe27e - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-21 14:19:03 +00:00

Files

T

History

Julio Quinteros ProandClaude Sonnet 4.5 fcabf9b602 fix(bedrock): filter internal json_tool_call when mixed with real tools

Fixes #18381: When using both tools and response_format with Bedrock
Converse API, LiteLLM internally adds json_tool_call to handle structured
output. Bedrock may return both this internal tool AND real user-defined
tools, breaking consumers like OpenAI Agents SDK.

Changes:
- Non-streaming: Added _filter_json_mode_tools() to handle 3 scenarios:
  only json_tool_call (convert to content), mixed (filter it out), or
  no json_tool_call (pass through)
- Streaming: Added json_mode tracking to AWSEventStreamDecoder to suppress
  json_tool_call chunks and convert to text content
- Fixed optional_params.pop() mutation issue

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

2026-02-28 00:18:56 -03:00

..

…

…

basic_proxy_startup_tests

…

fix(tests): fix flaky test_create_vertex_fine_tune_jobs_mocked - handle background Datadog flush (#21838 )

2026-02-21 14:44:01 -08:00

code_coverage_tests

Revert "[Feature] Add /public/supported_endpoints endpoint"

2026-02-26 17:21:43 -08:00

documentation_tests

fix failing tests

2026-02-21 15:48:26 -08:00

remove orphan comment from test file

2026-02-26 16:51:18 -08:00

guardrails_tests

Fix test_standard_logging_payload_includes_guardrail_information

2026-02-26 12:13:26 +05:30

image_gen_tests

[Release - 02/10/2026] v1.81.10-nightly

2026-02-10 16:26:30 -08:00

docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway (#21130 )

2026-02-27 17:24:48 -08:00

litellm_core_utils

…

litellm_utils_tests

Fix test_perform_health_check_filters_by_model_id

2026-02-26 10:43:05 +05:30

litellm-proxy-extras

…

llm_responses_api_testing

Fix anthropic responses

2026-02-20 17:30:42 -08:00

llm_translation

Preserve forwarding server side called tools

2026-02-27 11:31:45 +05:30

…

Restore

2026-02-26 13:31:37 -08:00

logging_callback_tests

Merge pull request #22180 from BerriAI/litellm_fix_vllm_test

2026-02-26 18:43:52 +05:30

[Fix] Pass MCP auth headers from request into tool fetch for /v1/responses and chat completions (#22291 )

2026-02-27 19:15:51 -08:00

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

…

…

pass_through_tests

FIx: replace deprecated claude-3-7-sonnet-20250219 with claude-4-sonnet-20250514

2026-02-20 17:27:59 -08:00

pass_through_unit_tests

Fix test_pass_through_request_logging_failure

2026-02-26 10:50:05 +05:30

proxy_admin_ui_tests

security: fix critical/high CVEs in OS-level libs and NPM transitive

2026-02-24 19:40:09 +05:30

proxy_e2e_anthropic_messages_tests

Fix: litellm/tests/llm_responses_api_testing/test_anthropic_responses_api.py

2026-02-20 17:30:53 -08:00

proxy_security_tests

…

proxy_unit_tests

fix: populate user_id and user_info for admin users in /user/info (#22239 )

2026-02-27 19:12:16 -08:00

router_unit_tests

Merge pull request #20593 from ryan-crabbe/perf/reuse-litellm-params

2026-02-21 12:11:02 -08:00

…

Add duckcukgo in model map

2026-02-18 16:13:20 +05:30

spend_tracking_tests

…

store_model_in_db_tests

…

fix(bedrock): filter internal json_tool_call when mixed with real tools

2026-02-28 00:18:56 -03:00

unified_google_tests

…

vector_store_tests

Add support for vertex ai for rag/ingest

2026-02-13 20:11:10 +05:30

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

…

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

…

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

…

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

fix(test): skip 'projects' field in team update assertion (#21777 )

2026-02-21 10:24:53 -08:00

test_users.py

fix(tests): update deprecated Anthropic model in test_user_model_access (#21826 )

2026-02-21 14:18:24 -08:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.