litellm/tests at b651012fdc993f60095e69d3fe849e351edb488e - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-14 03:04:12 +00:00

Files

T

History

Cesar Garcia 1531b58493 feat(openai): add reasoning_effort='xhigh' support for gpt-5.2 models (#17875 )

Add support for the 'xhigh' reasoning effort level on all gpt-5.2 model
variants, not just gpt-5.2-pro. This enables deeper reasoning capabilities
for the base gpt-5.2 model.

Changes:
- Add is_model_gpt_5_2_model() method to detect gpt-5.2 variants
- Update xhigh validation to allow gpt-5.2 models
- Update documentation with gpt-5.2 reasoning_effort support
- Update tests to reflect new behavior

2025-12-12 11:40:35 -08:00

..

[Feat] Agent Gateway - allow adding langgraph, bedrock agent core agents (#17802 )

2025-12-10 19:13:50 -08:00

[Feat] New model/provider - Adds support for Google Cloud Chirp3 HD on /speech (#17391 )

2025-12-02 15:36:23 -08:00

basic_proxy_startup_tests

Fix: remove merge markdown (#17586 )

2025-12-06 05:38:16 -08:00

Fix: apply_guardrail method and improve test isolation (#17555 )

2025-12-05 12:59:35 -08:00

code_coverage_tests

fix: Add _delete_nested_value_custom to recursive function ignore list

2025-12-09 17:56:13 +05:30

documentation_tests

Litellm docs readme fixes (#16107 )

2025-10-30 17:05:32 -07:00

fix(prometheus): add 'exception_status' to prometheus logger (#17847 )

2025-12-12 03:57:46 -08:00

guardrails_tests

Fix Presidio guardrail test TypeError and license base64 decoding error (#17538 )

2025-12-05 08:45:02 -08:00

image_gen_tests

fix

2025-11-26 17:11:33 -08:00

feat(deepseek): add native support for thinking and reasoning_effort params (#17712 )

2025-12-11 15:28:43 -08:00

litellm_utils_tests

Fix flanky tests (#17665 )

2025-12-08 12:21:26 -08:00

litellm-proxy-extras

Fix: Distinguish permission errors from idempotent errors in Prisma migrations (#17064 )

2025-11-24 20:41:44 -08:00

llm_responses_api_testing

test_process_chunk_with_response_completed_event

2025-11-26 11:52:05 -08:00

llm_translation

[Feat] New API Provider - Add Azure AI Foundry Agents on /chat/completions, /responses, /messages + Agent Gateway (#17845 )

2025-12-11 15:21:28 -08:00

…

test_thought_true_with_empty_text_creates_block

2025-12-06 16:00:05 -08:00

logging_callback_tests

feat(langfuse): Add support for custom masking function (#17826 )

2025-12-11 15:36:54 -08:00

Feat/mcp preserve tool metadata calltoolresult (#17561 )

2025-12-05 16:15:22 -08:00

multi_instance_e2e_tests

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

[Feat] Add Azure AI Doc Intelligence OCR (#16219 )

2025-11-03 17:22:19 -08:00

old_proxy_tests/tests

claude-sonnet-4-5-20250929 fix

2025-10-31 18:20:52 -07:00

openai_endpoints_tests

test_e2e_batches_files

2025-11-27 09:14:43 -08:00

Model Armor - Logging guardrail response on llm responses (#16977 )

2025-11-22 15:44:28 -08:00

pass_through_tests

fix: use vllm passthrough config for hosted vllm provider instead of raising error (#16537 )

2025-11-12 09:12:14 -08:00

pass_through_unit_tests

Add cost tracking for streaming in vertex ai

2025-11-20 15:08:38 +05:30

proxy_admin_ui_tests

Fixing e2e

2025-12-05 12:40:58 -08:00

proxy_security_tests

test fix

2025-10-04 10:57:02 -07:00

proxy_unit_tests

[Fix] CI/CD – Clean Up Performance PR Changes & others (#17838 )

2025-12-11 12:50:03 -08:00

router_unit_tests

fix(router): add minimum request threshold for error rate cooldown (#17464 )

2025-12-12 04:36:10 -08:00

…

[Bug Fix]: Search APIs - error in firecrawl-search "Invalid request body" (#16943 )

2025-11-21 14:56:19 -08:00

spend_tracking_tests

fix ocr test

2025-10-31 20:32:03 -07:00

store_model_in_db_tests

test_edit_mcp_server_redacts_credentials

2025-11-26 11:54:11 -08:00

feat(openai): add reasoning_effort='xhigh' support for gpt-5.2 models (#17875 )

2025-12-12 11:40:35 -08:00

unified_google_tests

fix: gooogle GenAI route tests

2025-10-04 10:18:25 -07:00

vector_store_tests

Add vector store support for ragflow

2025-12-03 15:29:47 +05:30

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

[Feat] MCP Gateway Fine-grained Tools Addition (#15153 )

2025-10-03 10:16:29 -07:00

test_budget_management.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_callbacks_on_proxy.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_config.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_debug_warning.py

…

test_end_users.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

Fix: Azure GPT-5 incorrectly routed to O-series config (temperature parameter unsupported) (#16246 )

2025-11-07 10:24:27 -08:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

Add native Responses API support for litellm_proxy provider (#15347 )

2025-10-08 18:31:26 -07:00

test_logging.conf

…

test_models.py

test_add_model_run_health

2025-09-27 10:59:25 -07:00

test_openai_endpoints.py

test fix claude-sonnet-4-5-20250929

2025-10-28 19:05:13 -07:00

test_organizations.py

…

test_passthrough_endpoints.py

fix: update authorization header to use 'Bearer' instead of 'bearer'

2025-09-21 10:44:47 +00:00

test_ratelimit.py

test_async_rate_limit

2025-11-15 10:34:24 -08:00

test_resource_cleanup.py

…

test_spend_logs.py

…

test_team_logging.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_team_members.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

test_team.py

…

test_users.py

fix: use fastuuid helper (#14903 )

2025-09-25 15:47:01 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.