tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-29 04:20:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
51dff1ff79d4f524b4ba35c3836af16be855289d
litellm/tests
T
History
Cursor AgentandYassin Kortam 51dff1ff79 fix(reasoning_effort_grid_v4): grant sonnet-4-6 entries the max-effort cap 
The runtime _validate_effort_for_model allows effort='max' for any
Claude 4.6 model (opus or sonnet), and model_prices_and_context_window
sets supports_max_reasoning_effort: true for claude-sonnet-4-6. The
grid spec previously gave sonnet-4-6 entries _CAPS_NONE, so expected()
returned status=400 for effort='max', which mismatched the runtime's
status=200 and caused 6 cells (one per route) to fail.

Rename _CAPS_OPUS_4_6 to _CAPS_4_6 (since the cap set is shared by
opus and sonnet 4.6) and assign it to all sonnet-4-6 entries.

Co-authored-by: Yassin Kortam <yassin@berri.ai>
2026-05-16 03:12:20 +00:00
..
agent_tests
…
audio_tests
test(vcr): classify cache verdicts, detect live calls, surface cost leaks
2026-05-13 00:31:47 +00:00
basic_proxy_startup_tests
…
batches_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
benchmarks
…
code_coverage_tests
feat(audio_transcription): add NVIDIA Riva STT provider (#27185)
2026-05-05 17:17:51 -07:00
documentation_tests
…
enterprise
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
guardrails_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
image_gen_tests
Merge pull request #27795 from BerriAI/litellm_vcr-cache-observability-and-fixes-c5bc
2026-05-14 13:51:16 -07:00
litellm
Add new chat model metadata (#27313)
2026-05-06 15:15:21 -07:00
litellm_core_utils
…
litellm_utils_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
litellm-proxy-extras
…
llm_responses_api_testing
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
llm_translation
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
load_tests
…
local_testing
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
logging_callback_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
mcp_tests
feat: litellm shin agent oss staging 05 10 2026 (#27631)
2026-05-11 20:31:43 -07:00
multi_instance_e2e_tests
…
ocr_tests
test(vcr): classify cache verdicts, detect live calls, surface cost leaks
2026-05-13 00:31:47 +00:00
old_proxy_tests/tests
…
openai_endpoints_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
otel_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
pass_through_tests
chore(deps): refresh dependency locks
2026-05-04 11:36:18 -07:00
pass_through_unit_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
proxy_admin_ui_tests
chore(deps): refresh dependency locks
2026-05-04 11:36:18 -07:00
proxy_e2e_anthropic_messages_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
proxy_security_tests
…
proxy_unit_tests
fix(managed_batches): convert raw output_file_id to managed ID in CheckBatchCost poller (#27984)
2026-05-15 04:41:38 -07:00
router_unit_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
scim_tests
…
search_tests
test(vcr): classify cache verdicts, detect live calls, surface cost leaks
2026-05-13 00:31:47 +00:00
spend_tracking_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
store_model_in_db_tests
…
test_litellm
fix(reasoning_effort_grid_v4): grant sonnet-4-6 entries the max-effort cap
2026-05-16 03:12:20 +00:00
unified_google_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
vector_store_tests
fix: drop milvus dbName and partitionNames from MILVUS_OPTIONAL_PARAMS
2026-04-30 11:51:32 -07:00
windows_tests
…
__init__.py
…
_flush_vcr_cache.py
tests(vcr): isolate cassette redis to CASSETTE_REDIS_URL
2026-05-01 12:32:59 -07:00
_vcr_conftest_common.py
fix(vcr): aggregate worker stats on the controller so the session summary actually renders under xdist
2026-05-13 07:24:32 +00:00
_vcr_redis_persister.py
test: add 24hr Redis-backed VCR cache to additional test suites (#27159)
2026-05-05 15:13:31 -07:00
eval_swe_bench.py
…
gettysburg.wav
…
large_text.py
…
openai_batch_completions.jsonl
…
README.MD
…
test_budget_management.py
…
test_callbacks_on_proxy.py
…
test_config.py
…
test_debug_warning.py
…
test_default_encoding_non_root.py
…
test_end_users.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_entrypoint.py
…
test_fallbacks.py
…
test_gpt5_azure_temperature_support.py
…
test_health.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_keys.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_litellm_proxy_responses_config.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_logging.conf
…
test_models.py
…
test_new_vector_store_endpoints.py
…
test_openai_endpoints.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_organizations.py
…
test_otel_thread_leak.py
…
test_passthrough_endpoints.py
…
test_presidio_latency.py
…
test_proxy_server_non_root.py
…
test_ratelimit.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_resource_cleanup.py
…
test_service_logger_otel.py
…
test_spend_logs.py
…
test_team_logging.py
…
test_team_members.py
…
test_team.py
…
test_users.py
Fix: tag budget reset must drop stale management-cache entry (#27568)
2026-05-10 00:18:55 +00:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink