tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-20 04:18:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
574ee7526db6808be3b2e3649da9a69bd2fb40b6
litellm/tests
T
History
yuneng-jiangandGitHub 574ee7526d test(streaming): tolerate Vertex 429 wrapped in MidStreamFallbackError (#28669) 
Streaming 429s are wrapped in MidStreamFallbackError so the Router can
fall back; the existing 'except litellm.RateLimitError: pass' in
test_vertex_ai_stream no longer matches, causing the generic
pytest.fail branch to fire when upstream Vertex returns 429.

Add a sibling except for MidStreamFallbackError that only swallows it
when e.original_exception is a RateLimitError, so unrelated streaming
failures still fail the test.
2026-05-22 15:57:29 -07:00
..
agent_tests
…
audio_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
basic_proxy_startup_tests
…
batches_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
benchmarks
…
code_coverage_tests
fix(check_licenses): read PEP 639 license-expression metadata (#28529)
2026-05-22 11:22:38 -07:00
documentation_tests
…
enterprise
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
guardrails_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
image_gen_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm
Add new chat model metadata (#27313)
2026-05-06 15:15:21 -07:00
litellm_core_utils
…
litellm_utils_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm-proxy-extras
…
llm_responses_api_testing
fix(responses): use OpenAI SSEDecoder for Responses API streaming (#28566)
2026-05-22 10:03:36 -07:00
llm_translation
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
load_tests
…
local_testing
test(streaming): tolerate Vertex 429 wrapped in MidStreamFallbackError (#28669)
2026-05-22 15:57:29 -07:00
logging_callback_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
mcp_tests
feat(mcp): Add tool call and tool list support via UI for Oauth mcps (#28454)
2026-05-22 09:04:04 -07:00
multi_instance_e2e_tests
…
ocr_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
old_proxy_tests/tests
…
openai_endpoints_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
otel_tests
feat(prometheus): add user_email and user_alias to user budget metrics (#28155)
2026-05-18 16:28:14 -07:00
pass_through_tests
chore(deps): bump deps (#28528)
2026-05-22 00:42:21 +00:00
pass_through_unit_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
proxy_admin_ui_tests
chore(test): remove dead old Playwright e2e suite (#28632)
2026-05-22 11:29:17 -07:00
proxy_behavior
test(proxy): behavior-pinning matrix for tier-2/3 key + team management endpoints (#28620)
2026-05-22 11:24:41 -07:00
proxy_e2e_anthropic_messages_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
proxy_security_tests
…
proxy_unit_tests
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
router_unit_tests
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
scim_tests
…
search_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
spend_tracking_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
store_model_in_db_tests
…
test_litellm
fix(bedrock): decouple STS region from Bedrock aws_region_name (#28245)
2026-05-23 00:39:24 +03:00
unified_google_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
vector_store_tests
…
windows_tests
…
__init__.py
…
_flush_vcr_cache.py
…
_vcr_conftest_common.py
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
_vcr_redis_persister.py
fix(caching): replay openai/responses bridge cache hits as chat streams (#28158)
2026-05-18 16:27:06 -07:00
eval_swe_bench.py
…
gettysburg.wav
…
large_text.py
…
openai_batch_completions.jsonl
…
README.MD
…
test_budget_management.py
…
test_callbacks_on_proxy.py
test(callbacks): harden flaky proxy callback-leak detector (#28195)
2026-05-18 16:39:02 -07:00
test_config.py
…
test_debug_warning.py
…
test_default_encoding_non_root.py
…
test_end_users.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_entrypoint.py
…
test_fallbacks.py
…
test_gpt5_azure_temperature_support.py
…
test_health.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_keys.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_litellm_proxy_responses_config.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_logging.conf
…
test_models.py
…
test_new_vector_store_endpoints.py
…
test_openai_endpoints.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_organizations.py
…
test_otel_thread_leak.py
…
test_passthrough_endpoints.py
…
test_presidio_latency.py
…
test_proxy_server_non_root.py
…
test_ratelimit.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_resource_cleanup.py
…
test_service_logger_otel.py
…
test_spend_logs.py
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
test_team_logging.py
…
test_team_members.py
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
test_team.py
…
test_users.py
Fix: tag budget reset must drop stale management-cache entry (#27568)
2026-05-10 00:18:55 +00:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink