tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-13 03:05:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3f953dfa9622942e6d8caebf47066f66911ca539
litellm/tests
T
History
yuneng-jiang 3f953dfa96 test(vertex_ai): tolerate transient 500 in google maps grounding test (#28503) 
test_gemini_google_maps_tool_simple makes live calls to Vertex AI's
Google Maps grounding backend, which intermittently returns
500 INTERNAL ("Please retry") — a transient Google-side failure, not a
LiteLLM bug. The request LiteLLM emits matches Google's published
googleMaps grounding spec field-for-field, and the maps-platform 500
only occurs after Vertex accepts the request.

The test already passes on RateLimitError; treat InternalServerError
the same way so transient Vertex-side failures don't fail CI.
2026-05-21 17:01:49 -07:00
..
agent_tests
…
audio_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
basic_proxy_startup_tests
…
batches_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
benchmarks
…
code_coverage_tests
feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)
2026-05-16 09:25:17 -07:00
documentation_tests
…
enterprise
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
guardrails_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
image_gen_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm
Add new chat model metadata (#27313)
2026-05-06 15:15:21 -07:00
litellm_core_utils
…
litellm_utils_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm-proxy-extras
…
llm_responses_api_testing
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
llm_translation
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
load_tests
…
local_testing
test(vertex_ai): tolerate transient 500 in google maps grounding test (#28503)
2026-05-21 17:01:49 -07:00
logging_callback_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
mcp_tests
fix(mcp): JWT on tools/list and REST tools/call server resolution (#28227)
2026-05-20 13:31:44 -07:00
multi_instance_e2e_tests
…
ocr_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
old_proxy_tests/tests
…
openai_endpoints_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
otel_tests
feat(prometheus): add user_email and user_alias to user budget metrics (#28155)
2026-05-18 16:28:14 -07:00
pass_through_tests
chore(deps): refresh dependency locks
2026-05-04 11:36:18 -07:00
pass_through_unit_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
proxy_admin_ui_tests
chore(deps): refresh dependency locks
2026-05-04 11:36:18 -07:00
proxy_behavior
test(proxy): behavior-pinning matrix for team management endpoints (#28441)
2026-05-21 16:57:25 -07:00
proxy_e2e_anthropic_messages_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
proxy_security_tests
…
proxy_unit_tests
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
router_unit_tests
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
scim_tests
…
search_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
spend_tracking_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
store_model_in_db_tests
…
test_litellm
feat: add guardrail violation span attributes and fix missing spans on pre-call blocks (#28364)
2026-05-21 15:49:42 -07:00
unified_google_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
vector_store_tests
…
windows_tests
…
__init__.py
…
_flush_vcr_cache.py
tests(vcr): isolate cassette redis to CASSETTE_REDIS_URL
2026-05-01 12:32:59 -07:00
_vcr_conftest_common.py
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
_vcr_redis_persister.py
fix(caching): replay openai/responses bridge cache hits as chat streams (#28158)
2026-05-18 16:27:06 -07:00
eval_swe_bench.py
…
gettysburg.wav
…
large_text.py
…
openai_batch_completions.jsonl
…
README.MD
…
test_budget_management.py
…
test_callbacks_on_proxy.py
test(callbacks): harden flaky proxy callback-leak detector (#28195)
2026-05-18 16:39:02 -07:00
test_config.py
…
test_debug_warning.py
…
test_default_encoding_non_root.py
…
test_end_users.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_entrypoint.py
…
test_fallbacks.py
…
test_gpt5_azure_temperature_support.py
…
test_health.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_keys.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_litellm_proxy_responses_config.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_logging.conf
…
test_models.py
…
test_new_vector_store_endpoints.py
…
test_openai_endpoints.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_organizations.py
…
test_otel_thread_leak.py
…
test_passthrough_endpoints.py
…
test_presidio_latency.py
…
test_proxy_server_non_root.py
…
test_ratelimit.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_resource_cleanup.py
…
test_service_logger_otel.py
…
test_spend_logs.py
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
test_team_logging.py
…
test_team_members.py
Litellm oss staging 04 21 2026 2 (#26569)
2026-05-20 21:25:19 -07:00
test_team.py
…
test_users.py
Fix: tag budget reset must drop stale management-cache entry (#27568)
2026-05-10 00:18:55 +00:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink