litellm/tests at 609e1e97638698fe8a7948e4199443f30076ceda - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 00:23:01 +00:00

Files

T

History

ryan-crabbe-berriandGitHub 1cce49b9d0 fix(vector-stores): support engines URL for Vertex AI Search (#27885 )

Adds optional vertex_engine_id field to vertex_ai/search_api so users
can route through a Discovery Engine search app instead of the data
store directly. Required for website, healthcare, and connector-based
data stores that return FAILED_PRECONDITION on the existing dataStores
URL. Existing data-store-direct callers are unaffected.

Resolves LIT-3036

2026-06-01 16:39:40 -07:00

..

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

basic_proxy_startup_tests

…

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

…

code_coverage_tests

bump deps (#29208 ) (#29226 )

2026-05-28 16:48:14 -07:00

documentation_tests

…

fix(bedrock): support tool search results + chat annotations (#29120 )

2026-05-29 20:48:36 -07:00

guardrails_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

image_gen_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

CI: copy of #25177 (OCI GenAI: embeddings, streaming/reasoning fixes, model catalog) (#28223 )

2026-05-23 12:15:41 -07:00

feat(a2a): well-known agent-card discovery + LangGraph Platform mode (#28860 )

2026-05-29 20:50:42 -07:00

litellm_core_utils

…

litellm_utils_tests

fix(reset_budget): write only {spend, budget_reset_at} and stop pre-zeroing counter (#29358 )

2026-05-30 17:48:16 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

test(responses): bump deprecated gemini-3-pro-preview to gemini-3.1-pro-preview (#29433 )

2026-06-01 09:54:30 -07:00

llm_translation

fix(proxy): enforce allowed_passthrough_routes for auth=true pass-thr… (#29256 )

2026-05-30 17:07:24 -07:00

…

fix(proxy): enforce allowed_passthrough_routes for auth=true pass-thr… (#29256 )

2026-05-30 17:07:24 -07:00

logging_callback_tests

fix(ci): make litellm_internal_staging green (logging test + Bedrock Opus 4.7 self-heal) (#29344 )

2026-05-30 13:57:18 -07:00

fix(mcp): preserve source_url in GET /v1/mcp/server list responses (#29249 )

2026-05-30 12:01:22 -07:00

multi_instance_e2e_tests

…

fix(tests/vcr): make Redis cassette cache replay deterministically (zero VCR misses on consecutive runs) (#28826 )

2026-05-26 11:30:44 -07:00

old_proxy_tests/tests

…

openai_endpoints_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

feat(prometheus): add user_email and user_alias to user budget metrics (#28155 )

2026-05-18 16:28:14 -07:00

pass_through_tests

chore(deps): bump deps (#28528 )

2026-05-22 00:42:21 +00:00

pass_through_unit_tests

feat(pass_through): extend passthrough_managed_object_ids to Azure (#29160 )

2026-05-30 16:30:10 -07:00

proxy_admin_ui_tests

fix(guardrails): persist disable_global_guardrails on keys (#29233 )

2026-05-28 21:19:04 -07:00

test(proxy): phase-4 payload behavior pinning for tier-2/3 key + team management endpoints (#28681 )

2026-05-23 12:16:29 -07:00

proxy_e2e_anthropic_messages_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

proxy_security_tests

…

proxy_unit_tests

[internal copy of #29089 ] fix: duplicate claude code traces (#29311 )

2026-05-29 22:23:24 -07:00

router_unit_tests

fix(router): enforce deployment budgets for dynamically added models (#29273 )

2026-05-29 19:43:14 -07:00

…

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

spend_tracking_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

store_model_in_db_tests

…

fix(vector-stores): support engines URL for Vertex AI Search (#27885 )

2026-06-01 16:39:40 -07:00

unified_google_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

vector_store_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

…

__init__.py

…

_flush_vcr_cache.py

…

_vcr_conftest_common.py

fix(tests/vcr): mint Google OAuth tokens live to prevent stale-token replay (#29229 )

2026-05-28 17:12:02 -07:00

_vcr_redis_persister.py

fix(tests/vcr): make Redis cassette cache replay deterministically (zero VCR misses on consecutive runs) (#28826 )

2026-05-26 11:30:44 -07:00

eval_swe_bench.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

test(callbacks): harden flaky proxy callback-leak detector (#28195 )

2026-05-18 16:39:02 -07:00

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

…

test_end_users.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

…

test_health.py

fix(tests): swap dall-e to gpt-image-1 after openai deprecation

2026-05-12 16:55:18 -07:00

test_keys.py

fix(tests): swap dall-e to gpt-image-1 after openai deprecation

2026-05-12 16:55:18 -07:00

test_litellm_proxy_responses_config.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_logging.conf

…

test_models.py

…

test_new_vector_store_endpoints.py

…

test_openai_endpoints.py

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team_logging.py

…

test_team_members.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team.py

…

test_users.py

Fix: tag budget reset must drop stale management-cache entry (#27568 )

2026-05-10 00:18:55 +00:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.