litellm/tests at 40edb16fb9991b326e6e02ddf7ddfcfd03b21091 - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-10 19:04:29 +00:00

Files

T

History

yuneng-jiang 40edb16fb9 Fix test isolation: run eager tiktoken tests in subprocesses

The eager tiktoken tests were clearing all litellm modules from
sys.modules and re-importing, creating new module objects with different
class identities. This broke unittest.mock.patch for all subsequent
tests on the same xdist worker. Running these tests in subprocesses
provides perfect isolation.

Fixes: test_metadata_passed_to_custom_callback_codex_models,
test_oidc_github_success, test_oidc_google_cached,
test_oidc_google_failure,
test_encrypted_content_affinity_bypasses_rpm_limits, and 5 others.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-15 17:32:31 -07:00

..

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

…

basic_proxy_startup_tests

CircleCI test stability (#23055 )

2026-03-07 15:19:39 -08:00

Merge pull request #22625 from BerriAI/litellm_azure_ai_finetune

2026-03-03 19:42:17 +05:30

code_coverage_tests

[Fix] Add max_depth guard to BFL _read_image_bytes recursive function

2026-03-12 13:22:56 -07:00

documentation_tests

fix failing tests

2026-02-21 15:48:26 -08:00

feat: allow multiple calls from tags

2026-03-07 11:24:18 +05:30

guardrails_tests

Optimize CI: parallelize router and guardrails test jobs, fix test isolation

2026-03-14 22:54:44 -07:00

image_gen_tests

fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test

2026-03-12 01:27:42 +00:00

fix(proxy): Windows compatibility for Prisma engine watchdog (#23494 )

2026-03-12 16:02:37 -07:00

litellm_core_utils

…

litellm_utils_tests

fix(tests): remove test_oidc_circle_v1_with_amazon_fips that depends on external infra

2026-03-13 10:33:52 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

Fix anthropic responses

2026-02-20 17:30:42 -08:00

llm_translation

fix(tests): remove test_completion_bedrock_claude_sts_oidc_auth and test_completion_bedrock_httpx_command_r_sts_oidc_auth that depend on external infra

2026-03-13 11:53:53 -07:00

…

Fix flaky test_caching_with_ttl by using distinct mock responses

2026-03-15 17:10:43 -07:00

logging_callback_tests

Merge pull request #23483 from BerriAI/litellm_update_deprecated_test_models

2026-03-12 14:16:52 -07:00

Fix test_get_tools_for_single_server

2026-03-12 18:33:14 +05:30

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

test(responses): add end-to-end test for responses API WebSocket mode

2026-03-02 17:24:39 +05:30

fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test

2026-03-13 00:04:31 -07:00

pass_through_tests

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

pass_through_unit_tests

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

proxy_admin_ui_tests

Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082 )

2026-03-07 18:31:27 -08:00

proxy_e2e_anthropic_messages_tests

Merge branch 'main' into litellm_fix_nova_pro_max_tokens

2026-03-09 15:47:53 -07:00

proxy_e2e_azure_batches_tests

Increase file deletion retry budget to 50s for batch_processed race

2026-03-15 15:39:35 -07:00

proxy_security_tests

…

proxy_unit_tests

Handle response.failed, response.incomplete, and response.cancelled (#23492 )

2026-03-13 23:02:09 -07:00

router_unit_tests

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

…

Merge remote main, resolve conflict keeping new unit tests

2026-03-09 15:20:20 -07:00

spend_tracking_tests

[Fix] Derive SPEND_PER_REQUEST dynamically in spend accuracy tests

2026-03-13 13:27:06 -07:00

store_model_in_db_tests

…

Fix test isolation: run eager tiktoken tests in subprocesses

2026-03-15 17:32:31 -07:00

unified_google_tests

…

vector_store_tests

…

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

fix: tiktoken cache nonroot offline (#23498 )

2026-03-14 10:48:36 -07:00

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check

2026-03-12 13:22:00 -07:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_new_vector_store_endpoints.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

[Fix] Fail fast when team member spend not flushed in time

2026-03-13 12:40:17 -07:00

test_users.py

fix(tests): update deprecated Anthropic model in test_user_model_access (#21826 )

2026-02-21 14:18:24 -08:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.