litellm/tests at cc027a2b904cd83e186d86b4e08eaaa383426d92 - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-06-17 20:48:32 +00:00

Files

T

History

yuneng-jiang cc027a2b90 Fix flaky test_langsmith_queue_logging: poll instead of fixed sleep

The test waited a fixed 3s for async callbacks to populate log_queue.
Under xdist -n 4, CPU contention can delay the GLOBAL_LOGGING_WORKER
background task beyond 3s. Replace fixed sleeps with polling loops
(up to 10s) that break as soon as the expected condition is met.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-15 20:25:11 -07:00

..

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

…

basic_proxy_startup_tests

CircleCI test stability (#23055 )

2026-03-07 15:19:39 -08:00

Fix flaky batch tests: mock vertex auth and skip on DNS failure

2026-03-15 18:37:40 -07:00

code_coverage_tests

[Fix] Add max_depth guard to BFL _read_image_bytes recursive function

2026-03-12 13:22:56 -07:00

documentation_tests

fix failing tests

2026-02-21 15:48:26 -08:00

feat: allow multiple calls from tags

2026-03-07 11:24:18 +05:30

guardrails_tests

Optimize CI: parallelize router and guardrails test jobs, fix test isolation

2026-03-14 22:54:44 -07:00

image_gen_tests

fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test

2026-03-12 01:27:42 +00:00

fix(proxy): Windows compatibility for Prisma engine watchdog (#23494 )

2026-03-12 16:02:37 -07:00

litellm_core_utils

…

litellm_utils_tests

Fix flaky AWS secret manager tests by skipping on ThrottlingException

2026-03-15 18:53:18 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

…

llm_translation

Fix flaky test_gemini_image_generation_async by removing non-deterministic content assertion

2026-03-15 17:58:00 -07:00

…

Fix flaky tests: anthropic error_msg state leak and vertex llama 404

2026-03-15 17:59:25 -07:00

logging_callback_tests

Fix flaky test_langsmith_queue_logging: poll instead of fixed sleep

2026-03-15 20:25:11 -07:00

Fix test_get_tools_for_single_server

2026-03-12 18:33:14 +05:30

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

Fix flaky e2e batch test: set batch_processed=True on completion in retrieve_batch

2026-03-15 18:18:32 -07:00

fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test

2026-03-13 00:04:31 -07:00

pass_through_tests

Fix flaky vertex pass-through spend test by polling instead of fixed sleep

2026-03-15 17:37:53 -07:00

pass_through_unit_tests

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

proxy_admin_ui_tests

Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082 )

2026-03-07 18:31:27 -08:00

proxy_e2e_anthropic_messages_tests

Merge branch 'main' into litellm_fix_nova_pro_max_tokens

2026-03-09 15:47:53 -07:00

proxy_e2e_azure_batches_tests

Increase file deletion retry budget to 50s for batch_processed race

2026-03-15 15:39:35 -07:00

proxy_security_tests

…

proxy_unit_tests

Fix flaky e2e batch test: set batch_processed=True on completion in retrieve_batch

2026-03-15 18:18:32 -07:00

router_unit_tests

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

…

Merge remote main, resolve conflict keeping new unit tests

2026-03-09 15:20:20 -07:00

spend_tracking_tests

[Fix] Derive SPEND_PER_REQUEST dynamically in spend accuracy tests

2026-03-13 13:27:06 -07:00

store_model_in_db_tests

…

Fix test isolation: run eager tiktoken tests in subprocesses

2026-03-15 17:32:31 -07:00

unified_google_tests

…

vector_store_tests

…

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

fix: tiktoken cache nonroot offline (#23498 )

2026-03-14 10:48:36 -07:00

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check

2026-03-12 13:22:00 -07:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_new_vector_store_endpoints.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

[Fix] Fail fast when team member spend not flushed in time

2026-03-13 12:40:17 -07:00

test_users.py

fix(tests): update deprecated Anthropic model in test_user_model_access (#21826 )

2026-02-21 14:18:24 -08:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.