litellm/tests at 36dc893770fa69cfcc014e5c535b87d58ca12c89 - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-08-24 02:25:29 +00:00

Files

T

History

Ephrim StanleyandClaude 36dc893770 fix: address review feedback on default tpm/rpm limits

- Use min() across all matching deployments instead of first-wins when
  resolving default_api_key_tpm/rpm_limit for a model group, so
  load-balanced setups with different per-deployment limits always apply
  the most conservative value
- Replace the global SensitiveDataMasker non_sensitive_overrides change
  with a targeted excluded_keys set at the remove_sensitive_info_from_deployment
  call site, avoiding unintended suppression of other fields
- Update the v1 parallel request limiter to pass model_name to
  get_key_model_tpm/rpm_limit so deployment defaults apply there too
- Add 4 tests covering multi-deployment min semantics

Co-Authored-By: Claude (claude-sonnet-4-6) <noreply@anthropic.com>

2026-03-19 01:43:27 -04:00

..

…

…

basic_proxy_startup_tests

CircleCI test stability (#23055 )

2026-03-07 15:19:39 -08:00

Fix flaky batch tests: mock vertex auth and skip on DNS failure

2026-03-15 18:37:40 -07:00

Add CodSpeed performance benchmarks (#23676 )

2026-03-14 18:44:36 -07:00

code_coverage_tests

[Fix] Add max_depth guard to BFL _read_image_bytes recursive function

2026-03-12 13:22:56 -07:00

documentation_tests

…

Fix downloading vertex ai files

2026-03-16 12:08:06 +05:30

guardrails_tests

Optimize CI: parallelize router and guardrails test jobs, fix test isolation

2026-03-14 22:54:44 -07:00

image_gen_tests

fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test

2026-03-12 01:27:42 +00:00

fix(proxy): Windows compatibility for Prisma engine watchdog (#23494 )

2026-03-12 16:02:37 -07:00

litellm_core_utils

…

litellm_utils_tests

Fix flaky AWS secret manager tests by skipping on ThrottlingException

2026-03-15 18:53:18 -07:00

litellm-proxy-extras

fix: prisma migrate deploy failures on pre-existing instances (#23655 )

2026-03-14 16:54:21 -07:00

llm_responses_api_testing

…

llm_translation

Merge remote main into litellm_ci_optimize

2026-03-16 00:50:22 -07:00

…

[Staging] - Ishaan March 17th (#23903 )

2026-03-18 15:09:01 -07:00

logging_callback_tests

[Staging] - Ishaan March 17th (#23903 )

2026-03-18 15:09:01 -07:00

[Infra] Merging RC Branch with Main (#23786 )

2026-03-16 15:32:20 -07:00

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

Fix flaky e2e batch test: set batch_processed=True on completion in retrieve_batch

2026-03-15 18:18:32 -07:00

fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test

2026-03-13 00:04:31 -07:00

pass_through_tests

Fix flaky vertex pass-through spend test by polling instead of fixed sleep

2026-03-15 17:37:53 -07:00

pass_through_unit_tests

…

proxy_admin_ui_tests

Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082 )

2026-03-07 18:31:27 -08:00

proxy_e2e_anthropic_messages_tests

Merge remote main into litellm_ci_optimize

2026-03-16 00:50:22 -07:00

proxy_e2e_azure_batches_tests

Increase file deletion retry budget to 50s for batch_processed race

2026-03-15 15:39:35 -07:00

proxy_security_tests

…

proxy_unit_tests

Merge pull request #23509 from michelligabriele/fix/pass-through-duplicate-failure-logs

2026-03-18 11:57:50 -07:00

router_unit_tests

…

…

Merge remote main, resolve conflict keeping new unit tests

2026-03-09 15:20:20 -07:00

spend_tracking_tests

[Staging] - Ishaan March 17th (#23903 )

2026-03-18 15:09:01 -07:00

store_model_in_db_tests

…

fix: address review feedback on default tpm/rpm limits

2026-03-19 01:43:27 -04:00

unified_google_tests

…

vector_store_tests

…

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

fix: tiktoken cache nonroot offline (#23498 )

2026-03-14 10:48:36 -07:00

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check

2026-03-12 13:22:00 -07:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_new_vector_store_endpoints.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

[Fix] Fail fast when team member spend not flushed in time

2026-03-13 12:40:17 -07:00

test_users.py

…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.