litellm/tests at f351bbdb368349e6ff65fff7017182ac13ca28dc - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-07 11:13:28 +00:00

Files

T

History

yuneng-jiang f351bbdb36 [Fix] Derive SPEND_PER_REQUEST dynamically in spend accuracy tests

Instead of hardcoding SPEND_PER_REQUEST (which broke when the model
changed from gpt-3.5-turbo-0301 to gpt-3.5-turbo), make a single
calibration request first, poll for its spend, and use that as the
per-request cost. Fails fast with pytest.fail() after 5 retries if
calibration cannot determine the cost.

Also fixes a bug in test_basic_spend_accuracy where the user spend
assertion error message referenced user_info['info'] instead of
user_info['user_info'].

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-13 13:27:06 -07:00

..

…

…

basic_proxy_startup_tests

…

…

code_coverage_tests

[Fix] Add max_depth guard to BFL _read_image_bytes recursive function

2026-03-12 13:22:56 -07:00

documentation_tests

…

…

guardrails_tests

fix: address req changes

2026-03-10 15:51:10 +05:30

image_gen_tests

fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test

2026-03-12 01:27:42 +00:00

fix(proxy): Windows compatibility for Prisma engine watchdog (#23494 )

2026-03-12 16:02:37 -07:00

litellm_core_utils

…

litellm_utils_tests

fix(tests): remove test_oidc_circle_v1_with_amazon_fips that depends on external infra

2026-03-13 10:33:52 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

…

llm_translation

fix(tests): remove test_completion_bedrock_claude_sts_oidc_auth and test_completion_bedrock_httpx_command_r_sts_oidc_auth that depend on external infra

2026-03-13 11:53:53 -07:00

…

fix(tests): fix broken test_router_fallbacks_with_cooldowns_and_model_id

2026-03-13 09:10:41 -07:00

logging_callback_tests

Merge pull request #23483 from BerriAI/litellm_update_deprecated_test_models

2026-03-12 14:16:52 -07:00

Fix test_get_tools_for_single_server

2026-03-12 18:33:14 +05:30

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

…

fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test

2026-03-13 00:04:31 -07:00

pass_through_tests

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

pass_through_unit_tests

…

proxy_admin_ui_tests

Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082 )

2026-03-07 18:31:27 -08:00

proxy_e2e_anthropic_messages_tests

Merge branch 'main' into litellm_fix_nova_pro_max_tokens

2026-03-09 15:47:53 -07:00

proxy_e2e_azure_batches_tests

[Fix] Increase _delete_file retry budget to reduce flakiness

2026-03-13 12:32:55 -07:00

proxy_security_tests

…

proxy_unit_tests

Revert "QA: improve gpt-5.4 code/bugs"

2026-03-13 10:15:47 -07:00

router_unit_tests

…

…

Merge remote main, resolve conflict keeping new unit tests

2026-03-09 15:20:20 -07:00

spend_tracking_tests

[Fix] Derive SPEND_PER_REQUEST dynamically in spend accuracy tests

2026-03-13 13:27:06 -07:00

store_model_in_db_tests

…

Revert "[Fix] Populate _hidden_params.model_id in batch terminal-state shortcut path"

2026-03-13 12:21:39 -07:00

unified_google_tests

…

vector_store_tests

…

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

…

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check

2026-03-12 13:22:00 -07:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_new_vector_store_endpoints.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

[Fix] Fail fast when team member spend not flushed in time

2026-03-13 12:40:17 -07:00

test_users.py

…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.