litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-06-18 07:33:58 +00:00

Files

T

yuneng-jiang 2a5dfcd5bc build(deps-dev): bump black to 26.3.1 and apply formatting (#28525 )

* build(deps-dev): bump black 24.10.0 -> 26.3.1

* style: apply black 26.3.1 formatting

* chore: authorize black 26.3.1 license in liccheck.ini

2026-05-21 17:24:18 -07:00

agent_tests

…

audio_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

basic_proxy_startup_tests

…

batches_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

benchmarks

…

code_coverage_tests

build(deps-dev): bump black to 26.3.1 and apply formatting (#28525 )

2026-05-21 17:24:18 -07:00

documentation_tests

…

enterprise

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

guardrails_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

image_gen_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

litellm

…

litellm_core_utils

…

litellm_utils_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

Litellm oss staging 1 (#28337 )

2026-05-20 17:27:03 -07:00

llm_translation

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

load_tests

…

local_testing

test(vertex_ai): tolerate transient 500 in google maps grounding test (#28503 )

2026-05-21 17:01:49 -07:00

logging_callback_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

mcp_tests

fix(mcp): JWT on tools/list and REST tools/call server resolution (#28227 )

2026-05-20 13:31:44 -07:00

multi_instance_e2e_tests

…

ocr_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

old_proxy_tests/tests

…

openai_endpoints_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

otel_tests

feat(prometheus): add user_email and user_alias to user budget metrics (#28155 )

2026-05-18 16:28:14 -07:00

pass_through_tests

…

pass_through_unit_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

proxy_admin_ui_tests

…

proxy_behavior

test(proxy): behavior-pinning matrix for team management endpoints (#28441 )

2026-05-21 16:57:25 -07:00

proxy_e2e_anthropic_messages_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

proxy_security_tests

…

proxy_unit_tests

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

router_unit_tests

Litellm oss staging 1 (#28337 )

2026-05-20 17:27:03 -07:00

scim_tests

…

search_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

spend_tracking_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

store_model_in_db_tests

…

test_litellm

feat: add guardrail violation span attributes and fix missing spans on pre-call blocks (#28364 )

2026-05-21 15:49:42 -07:00

unified_google_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

vector_store_tests

…

windows_tests

…

__init__.py

…

_flush_vcr_cache.py

…

_vcr_conftest_common.py

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

_vcr_redis_persister.py

fix(caching): replay openai/responses bridge cache hits as chat streams (#28158 )

2026-05-18 16:27:06 -07:00

eval_swe_bench.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

test(callbacks): harden flaky proxy callback-leak detector (#28195 )

2026-05-18 16:39:02 -07:00

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

…

test_end_users.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

…

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_logging.conf

…

test_models.py

…

test_new_vector_store_endpoints.py

…

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team_logging.py

…

test_team_members.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team.py

…

test_users.py

…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.