tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-25 12:23:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e23d06dda4f4ef22a046da3a034f58091a31c40e
litellm/tests
T
History
yuneng-jiangandGitHub e23d06dda4 test(realtime): expect session.created as xAI realtime initial event (#28424) 
xAI's Grok Voice Agent API now sends session.created as its first
realtime event (matching OpenAI), followed by conversation.created.
The E2E canary pinned the old conversation.created value and failed.

LiteLLM's xAI realtime path is a verbatim passthrough (provider_config
is None, raw forwarding), so the event ordering is xAI's own — no
transformation on our side. Update the pinned expected value and the
now-stale comments to match the current API behavior.
2026-05-20 19:01:31 -07:00
..
agent_tests
…
audio_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
basic_proxy_startup_tests
…
batches_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
benchmarks
…
code_coverage_tests
feat: add componentized proxy deployment with gateway, backend, ui, and migrations (#27557)
2026-05-16 09:25:17 -07:00
documentation_tests
…
enterprise
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
guardrails_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
image_gen_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm
…
litellm_core_utils
…
litellm_utils_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
litellm-proxy-extras
…
llm_responses_api_testing
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
llm_translation
test(realtime): expect session.created as xAI realtime initial event (#28424)
2026-05-20 19:01:31 -07:00
load_tests
…
local_testing
fix(proxy): normalize batch file IDs before ManagedObjectTable write (#28339)
2026-05-20 12:13:56 -07:00
logging_callback_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
mcp_tests
fix(mcp): JWT on tools/list and REST tools/call server resolution (#28227)
2026-05-20 13:31:44 -07:00
multi_instance_e2e_tests
…
ocr_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
old_proxy_tests/tests
…
openai_endpoints_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
otel_tests
feat(prometheus): add user_email and user_alias to user budget metrics (#28155)
2026-05-18 16:28:14 -07:00
pass_through_tests
…
pass_through_unit_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
proxy_admin_ui_tests
…
proxy_e2e_anthropic_messages_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
proxy_security_tests
…
proxy_unit_tests
chore(ci): merge dev branch (#28314)
2026-05-20 17:47:33 -07:00
router_unit_tests
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
scim_tests
…
search_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
spend_tracking_tests
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
store_model_in_db_tests
…
test_litellm
chore(ci): merge dev branch (#28314)
2026-05-20 17:47:33 -07:00
unified_google_tests
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
vector_store_tests
…
windows_tests
…
__init__.py
…
_flush_vcr_cache.py
…
_vcr_conftest_common.py
fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110)
2026-05-18 09:15:39 -07:00
_vcr_redis_persister.py
fix(caching): replay openai/responses bridge cache hits as chat streams (#28158)
2026-05-18 16:27:06 -07:00
eval_swe_bench.py
…
gettysburg.wav
…
large_text.py
…
openai_batch_completions.jsonl
…
README.MD
…
test_budget_management.py
…
test_callbacks_on_proxy.py
test(callbacks): harden flaky proxy callback-leak detector (#28195)
2026-05-18 16:39:02 -07:00
test_config.py
…
test_debug_warning.py
…
test_default_encoding_non_root.py
…
test_end_users.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_entrypoint.py
…
test_fallbacks.py
…
test_gpt5_azure_temperature_support.py
…
test_health.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_keys.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_litellm_proxy_responses_config.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_logging.conf
…
test_models.py
…
test_new_vector_store_endpoints.py
…
test_openai_endpoints.py
fix(tests): swap dall-e to gpt-image-1 after openai deprecation
2026-05-12 16:55:18 -07:00
test_organizations.py
…
test_otel_thread_leak.py
…
test_passthrough_endpoints.py
…
test_presidio_latency.py
…
test_proxy_server_non_root.py
…
test_ratelimit.py
chore(ci): modernize model references in tests and configs (#27856)
2026-05-15 15:44:28 -07:00
test_resource_cleanup.py
…
test_service_logger_otel.py
…
test_spend_logs.py
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
test_team_logging.py
…
test_team_members.py
Litellm oss staging 1 (#28337)
2026-05-20 17:27:03 -07:00
test_team.py
…
test_users.py
…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink