litellm/tests at 216c68db049d8d06a8fefc35aa4976f4dff8789f - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 20:18:21 +00:00

Files

T

History

216c68db04 fix(gemini): googleSearch + server-side tools and googleMaps JSON schema (#29582 )

* fix(gemini): keep googleSearch with server-side tools and googleMaps JSON schema

Wire include_server_side_tool_invocations through completion() so mixed
google_search and function tools are not dropped on Gemini 3+. Rewrite
generationConfig to responseFormat when googleMaps is used with JSON schema.

Fixes #27479
Fixes #29451

Co-authored-by: Cursor <cursoragent@cursor.com>

* address greptile review feedback (greploop iteration 1)

* style: fix black formatting in main.py for py312 compat

* Fix Gemini Google Maps extra_body JSON rewrite

---------

Co-authored-by: Cursor <cursoragent@cursor.com>

2026-06-04 07:43:30 -07:00

..

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

basic_proxy_startup_tests

…

test: stabilize batch VCR coverage and stop live upload/network leaks (#29477 )

2026-06-02 16:11:52 -07:00

…

code_coverage_tests

Litellm oss staging (#29492 )

2026-06-02 08:48:10 -07:00

documentation_tests

…

fix(bedrock): support tool search results + chat annotations (#29120 )

2026-05-29 20:48:36 -07:00

guardrails_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

image_gen_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

CI: copy of #25177 (OCI GenAI: embeddings, streaming/reasoning fixes, model catalog) (#28223 )

2026-05-23 12:15:41 -07:00

fix(gemini): googleSearch + server-side tools and googleMaps JSON schema (#29582 )

2026-06-04 07:43:30 -07:00

litellm_core_utils

…

litellm_utils_tests

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

litellm-proxy-extras

…

llm_responses_api_testing

test(responses): bump deprecated gemini-3-pro-preview to gemini-3.1-pro-preview (#29433 )

2026-06-01 09:54:30 -07:00

llm_translation

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

…

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

logging_callback_tests

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

[internal copy of #28008 ] Support MCP OAuth passthrough and issuer-scoped JWT auth (#28356 )

2026-06-02 12:22:04 -07:00

multi_instance_e2e_tests

…

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

old_proxy_tests/tests

…

openai_endpoints_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

feat(prometheus): add user_email and user_alias to user budget metrics (#28155 )

2026-05-18 16:28:14 -07:00

pass_through_tests

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

pass_through_unit_tests

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

proxy_admin_ui_tests

fix(guardrails): persist disable_global_guardrails on keys (#29233 )

2026-05-28 21:19:04 -07:00

test(proxy): phase-4 payload behavior pinning for tier-2/3 key + team management endpoints (#28681 )

2026-05-23 12:16:29 -07:00

proxy_e2e_anthropic_messages_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

proxy_security_tests

…

proxy_unit_tests

Litellm oss staging 030626 (#29578 )

2026-06-03 11:01:51 -07:00

router_unit_tests

fix(router): enforce deployment budgets for dynamically added models (#29273 )

2026-05-29 19:43:14 -07:00

…

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

spend_tracking_tests

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

store_model_in_db_tests

…

fix(gemini): googleSearch + server-side tools and googleMaps JSON schema (#29582 )

2026-06-04 07:43:30 -07:00

unified_google_tests

fix(tests): stabilize image-edit VCR cassettes to stop live gpt-image-1 spend (#28110 )

2026-05-18 09:15:39 -07:00

vector_store_tests

Revert "chore(tests): migrate Bedrock CI to AWS account 941277531214 (#28728 )" (#29326 )

2026-05-30 11:26:24 -07:00

ci: reproduce default-Windows wheel install to guard MAX_PATH (#29597 )

2026-06-03 11:28:08 -07:00

__init__.py

…

_flush_vcr_cache.py

tests(vcr): isolate cassette redis to CASSETTE_REDIS_URL

2026-05-01 12:32:59 -07:00

_live_test_helpers.py

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

_vcr_conftest_common.py

test(vcr): close out the remaining VCR live-call leaks (#29603 )

2026-06-03 13:46:43 -07:00

_vcr_redis_persister.py

fix(tests/vcr): make Redis cassette cache replay deterministically (zero VCR misses on consecutive runs) (#28826 )

2026-05-26 11:30:44 -07:00

eval_swe_bench.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

test(callbacks): harden flaky proxy callback-leak detector (#28195 )

2026-05-18 16:39:02 -07:00

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

…

test_end_users.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

…

test_health.py

fix(tests): swap dall-e to gpt-image-1 after openai deprecation

2026-05-12 16:55:18 -07:00

test_keys.py

fix(tests): swap dall-e to gpt-image-1 after openai deprecation

2026-05-12 16:55:18 -07:00

test_litellm_proxy_responses_config.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_logging.conf

…

test_models.py

…

test_new_vector_store_endpoints.py

…

test_openai_endpoints.py

fix(ci): keep coverage rename green when a parallel node runs no tests (#29608 )

2026-06-03 13:37:53 -07:00

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

chore(ci): modernize model references in tests and configs (#27856 )

2026-05-15 15:44:28 -07:00

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team_logging.py

…

test_team_members.py

Litellm oss staging 04 21 2026 2 (#26569 )

2026-05-20 21:25:19 -07:00

test_team.py

…

test_users.py

Fix: tag budget reset must drop stale management-cache entry (#27568 )

2026-05-10 00:18:55 +00:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.