litellm/tests at cb66672017e4e091cd05622b00e430425afdfddc - litellm - Gitea: Git with a cup of tea

tiennm99/litellm

mirror of https://github.com/tiennm99/litellm.git synced 2026-07-14 01:07:15 +00:00

Files

T

History

Nicholas Gigliotti cb66672017 Replace hardcoded Bedrock native structured output model set with cost JSON lookup

Move the source of truth for which Bedrock models support native structured
outputs (outputConfig.textFormat) from a hardcoded substring set
(BEDROCK_NATIVE_STRUCTURED_OUTPUT_MODELS) to the cost JSON via a new
"supports_native_structured_output" flag. This makes it possible to add
support for new models (including Claude Sonnet 4.6, which was missing)
by updating the JSON alone, with no code changes needed.

2026-03-26 20:23:12 -04:00

..

[Release Fix] (#22411 )

2026-02-28 09:46:35 -08:00

…

basic_proxy_startup_tests

CircleCI test stability (#23055 )

2026-03-07 15:19:39 -08:00

Fix flaky batch tests: mock vertex auth and skip on DNS failure

2026-03-15 18:37:40 -07:00

Add CodSpeed performance benchmarks (#23676 )

2026-03-14 18:44:36 -07:00

code_coverage_tests

[Fix] Add max_depth guard to BFL _read_image_bytes recursive function

2026-03-12 13:22:56 -07:00

documentation_tests

…

Fix downloading vertex ai files

2026-03-16 12:08:06 +05:30

guardrails_tests

Add Akto Guardrails to LiteLLM (#23250 )

2026-03-17 14:38:04 -07:00

image_gen_tests

fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test

2026-03-12 01:27:42 +00:00

fix(gemini-embeddings): convert task_type to camelCase taskType for Gemini API (#24191 )

2026-03-20 22:32:22 +05:30

litellm_core_utils

…

litellm_utils_tests

Update tests/litellm_utils_tests/test_bedrock_token_counter.py

2026-03-20 22:21:22 +09:00

litellm-proxy-extras

fix: prisma migrate deploy failures on pre-existing instances (#23655 )

2026-03-14 16:54:21 -07:00

llm_responses_api_testing

fix: address greptile feedback

2026-03-18 21:36:39 -07:00

llm_translation

Merge remote-tracking branch 'origin/main' into litellm_dev_sameer_16_march_week

2026-03-21 15:11:29 -07:00

…

[Staging] - Ishaan March 17th (#23903 )

2026-03-18 15:09:01 -07:00

logging_callback_tests

Ishaan - March 18th changes (#24056 )

2026-03-19 10:20:35 -07:00

[Infra] Merging RC Branch with Main (#23786 )

2026-03-16 15:32:20 -07:00

multi_instance_e2e_tests

…

…

old_proxy_tests/tests

…

openai_endpoints_tests

Fix flaky e2e batch test: set batch_processed=True on completion in retrieve_batch

2026-03-15 18:18:32 -07:00

fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test

2026-03-13 00:04:31 -07:00

pass_through_tests

Fix flaky vertex pass-through spend test by polling instead of fixed sleep

2026-03-15 17:37:53 -07:00

pass_through_unit_tests

Litellm ishaan march 20 (#24303 )

2026-03-21 12:40:11 -07:00

proxy_admin_ui_tests

Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082 )

2026-03-07 18:31:27 -08:00

proxy_e2e_anthropic_messages_tests

Merge remote main into litellm_ci_optimize

2026-03-16 00:50:22 -07:00

proxy_e2e_azure_batches_tests

Increase file deletion retry budget to 50s for batch_processed race

2026-03-15 15:39:35 -07:00

proxy_security_tests

…

proxy_unit_tests

Merge pull request #24106 from BerriAI/Sameerlite/pre-ratelimit-bg

2026-03-20 17:41:24 +05:30

router_unit_tests

Address router generic API review feedback

2026-03-18 15:25:44 -05:00

…

Merge remote main, resolve conflict keeping new unit tests

2026-03-09 15:20:20 -07:00

spend_tracking_tests

[Staging] - Ishaan March 17th (#23903 )

2026-03-18 15:09:01 -07:00

store_model_in_db_tests

…

Replace hardcoded Bedrock native structured output model set with cost JSON lookup

2026-03-26 20:23:12 -04:00

unified_google_tests

…

vector_store_tests

…

…

__init__.py

…

gettysburg.wav

…

large_text.py

…

openai_batch_completions.jsonl

…

README.MD

…

test_budget_management.py

…

test_callbacks_on_proxy.py

…

test_config.py

…

test_debug_warning.py

…

test_default_encoding_non_root.py

fix: tiktoken cache nonroot offline (#23498 )

2026-03-14 10:48:36 -07:00

test_end_users.py

…

test_entrypoint.py

…

test_fallbacks.py

…

test_gpt5_azure_temperature_support.py

[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check

2026-03-12 13:22:00 -07:00

test_health.py

…

test_keys.py

…

test_litellm_proxy_responses_config.py

…

test_logging.conf

…

test_models.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_new_vector_store_endpoints.py

fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments

2026-03-13 00:01:25 +00:00

test_openai_endpoints.py

…

test_organizations.py

…

test_otel_thread_leak.py

…

test_passthrough_endpoints.py

…

test_presidio_latency.py

…

test_proxy_server_non_root.py

…

test_ratelimit.py

…

test_resource_cleanup.py

…

test_service_logger_otel.py

…

test_spend_logs.py

…

test_team_logging.py

…

test_team_members.py

…

test_team.py

[Fix] Fail fast when team member spend not flushed in time

2026-03-13 12:40:17 -07:00

test_users.py

…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.