tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-17 14:16:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ed06dded199fa38fc2d2ef6165c25608020b1fa3
litellm/tests
T
History
Nicholas Gigliotti aba027beed Remove native structured output flag from models broken on Bedrock 
Integration testing confirmed gemma-3 (4b/12b/27b) ignores the JSON
schema and returns free text, and nemotron-nano (9b/12b) errors with
"Tool calling is not supported in streaming mode" even on sync calls.
Remove the flag so these models fall back to the tool-call approach.
Also fix test assertions to match (nemotron-nano-3-30b is supported,
gemma-3 and nemotron-nano-12b are not).
2026-03-26 20:23:12 -04:00
..
agent_tests
[Release Fix] (#22411)
2026-02-28 09:46:35 -08:00
audio_tests
…
basic_proxy_startup_tests
CircleCI test stability (#23055)
2026-03-07 15:19:39 -08:00
batches_tests
Fix flaky batch tests: mock vertex auth and skip on DNS failure
2026-03-15 18:37:40 -07:00
benchmarks
Add CodSpeed performance benchmarks (#23676)
2026-03-14 18:44:36 -07:00
code_coverage_tests
[Fix] Add max_depth guard to BFL _read_image_bytes recursive function
2026-03-12 13:22:56 -07:00
documentation_tests
…
enterprise
Fix downloading vertex ai files
2026-03-16 12:08:06 +05:30
guardrails_tests
Add Akto Guardrails to LiteLLM (#23250)
2026-03-17 14:38:04 -07:00
image_gen_tests
fix(ci): remove unused is_expired variable (ruff F841) and handle ModelDeprecated in image gen test
2026-03-12 01:27:42 +00:00
litellm
fix(gemini-embeddings): convert task_type to camelCase taskType for Gemini API (#24191)
2026-03-20 22:32:22 +05:30
litellm_core_utils
…
litellm_utils_tests
Update tests/litellm_utils_tests/test_bedrock_token_counter.py
2026-03-20 22:21:22 +09:00
litellm-proxy-extras
fix: prisma migrate deploy failures on pre-existing instances (#23655)
2026-03-14 16:54:21 -07:00
llm_responses_api_testing
fix: address greptile feedback
2026-03-18 21:36:39 -07:00
llm_translation
Merge remote-tracking branch 'origin/main' into litellm_dev_sameer_16_march_week
2026-03-21 15:11:29 -07:00
load_tests
…
local_testing
[Staging] - Ishaan March 17th (#23903)
2026-03-18 15:09:01 -07:00
logging_callback_tests
Ishaan - March 18th changes (#24056)
2026-03-19 10:20:35 -07:00
mcp_tests
[Infra] Merging RC Branch with Main (#23786)
2026-03-16 15:32:20 -07:00
multi_instance_e2e_tests
…
ocr_tests
…
old_proxy_tests/tests
…
openai_endpoints_tests
Fix flaky e2e batch test: set batch_processed=True on completion in retrieve_batch
2026-03-15 18:18:32 -07:00
otel_tests
fix(tests): increase MAX_CALLS and reduce sleep in flaky e2e budget test
2026-03-13 00:04:31 -07:00
pass_through_tests
Fix flaky vertex pass-through spend test by polling instead of fixed sleep
2026-03-15 17:37:53 -07:00
pass_through_unit_tests
Litellm ishaan march 20 (#24303)
2026-03-21 12:40:11 -07:00
proxy_admin_ui_tests
Fix CVEs: bump tar/minimatch/pypdf + harden Docker SBOM patching (#23082)
2026-03-07 18:31:27 -08:00
proxy_e2e_anthropic_messages_tests
Merge remote main into litellm_ci_optimize
2026-03-16 00:50:22 -07:00
proxy_e2e_azure_batches_tests
Increase file deletion retry budget to 50s for batch_processed race
2026-03-15 15:39:35 -07:00
proxy_security_tests
…
proxy_unit_tests
Merge pull request #24106 from BerriAI/Sameerlite/pre-ratelimit-bg
2026-03-20 17:41:24 +05:30
router_unit_tests
Address router generic API review feedback
2026-03-18 15:25:44 -05:00
scim_tests
…
search_tests
Merge remote main, resolve conflict keeping new unit tests
2026-03-09 15:20:20 -07:00
spend_tracking_tests
[Staging] - Ishaan March 17th (#23903)
2026-03-18 15:09:01 -07:00
store_model_in_db_tests
…
test_litellm
Remove native structured output flag from models broken on Bedrock
2026-03-26 20:23:12 -04:00
unified_google_tests
…
vector_store_tests
…
windows_tests
…
__init__.py
…
gettysburg.wav
…
large_text.py
…
openai_batch_completions.jsonl
…
README.MD
…
test_budget_management.py
…
test_callbacks_on_proxy.py
…
test_config.py
…
test_debug_warning.py
…
test_default_encoding_non_root.py
fix: tiktoken cache nonroot offline (#23498)
2026-03-14 10:48:36 -07:00
test_end_users.py
…
test_entrypoint.py
…
test_fallbacks.py
…
test_gpt5_azure_temperature_support.py
[Fix] Remove deprecated o1-preview from O-series test and deduplicate is_o_series check
2026-03-12 13:22:00 -07:00
test_health.py
…
test_keys.py
…
test_litellm_proxy_responses_config.py
…
test_logging.conf
…
test_models.py
fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments
2026-03-13 00:01:25 +00:00
test_new_vector_store_endpoints.py
fix(ci): stabilize CI tests - conditional import, mock fixes, timing adjustments
2026-03-13 00:01:25 +00:00
test_openai_endpoints.py
…
test_organizations.py
…
test_otel_thread_leak.py
…
test_passthrough_endpoints.py
…
test_presidio_latency.py
…
test_proxy_server_non_root.py
…
test_ratelimit.py
…
test_resource_cleanup.py
…
test_service_logger_otel.py
…
test_spend_logs.py
…
test_team_logging.py
…
test_team_members.py
…
test_team.py
[Fix] Fail fast when team member spend not flushed in time
2026-03-13 12:40:17 -07:00
test_users.py
…

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/test_litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink