tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-10 15:03:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
80acf6bc97eda8b70ccecc7e64d40c17c3aedac3
litellm/tests
T
History
Ryan Castner ac11bfabcb Responses API - Add reasoning content support for non-OpenAI providers (#12055) 
Add reasoning content support when Responses API falls
back to completions API, enabling reasoning content for
all LLM providers (Anthropic, Vertex AI, etc.) since
OpenAI is currently the only native Responses API
provider.

* Add ReasoningSummaryTextDeltaEvent for streaming
  reasoning deltas
* Update streaming iterator to detect and transform
  reasoning content
* Extract reasoning content as separate output items in
  transformations
* Support reasoning content alongside regular message
  content

Closes https://github.com/BerriAI/litellm/issues/11302
2025-06-26 14:21:49 -07:00
..
basic_proxy_startup_tests
(fix) don't block proxy startup if license check fails & using prometheus (#6839)
2024-11-20 17:55:39 -08:00
batches_tests
Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING
2025-06-25 22:41:22 -07:00
code_coverage_tests
docs(litellm_logging_code_coverage.py): fix check
2025-06-18 21:36:03 -07:00
documentation_tests
Litellm dev 12 28 2024 p1 (#7463)
2024-12-28 20:26:00 -08:00
enterprise
Store batch output file id in DB + Store batch file status in DB + (experimental) BATCH API COST TRACKING
2025-06-25 22:41:22 -07:00
guardrails_tests
[Bug Fix] Bedrock Guardrail - Don't raise exception on intervene action (#11875)
2025-06-23 19:59:44 -07:00
image_gen_tests
[Fix]: Add cost tracking for image edits endpoint [OpenAI, Azure] (#11186)
2025-05-27 17:52:15 -07:00
litellm_utils_tests
Update enduser spend and budget reset date based on budget duration (#8460)
2025-06-08 08:39:14 -07:00
litellm-proxy-extras
Prisma Migrate - support setting custom migration dir (#10336)
2025-04-26 12:05:06 -07:00
llm_responses_api_testing
[Feat] Add Azure Codex Models on LiteLLM + new /v1 preview Azure OpenAI API (#11934)
2025-06-20 18:08:44 -07:00
llm_translation
Anthropic /v1/messages - Custom LLM Server support (#12016)
2025-06-24 22:00:44 -07:00
load_tests
test: test_embedding_performance
2025-05-14 21:31:07 -07:00
local_testing
Minor Fixes (#11868)
2025-06-18 14:12:59 -07:00
logging_callback_tests
[Feat] Add OpenAI Search Vector Store Operation (#12018)
2025-06-24 15:52:43 -07:00
mcp_tests
[Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers (#11890) (#11891)
2025-06-19 20:07:08 -07:00
multi_instance_e2e_tests
(e2e testing) - add tests for using litellm /team/ updates in multi-instance deployments with Redis (#8440)
2025-02-10 19:33:27 -08:00
old_proxy_tests/tests
test: update tests to new deployment model (#10142)
2025-04-18 14:22:12 -07:00
openai_endpoints_tests
set flaky tests as flaky
2025-06-14 13:51:52 -07:00
otel_tests
set flaky tests as flaky
2025-06-14 13:51:52 -07:00
pass_through_tests
test_anthropic_basic_completion_with_headers
2025-06-14 13:56:06 -07:00
pass_through_unit_tests
[Bug Fix] Cost tracking and logging via the /v1/messages API are not working when using Claude Code (#11928)
2025-06-20 18:08:35 -07:00
proxy_admin_ui_tests
test(test_sso_sign_in.py): update test
2025-06-03 21:46:34 -07:00
proxy_security_tests
(Security fix) - remove code block that inserts master key hash into DB (#8268)
2025-02-05 17:25:42 -08:00
proxy_unit_tests
Squashed commit of the following:
2025-06-20 23:11:53 -07:00
router_unit_tests
[Fix] Router - cooldown time, allow using dynamic cooldown time for a specific deployment (#12037)
2025-06-25 08:46:27 -07:00
scim_tests
[Feat SSO] Add LiteLLM SCIM Integration for Team and User management (#10072)
2025-04-16 19:21:47 -07:00
spend_tracking_tests
test_long_term_spend_accuracy_with_bursts
2025-03-31 21:09:29 -07:00
store_model_in_db_tests
fix test MCP
2025-06-20 12:09:45 -07:00
test_litellm
Responses API - Add reasoning content support for non-OpenAI providers (#12055)
2025-06-26 14:21:49 -07:00
unified_google_tests
[Feat] gemini-cli integration - Add Logging + Cost tracking for stream + non-stream Vertex / Google AI Studio routes (#12058)
2025-06-25 22:26:20 -07:00
vector_store_tests
[Feat] OpenAI/Azure OpenAI - Add support for creating vector stores on LiteLLM (#12021)
2025-06-24 20:46:48 -07:00
windows_tests
[Bug Fix] UnicodeDecodeError: 'charmap' on Windows during litellm import (#10542)
2025-05-03 21:31:05 -07:00
__init__.py
Litellm fix GitHub action testing (#11163)
2025-05-26 14:41:42 -07:00
gettysburg.wav
feat(main.py): support openai transcription endpoints
2024-03-08 10:25:19 -08:00
large_text.py
fix(router.py): check for context window error when handling 400 status code errors
2024-03-26 08:08:15 -07:00
openai_batch_completions.jsonl
feat(router.py): Support Loadbalancing batch azure api endpoints (#5469)
2024-09-02 21:32:55 -07:00
README.MD
add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684)
2025-02-20 21:23:54 -08:00
test_budget_management.py
Update enduser spend and budget reset date based on budget duration (#8460)
2025-06-08 08:39:14 -07:00
test_callbacks_on_proxy.py
fix - test num callbacks
2024-05-17 22:06:51 -07:00
test_config.py
fix testing - langfuse apis are flaky, we unit test team / key based logging in test_langfuse_unit_tests.py
2024-12-03 11:24:36 -08:00
test_debug_warning.py
fix(utils.py): fix togetherai streaming cost calculation
2024-08-01 15:03:08 -07:00
test_end_users.py
test: run test earlier to catch error
2025-03-27 23:08:52 -07:00
test_entrypoint.py
(fix) clean up root repo - move entrypoint.sh and build_admin_ui to /docker (#6110)
2024-10-08 11:34:43 +05:30
test_fallbacks.py
Ollama Chat - parse tool calls on streaming (#11171)
2025-05-27 16:14:49 -07:00
test_health.py
(test) /health/readiness
2024-01-29 15:27:25 -08:00
test_keys.py
test: temporarily skip test due to change testing model change - need to update test for new model
2025-05-09 09:02:08 -07:00
test_logging.conf
feat(proxy_cli.py): add new 'log_config' cli param (#6352)
2024-10-21 21:25:58 -07:00
test_models.py
Add model access groups on UI (#11719)
2025-06-13 21:20:25 -07:00
test_openai_endpoints.py
test string checked for model access control
2025-03-10 20:04:18 -07:00
test_organizations.py
UI - fix adding vertex models with reusable credentials + fix pagination on keys table + fix showing org budgets on table (#10528)
2025-05-03 08:16:53 -07:00
test_passthrough_endpoints.py
test test_basic_passthrough
2024-08-06 21:17:07 -07:00
test_ratelimit.py
(Refactor / QA) - Use LoggingCallbackManager to append callbacks and ensure no duplicate callbacks are added (#8112)
2025-01-30 19:35:50 -08:00
test_spend_logs.py
(feat) - track org_id in SpendLogs (#8253)
2025-02-04 21:08:05 -08:00
test_team_logging.py
test: skip flaky test
2024-11-22 19:23:36 +05:30
test_team_members.py
test: add more unit testing for team member endpoints (#8170)
2025-02-01 11:23:00 -08:00
test_team.py
build: publish new litellm-proxy-extras file
2025-05-27 17:44:23 -07:00
test_users.py
test: fix imports
2025-05-26 22:06:53 -07:00

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.

Reference in New Issue View Git Blame Copy Permalink