Commit Graph
23230 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 3362503927 fix(guardrails): add azure content safety guardrails to the UI (#12309) 2025-07-03 21:35:20 -07:00
Ishaan Jaff c83f86f8cb ci/cd new release 2025-07-03 21:16:49 -07:00
Ishaan Jaff 9c8619ed10 test fix 2025-07-03 21:16:26 -07:00
Ishaan Jaff 81d96b9ffe fix test models 2025-07-03 21:16:26 -07:00
Krish DholakiaandGitHub f755b70528 fix(factory.py): support optional args for bedrock (#12287)
* fix(factory.py): support optional args for bedrock

Closes https://github.com/BerriAI/litellm/pull/12276

* test(main.py): Support async await on mock_delay

Closes https://github.com/BerriAI/litellm/issues/12282
2025-07-03 21:15:10 -07:00
Ishaan Jaff bffe5bec7d test fix cli credentials 2025-07-03 21:08:35 -07:00
Ishaan Jaff e03686de5f tests fix use correct import responses 2025-07-03 21:06:31 -07:00
Ishaan JaffandGitHub 4293dd2c2a test: stabilize credentials CLI patch (#12305) 2025-07-03 18:09:32 -07:00
Krrish Dholakia 35ecfb7737 docs(index.md): cleanup 2025-07-03 17:35:49 -07:00
Ishaan JaffandGitHub 3ad6b36ffc test: patch CredentialsManagementClient in CLI (#12304) 2025-07-03 17:01:50 -07:00
Ishaan JaffandGitHub 005de79dd5 Fix Deepeval logger debug formatting (#12303) 2025-07-03 16:45:38 -07:00
Ishaan Jaff e7374e3909 test_gemini_url_context 2025-07-03 16:13:44 -07:00
Ishaan Jaff e66898828c is_error_str_rate_limit 2025-07-03 16:03:48 -07:00
Ishaan Jaff 59f3771799 test_text_completion_stream - hf 2025-07-03 16:00:51 -07:00
Ishaan Jaff 782ba9f5a0 sys.path.insert for cli tests 2025-07-03 15:58:49 -07:00
Ishaan Jaff 81948d4198 fix test 2025-07-03 15:37:10 -07:00
Ishaan Jaff e75f4c8561 TestCallbackManagementEndpoints 2025-07-03 15:00:53 -07:00
Ishaan Jaff 437f4765b4 test_completion_mistral_api_mistral_large_function_call_with_streaming 2025-07-03 14:58:28 -07:00
Ishaan Jaff 274baac9df test_mcp_tools_with_responses_api 2025-07-03 14:53:30 -07:00
Cole McIntoshandGitHub adfe63cf3a fix: handle proxy internal callbacks in callback management test (#12294)
The test_list_callbacks_mixed_callback_types test was failing when run in parallel with other tests due to the proxy server's internal _PROXY_VirtualKeyModelMaxBudgetLimiter callback persisting across test runs. This fix filters out proxy internal callbacks from the test assertions to ensure consistent test behavior regardless of test execution order or parallelization.
2025-07-03 14:28:46 -07:00
Ishaan Jaff 03a589d323 fix - MCP deepwiki mcp is unstable, move to stable mcp 2025-07-03 14:24:32 -07:00
Ishaan JaffandGitHub 3387029723 [Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246)
* add is_vertex_partner_model

* fixes for get_provider_google_genai_generate_content_config

* bug fix use vertex anthropic models with gemini cli

* vertex_anthropic_mock_response

* test streaming vertex generateContent

* add unified_google_tests

* fix is_vertex_partner_model

* add load_vertex_ai_credentials

* test fix
2025-07-03 12:29:27 -07:00
Krish DholakiaandIshaan Jaff c0319d0d01 Litellm dev fix gemini web search tracking (#12288)
* feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder

* fix(types/utils.py): handle prompttokendetails

* fix(stream_chunk_builder_utils.py): fix ruff check error

* test: try-except rate limit error

* fix: fix import
2025-07-03 12:27:14 -07:00
Ishaan Jaff 75bb22a868 fix huggingface/deepseek-ai/DeepSeek-R1 2025-07-03 12:13:51 -07:00
Ishaan Jaff 5630147e80 Revert "Revert "fix tests (#12286)""
This reverts commit 12f157513b.
2025-07-03 12:08:27 -07:00
Ishaan Jaff 12f157513b Revert "fix tests (#12286)"
This reverts commit 99ce3a24cc.
2025-07-03 12:04:23 -07:00
Ishaan Jaff 9cc144e3cb test add clear_existing_callbacks 2025-07-03 12:00:36 -07:00
Ishaan Jaff cb68f5387c Revert "test_caching_kwargs_input"
This reverts commit 1dee70efba.
2025-07-03 11:49:04 -07:00
Jugal D. BhattandGitHub df161f1e45 Litellm mcp tool prefix (#12289)
* prefix all server tools from the backend

* change var name

* fix tests
2025-07-03 11:39:37 -07:00
Ishaan Jaff 1dee70efba test_caching_kwargs_input 2025-07-03 11:28:12 -07:00
Ishaan Jaff 96d5f891df fix test 2025-07-03 11:18:41 -07:00
Ishaan Jaff ba5af3e44b fix keys delete 2025-07-03 11:18:10 -07:00
Ishaan Jaff 4fc4304f37 fix code qa checks 2025-07-03 10:59:52 -07:00
célinaandGitHub 99ce3a24cc fix tests (#12286) 2025-07-03 10:57:19 -07:00
Krrish DholakiaandIshaan Jaff 82a0a443c6 feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder 2025-07-03 10:56:26 -07:00
Ishaan Jaff c3909d6f50 test_keys_delete_error_handling 2025-07-03 10:04:59 -07:00
dcieslak19973andGitHub d480cea8b0 Add azure_ai cohere rerank v3.5 (#12283)
* Add azure_ai cohere rerank v3.5

* Fix CI error
2025-07-03 10:01:45 -07:00
tanjiroandGitHub 6bf1073e1c Correctly display 'Internal Viewer' user role (#12284)
* add "internal_user_viewer" as a user role value type

* cleanup console.log

* remove unused imports

* prettier

* comment
2025-07-03 09:57:49 -07:00
Ishaan Jaff 282ce1a859 test - fix delete keys 2025-07-02 22:23:10 -07:00
Krish DholakiaandGitHub 42cd05dee8 Add Azure Content Safety Guardrails to LiteLLM proxy (#12268)
* feat(azure/prompt_shield.py): initial commit adding prompt shield guardrail + auto discovery mechanism for guardrails

reduces amount of code needed outside of guardrail integration for instrumentation

* feat(azure/prompt_shield.py): working azure prompt shield guardrail integration

Addresses https://github.com/BerriAI/litellm/issues/12254

* test: unit tests for prompt_shield

* fix(prompt_shield.py): add event hook validation for prompt shield guardrail

ensures prompt shield guardrail raises error if asked to run post_call (only runs on user prompt)

* feat(azure/): working text_moderation integration

* fix(text_moderation.py): suppress linting error

* test(test_azure_text_moderation.py): add unit test

* test(test_azure_text_moderation.py): add unit test for responses

* fix(text_moderation.py): return streaming error correctly

ensures error returned to user

* fix: fix linting error

* fix: fix linting check

* test: change mistral model

service tier exceeded

* fix(exception_mapping_utils.py): cover mistral in exception mapping
2025-07-02 21:34:19 -07:00
Krrish DholakiaandIshaan Jaff a198d4a39f test: change mistral model
service tier exceeded
2025-07-02 21:11:02 -07:00
Ishaan Jaff 1aa55e6a74 test_url_context 2025-07-02 21:10:12 -07:00
Ishaan Jaff 4290e04e4f test -self.received_finish_reason = response_obj["finish_reason"] 2025-07-02 21:06:43 -07:00
Ishaan Jaff f1777dbe3d ui new build 2025-07-02 20:50:08 -07:00
Ishaan Jaff 03790cfc2d fix lint 2025-07-02 20:42:10 -07:00
Ishaan Jaff 9e363787e7 fix - mcp import error 2025-07-02 20:39:59 -07:00
Krish DholakiaandGitHub bba75aa12b Add 'audio_url' message type support for VLLM (#12270)
* fix(openai.py): add audio_url content type for vllm

Fixes https://github.com/BerriAI/litellm/issues/12196

* test: fix test
2025-07-02 20:37:45 -07:00
Ishaan Jaff 3b1c5df288 Revert "bump: version 1.74.0 → 1.75.0"
This reverts commit e1c801a1a9.
2025-07-02 20:33:29 -07:00
Ishaan Jaff e1c801a1a9 bump: version 1.74.0 → 1.75.0 2025-07-02 20:32:42 -07:00
Ishaan JaffandGitHub 98d535deaa qa - ui (#12265) 2025-07-02 20:30:14 -07:00