Commit Graph
23086 Commits
Author SHA1 Message Date
Krrish Dholakia bc6b60e5ab docs(index.md): cleanup release 2025-07-03 22:35:37 -07:00
Ishaan Jaff 7319d6b003 test llamafile 2025-07-03 22:35:22 -07:00
Krrish Dholakia 38dcb85e9a docs(index.md): cleanup doc 2025-07-03 22:35:07 -07:00
Ishaan Jaff 0835011388 test fix creds test 2025-07-03 22:01:52 -07:00
Takashi IshidaandGitHub 773717d57c improve readme: replace claude-3-sonnet because it will be retired soon (#12239)
* improve readme: replace claude-3-sonnet-20240229 because it will be retired soon

* update the readme example to claude sonnet 4
2025-07-03 21:50:39 -07:00
Cole McIntoshandGitHub b6589a72c9 fix: Add size parameter support for Vertex AI image generation (#12292)
- Added 'size' to supported parameters for vertex_ai in get_optional_params_image_gen
- Implemented mapping from OpenAI size format (e.g., '1024x1024') to Vertex AI aspectRatio format (e.g., '1:1')
- Supports common aspect ratios: 1:1 (square), 16:9 (landscape), 9:16 (portrait)
- Added comprehensive test coverage for the size parameter mapping

Fixes LIT-279: Vertex AI Image Generation Aspect Ratio Support
2025-07-03 21:43:37 -07:00
Krish DholakiaandGitHub 3362503927 fix(guardrails): add azure content safety guardrails to the UI (#12309) 2025-07-03 21:35:20 -07:00
Ishaan Jaff c83f86f8cb ci/cd new release 2025-07-03 21:16:49 -07:00
Ishaan Jaff 9c8619ed10 test fix 2025-07-03 21:16:26 -07:00
Ishaan Jaff 81d96b9ffe fix test models 2025-07-03 21:16:26 -07:00
Krish DholakiaandGitHub f755b70528 fix(factory.py): support optional args for bedrock (#12287)
* fix(factory.py): support optional args for bedrock

Closes https://github.com/BerriAI/litellm/pull/12276

* test(main.py): Support async await on mock_delay

Closes https://github.com/BerriAI/litellm/issues/12282
2025-07-03 21:15:10 -07:00
Ishaan Jaff bffe5bec7d test fix cli credentials 2025-07-03 21:08:35 -07:00
Ishaan Jaff e03686de5f tests fix use correct import responses 2025-07-03 21:06:31 -07:00
Ishaan JaffandGitHub 4293dd2c2a test: stabilize credentials CLI patch (#12305) 2025-07-03 18:09:32 -07:00
Krrish Dholakia 35ecfb7737 docs(index.md): cleanup 2025-07-03 17:35:49 -07:00
Ishaan JaffandGitHub 3ad6b36ffc test: patch CredentialsManagementClient in CLI (#12304) 2025-07-03 17:01:50 -07:00
Ishaan JaffandGitHub 005de79dd5 Fix Deepeval logger debug formatting (#12303) 2025-07-03 16:45:38 -07:00
Ishaan Jaff e7374e3909 test_gemini_url_context 2025-07-03 16:13:44 -07:00
Ishaan Jaff e66898828c is_error_str_rate_limit 2025-07-03 16:03:48 -07:00
Ishaan Jaff 59f3771799 test_text_completion_stream - hf 2025-07-03 16:00:51 -07:00
Ishaan Jaff 782ba9f5a0 sys.path.insert for cli tests 2025-07-03 15:58:49 -07:00
Ishaan Jaff 81948d4198 fix test 2025-07-03 15:37:10 -07:00
Ishaan Jaff e75f4c8561 TestCallbackManagementEndpoints 2025-07-03 15:00:53 -07:00
Ishaan Jaff 437f4765b4 test_completion_mistral_api_mistral_large_function_call_with_streaming 2025-07-03 14:58:28 -07:00
Ishaan Jaff 274baac9df test_mcp_tools_with_responses_api 2025-07-03 14:53:30 -07:00
Cole McIntoshandGitHub adfe63cf3a fix: handle proxy internal callbacks in callback management test (#12294)
The test_list_callbacks_mixed_callback_types test was failing when run in parallel with other tests due to the proxy server's internal _PROXY_VirtualKeyModelMaxBudgetLimiter callback persisting across test runs. This fix filters out proxy internal callbacks from the test assertions to ensure consistent test behavior regardless of test execution order or parallelization.
2025-07-03 14:28:46 -07:00
Ishaan Jaff 03a589d323 fix - MCP deepwiki mcp is unstable, move to stable mcp 2025-07-03 14:24:32 -07:00
Ishaan JaffandGitHub 3387029723 [Bug Fix] Using gemini-cli with Vertex Anthropic Models (#12246)
* add is_vertex_partner_model

* fixes for get_provider_google_genai_generate_content_config

* bug fix use vertex anthropic models with gemini cli

* vertex_anthropic_mock_response

* test streaming vertex generateContent

* add unified_google_tests

* fix is_vertex_partner_model

* add load_vertex_ai_credentials

* test fix
2025-07-03 12:29:27 -07:00
Krish DholakiaandIshaan Jaff c0319d0d01 Litellm dev fix gemini web search tracking (#12288)
* feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder

* fix(types/utils.py): handle prompttokendetails

* fix(stream_chunk_builder_utils.py): fix ruff check error

* test: try-except rate limit error

* fix: fix import
2025-07-03 12:27:14 -07:00
Ishaan Jaff 75bb22a868 fix huggingface/deepseek-ai/DeepSeek-R1 2025-07-03 12:13:51 -07:00
Ishaan Jaff 5630147e80 Revert "Revert "fix tests (#12286)""
This reverts commit 12f157513b.
2025-07-03 12:08:27 -07:00
Ishaan Jaff 12f157513b Revert "fix tests (#12286)"
This reverts commit 99ce3a24cc.
2025-07-03 12:04:23 -07:00
Ishaan Jaff 9cc144e3cb test add clear_existing_callbacks 2025-07-03 12:00:36 -07:00
Ishaan Jaff cb68f5387c Revert "test_caching_kwargs_input"
This reverts commit 1dee70efba.
2025-07-03 11:49:04 -07:00
Jugal D. BhattandGitHub df161f1e45 Litellm mcp tool prefix (#12289)
* prefix all server tools from the backend

* change var name

* fix tests
2025-07-03 11:39:37 -07:00
Ishaan Jaff 1dee70efba test_caching_kwargs_input 2025-07-03 11:28:12 -07:00
Ishaan Jaff 96d5f891df fix test 2025-07-03 11:18:41 -07:00
Ishaan Jaff ba5af3e44b fix keys delete 2025-07-03 11:18:10 -07:00
Ishaan Jaff 4fc4304f37 fix code qa checks 2025-07-03 10:59:52 -07:00
célinaandGitHub 99ce3a24cc fix tests (#12286) 2025-07-03 10:57:19 -07:00
Krrish DholakiaandIshaan Jaff 82a0a443c6 feat(stream_chunk_builder_utils.py): correctly return web_search_requests on stream chunk builder 2025-07-03 10:56:26 -07:00
Ishaan Jaff c3909d6f50 test_keys_delete_error_handling 2025-07-03 10:04:59 -07:00
dcieslak19973andGitHub d480cea8b0 Add azure_ai cohere rerank v3.5 (#12283)
* Add azure_ai cohere rerank v3.5

* Fix CI error
2025-07-03 10:01:45 -07:00
tanjiroandGitHub 6bf1073e1c Correctly display 'Internal Viewer' user role (#12284)
* add "internal_user_viewer" as a user role value type

* cleanup console.log

* remove unused imports

* prettier

* comment
2025-07-03 09:57:49 -07:00
Ishaan Jaff 282ce1a859 test - fix delete keys 2025-07-02 22:23:10 -07:00
Krish DholakiaandGitHub 42cd05dee8 Add Azure Content Safety Guardrails to LiteLLM proxy (#12268)
* feat(azure/prompt_shield.py): initial commit adding prompt shield guardrail + auto discovery mechanism for guardrails

reduces amount of code needed outside of guardrail integration for instrumentation

* feat(azure/prompt_shield.py): working azure prompt shield guardrail integration

Addresses https://github.com/BerriAI/litellm/issues/12254

* test: unit tests for prompt_shield

* fix(prompt_shield.py): add event hook validation for prompt shield guardrail

ensures prompt shield guardrail raises error if asked to run post_call (only runs on user prompt)

* feat(azure/): working text_moderation integration

* fix(text_moderation.py): suppress linting error

* test(test_azure_text_moderation.py): add unit test

* test(test_azure_text_moderation.py): add unit test for responses

* fix(text_moderation.py): return streaming error correctly

ensures error returned to user

* fix: fix linting error

* fix: fix linting check

* test: change mistral model

service tier exceeded

* fix(exception_mapping_utils.py): cover mistral in exception mapping
2025-07-02 21:34:19 -07:00
Krrish DholakiaandIshaan Jaff a198d4a39f test: change mistral model
service tier exceeded
2025-07-02 21:11:02 -07:00
Ishaan Jaff 1aa55e6a74 test_url_context 2025-07-02 21:10:12 -07:00
Ishaan Jaff 4290e04e4f test -self.received_finish_reason = response_obj["finish_reason"] 2025-07-02 21:06:43 -07:00
Ishaan Jaff f1777dbe3d ui new build 2025-07-02 20:50:08 -07:00