tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-13 07:06:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
29,680 Commits 2,072 Branches 1,425 Tags
5e00a49e7f66190bf06e3c4d6528becfce36c3ce
Commit Graph

29680 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kris Xia 5e00a49e7f fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback (#18698) 
在流式处理错误时，添加状态码标准化逻辑，确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。

- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取，其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时，直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播，而不会触发回退机制
 2026-01-06 23:41:23 +05:30
Ishaan Jaff 69aa111fdd [UI] - Feat add request provider form on UI (#18704) 
* add request provider form

* fix link to github

* add button

* fix link
 2026-01-06 18:54:57 +05:30
Sameer Kankute ce0f71fbe9 Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default 
[Bug] fix model map
 2026-01-06 18:31:33 +05:30
Sameer Kankute 0cd92e895f fix model map 2026-01-06 18:14:00 +05:30
Sameer Kankute e3cbd5ff56 Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default 
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
 2026-01-06 18:05:55 +05:30
Sameer Kankute 1c177a576b Add the LITELLM_REASONING_AUTO_SUMMARY in doc 2026-01-06 18:04:09 +05:30
Sameer Kankute 353769d2ac Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default 
[Fix] Put automatic reasoning summary inclusion behind feat flag
 2026-01-06 17:56:40 +05:30
Sameer Kankute aca656f036 Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3 
fix: remove display name
 2026-01-06 16:35:24 +05:30
Sameer Kankute ffc462465d fix: remove display name 2026-01-06 16:31:07 +05:30
Ishaan Jaff 76eda472be [Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
 2026-01-06 16:24:04 +05:30
Sameer Kankute 2e668d1dfe Merge pull request #18701 from BerriAI/revert-17330-add-model-metadata 
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
 2026-01-06 15:30:19 +05:30
Sameer Kankute 2baec27657 Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries" 2026-01-06 15:29:42 +05:30
Sameer Kankute eb0193a8a5 Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126 
Fix mapped test 060126
 2026-01-06 15:05:19 +05:30
Sameer Kankute 84b24ad030 fix:mypy mcp management 2026-01-06 14:48:31 +05:30
Sameer Kankute 15a28c7fe2 fix:test_api_error_handling 2026-01-06 14:44:34 +05:30
Sameer Kankute 0d050dc0ea fix:test_anthropic_beta_header 2026-01-06 14:28:30 +05:30
Sameer Kankute 8aff258a93 fix: test_databricks_embeddings[True] 2026-01-06 14:20:30 +05:30
Sameer Kankute 386ea1354a fix: async def test_bedrock_apply_guardrail_blocked() 2026-01-06 14:15:06 +05:30
Sameer Kankute 9c795a2baa fix: test_all_models_have_display_name 2026-01-06 14:09:43 +05:30
Sameer Kankute a087df365e fix: test_aaamodel_prices_and_context_window_json_is_valid 2026-01-06 14:04:09 +05:30
Sameer Kankute 865c7a2215 fix: test_update_ui_settings_allowlisted_value 2026-01-06 13:58:37 +05:30
Sameer Kankute 9d59d3eef6 fix: test_secret_manager_failure_does_not_block_email 2026-01-06 13:58:15 +05:30
Sameer Kankute 9f65f82c56 Fix: ImportError: qualifire package is required for QualifireGuardrail. Install it with: pip install qualifire 2026-01-06 13:52:26 +05:30
YutaSaito facc4b0b79 Merge pull request #18693 from BerriAI/litellm_fix_main_test 
fix main test
 2026-01-06 17:17:33 +09:00
Yuta Saito ca14160375 Revert "fix: model eol" 
This reverts commit 5aa1665d79.
 2026-01-06 16:49:30 +09:00
Yuta Saito 23713d1811 fix: anthropic claude-3-opus-20240229 EOL 2026-01-06 16:06:21 +09:00
Yuta Saito 5aa1665d79 fix: model eol 2026-01-06 15:47:37 +09:00
YutaSaito abb4df9dc7 Merge pull request #18687 from BerriAI/revert-18177-litellm_fix_redisvl_dependency 
Revert "Add redisvl in requirements.txt"
 2026-01-06 15:12:39 +09:00
Sameer Kankute bb00a53786 Put reasoning summary behind feat flag 2026-01-06 11:36:20 +05:30
YutaSaito 1897a1f894 Revert "Add redisvl in requirements.txt" 2026-01-06 15:04:56 +09:00
Sameer Kankute 694e44551f Merge pull request #17330 from nmgarza5/add-model-metadata 
feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries
 2026-01-06 10:56:49 +05:30
Sameer Kankute 0f55c2b216 Merge pull request #18513 from talesofai/feat/responses-api-hooks-parity 
feat (proxy) : Responses API Support More Streaming Callback Hooks
 2026-01-06 10:51:48 +05:30
Sameer Kankute 3c0248edb9 Merge pull request #18663 from BerriAI/litellm_staging_01_05_2026 
Staging 01/05/2026
 2026-01-06 10:46:04 +05:30
Sameer Kankute 4ebd9b266b Merge pull request #18177 from BerriAI/litellm_fix_redisvl_dependency 
Add redisvl in requirements.txt
 2026-01-06 10:43:25 +05:30
0717376 12f02f6c54 feat: Add GigaChat provider support (#18564) 
* feat: Add GigaChat provider support

Add native support for GigaChat API (Sber AI, Russia's leading LLM).

Supported features:
- Chat completions (sync/async)
- Streaming (sync/async)
- Function calling / Tools
- Structured output via JSON schema (emulated through function calls)
- Image input (base64 and URL)
- Embeddings

Closes #18515

* fix: resolve mypy type errors in GigaChat handler

- Fix _prepare_file_data return type (use 3-tuple for cleaner type flow)
- Add type annotations for lists in _process_content_parts methods
- Add type annotations in _collapse_user_messages
- Use ChatCompletionToolCallChunk for proper tool_use typing
- Add type: ignore[override] for astreaming async generator

* refactor(gigachat): migrate to BaseConfig pattern

* fix: remove unused imports

* fix: resolve mypy type errors

* fix: mypy type errors

* refactor: address review feedback for GigaChat provider

- Remove singleton pattern, reuse litellm HTTPHandler
- Move constants/errors to transformation files, delete common_utils.py
- Add models to model_prices_and_context_window.json
- Fix ssl_verify not passed to HTTP client for embeddings

* docs: update GigaChat documentation with ssl_verify requirement
 2026-01-06 10:10:02 +05:30
YutaSaito a774e7899c Merge pull request #18281 from Eric84626/main 
Fix: fixed some MCP gateway oauth2 auth issues and ClosedResourceError
 2026-01-06 13:22:46 +09:00
yuneng-jiang 612782e2fb Merge pull request #18680 from BerriAI/litellm_sso_modal_fix 
[Fix] UI - SSO Edit Modal Clear Role Mapping Values on Provider Change
 2026-01-05 19:55:49 -08:00
YutaSaito 31470032ad Merge pull request #18681 from BerriAI/litellm_feat_mcp-server-visibility-configurable 
[feat] mcp server visibility configurable
 2026-01-06 12:53:07 +09:00
YutaSaito ccdcb20048 Merge pull request #18279 from mangabits/fix-otel-provider 
Use already configured opentelemetry providers
 2026-01-06 12:49:48 +09:00
mangabits ce678403b3 Address review comments 2026-01-05 19:42:44 -08:00
LingXuanYin d101990342 Clarify responses API streaming context 2026-01-06 10:54:19 +08:00
LingXuanYin 499fc9f48a Align responses API streaming hooks with chat pipeline 2026-01-06 10:54:19 +08:00
Yuta Saito 29e658012a docs: add user_mcp_management_mode 2026-01-06 11:43:58 +09:00
Yuta Saito 375f3ed439 fix: missing mcp_allow_all_ui.png 2026-01-06 11:23:22 +09:00
yuneng-jiang 4566255181 Fixing tests 2026-01-05 18:22:54 -08:00
Yuta Saito 694bcb6186 feat: add user_mcp_management_mode for view_all visibility 2026-01-06 11:22:28 +09:00
yuneng-jiang 2d464032c5 Fixing Edit SSO Settings Modal 2026-01-05 18:08:41 -08:00
yuneng-jiang 4cdcdc98e8 Merge pull request #18677 from BerriAI/litellm_ui_sso_settings_role 
[Feature] UI - SSO Settings Page Add Role Mappings
 2026-01-05 17:40:29 -08:00
yuneng-jiang 8851b86d93 Adding Role Mappings 2026-01-05 17:30:31 -08:00
Eric84626 f59e9cef55 Merge branch 'main' into main 2026-01-06 06:57:25 +08:00