tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-06 00:23:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
29,731 Commits 2,072 Branches 1,425 Tags
dd67235d4de475e433ce297794dda5ee3afc42bc
Commit Graph
5155 Commits
Author SHA1 Message Date
Ishaan Jaffer dd67235d4d TestLevoIntegration 2026-01-07 18:17:22 +05:30
Ishaan Jaffer 407575efb3 test_completion_bedrock_claude_aws_session_token 2026-01-07 18:09:07 +05:30
Krish DholakiaandGitHub 80ead21c3a Litellm improve endpoint discovery (#18762) 
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
 2026-01-07 17:35:01 +05:30
Ishaan Jaffer 45f840d274 test_azure_image_edit_cost_tracking 2026-01-07 15:12:51 +05:30
Ishaan Jaffer 5873cd4a32 test_completion_bedrock_titan_null_response 2026-01-07 15:09:44 +05:30
Ishaan Jaffer d56054e747 test_anthropic_messages_to_wildcard_model 2026-01-07 15:03:06 +05:30
Ishaan Jaffer 269771a7c9 test_bedrock_httpx_streaming 2026-01-07 15:02:10 +05:30
Ishaan Jaffer 645ca64780 a121 fixes 2026-01-07 15:00:49 +05:30
Ishaan Jaffer a5332a6d51 fix code qa check 2026-01-07 14:54:00 +05:30
Ishaan Jaffer ee2b51b2d0 test_openai_image_edit_cost_tracking 2026-01-07 14:36:50 +05:30
Ishaan Jaffer bab43ee9dd fix list keys 2026-01-07 14:34:37 +05:30
Ishaan Jaffer 38ccfb4234 test_completion_claude_3_function_call_with_otel 2026-01-07 14:22:54 +05:30
Ishaan Jaffer fa1b387237 test_routing_strategy_init 2026-01-07 14:21:03 +05:30
Ishaan Jaffer 3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaffer b7798b7f7c fix metadata.cost_breakdown 2026-01-07 14:17:08 +05:30
Ishaan JaffandGitHub b5d74722ba Revert "Litellm fixes a2a sdk (#18748)" (#18752) 
This reverts commit 1661707492.
 2026-01-07 14:04:10 +05:30
Ishaan JaffandGitHub 1661707492 Litellm fixes a2a sdk (#18748) 
* add a2a SDK to req

* fix
 2026-01-07 13:31:45 +05:30
Yuta Saito 1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
yuneng-jiang 2a6f2a3fb8 add team member budget duration in team/update 2026-01-06 17:43:17 -08:00
Alexsander HamirandGitHub bb4c01ffa0 Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio BritoandGitHub 18ca6b2add Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665) 
* Handle not supported region for vertex ai count tokens

* add unit test
 2026-01-07 00:05:00 +05:30
Lize CaiandGitHub fe9b05e23e Add header for SAP AI Core Tracking (#18714) 
Signed-off-by: Lize Cai <lize.cai@sap.com>
 2026-01-06 23:59:02 +05:30
Rohit Ravikant RaneandGitHub a7c39ccc12 fix(router): correct num_retries tracking in retry logic (#18712) 
* fix(router): correct num_retries tracking in retry logic

- Fix off-by-one error in num_retries attribute when retries exhausted
- Correct remaining_retries calculation
- Add comprehensive tests for retry tracking edge cases

Fixes incorrect retry count in error messages and logging

* chore: trigger CI re-run

* chore: trigger CI tests again
 2026-01-06 23:58:41 +05:30
Kazuki MatsumaruandGitHub 26bdf7b7a8 Remove redundant comments about setting litellm.callbacks (#18711) 
- Removed duplicate comment in test_router_endpoints.py
- Removed duplicate comment in logging.md
- Kept clearer comment: 'Set litellm.callbacks = [proxy_handler_instance] on the proxy'
 2026-01-06 23:58:01 +05:30
Kris XiaandGitHub 5e00a49e7f fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback (#18698) 
在流式处理错误时，添加状态码标准化逻辑，确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。

- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取，其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时，直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播，而不会触发回退机制
 2026-01-06 23:41:23 +05:30
Sameer KankuteandGitHub 353769d2ac Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default 
[Fix] Put automatic reasoning summary inclusion behind feat flag
 2026-01-06 17:56:40 +05:30
Ishaan JaffandGitHub 76eda472be [Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
 2026-01-06 16:24:04 +05:30
Sameer KankuteandGitHub 2baec27657 Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries" 2026-01-06 15:29:42 +05:30
Sameer KankuteandGitHub eb0193a8a5 Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126 
Fix mapped test 060126
 2026-01-06 15:05:19 +05:30
Sameer Kankute 0d050dc0ea fix:test_anthropic_beta_header 2026-01-06 14:28:30 +05:30
Sameer Kankute 8aff258a93 fix: test_databricks_embeddings[True] 2026-01-06 14:20:30 +05:30
Sameer Kankute 386ea1354a fix: async def test_bedrock_apply_guardrail_blocked() 2026-01-06 14:15:06 +05:30
Sameer Kankute 865c7a2215 fix: test_update_ui_settings_allowlisted_value 2026-01-06 13:58:37 +05:30
Sameer Kankute 9d59d3eef6 fix: test_secret_manager_failure_does_not_block_email 2026-01-06 13:58:15 +05:30
Sameer Kankute 9f65f82c56 Fix: ImportError: qualifire package is required for QualifireGuardrail. Install it with: pip install qualifire 2026-01-06 13:52:26 +05:30
Yuta Saito ca14160375 Revert "fix: model eol" 
This reverts commit 5aa1665d79.
 2026-01-06 16:49:30 +09:00
Yuta Saito 23713d1811 fix: anthropic claude-3-opus-20240229 EOL 2026-01-06 16:06:21 +09:00
Yuta Saito 5aa1665d79 fix: model eol 2026-01-06 15:47:37 +09:00
Sameer Kankute bb00a53786 Put reasoning summary behind feat flag 2026-01-06 11:36:20 +05:30
Sameer KankuteandGitHub 694e44551f Merge pull request #17330 from nmgarza5/add-model-metadata 
feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries
 2026-01-06 10:56:49 +05:30
Sameer KankuteandGitHub 0f55c2b216 Merge pull request #18513 from talesofai/feat/responses-api-hooks-parity 
feat (proxy) : Responses API Support More Streaming Callback Hooks
 2026-01-06 10:51:48 +05:30
Sameer KankuteandGitHub 3c0248edb9 Merge pull request #18663 from BerriAI/litellm_staging_01_05_2026 
Staging 01/05/2026
 2026-01-06 10:46:04 +05:30
0717376andGitHub 12f02f6c54 feat: Add GigaChat provider support (#18564) 
* feat: Add GigaChat provider support

Add native support for GigaChat API (Sber AI, Russia's leading LLM).

Supported features:
- Chat completions (sync/async)
- Streaming (sync/async)
- Function calling / Tools
- Structured output via JSON schema (emulated through function calls)
- Image input (base64 and URL)
- Embeddings

Closes #18515

* fix: resolve mypy type errors in GigaChat handler

- Fix _prepare_file_data return type (use 3-tuple for cleaner type flow)
- Add type annotations for lists in _process_content_parts methods
- Add type annotations in _collapse_user_messages
- Use ChatCompletionToolCallChunk for proper tool_use typing
- Add type: ignore[override] for astreaming async generator

* refactor(gigachat): migrate to BaseConfig pattern

* fix: remove unused imports

* fix: resolve mypy type errors

* fix: mypy type errors

* refactor: address review feedback for GigaChat provider

- Remove singleton pattern, reuse litellm HTTPHandler
- Move constants/errors to transformation files, delete common_utils.py
- Add models to model_prices_and_context_window.json
- Fix ssl_verify not passed to HTTP client for embeddings

* docs: update GigaChat documentation with ssl_verify requirement
 2026-01-06 10:10:02 +05:30
YutaSaitoandGitHub a774e7899c Merge pull request #18281 from Eric84626/main 
Fix: fixed some MCP gateway oauth2 auth issues and ClosedResourceError
 2026-01-06 13:22:46 +09:00
YutaSaitoandGitHub 31470032ad Merge pull request #18681 from BerriAI/litellm_feat_mcp-server-visibility-configurable 
[feat] mcp server visibility configurable
 2026-01-06 12:53:07 +09:00
YutaSaitoandGitHub ccdcb20048 Merge pull request #18279 from mangabits/fix-otel-provider 
Use already configured opentelemetry providers
 2026-01-06 12:49:48 +09:00
LingXuanYin 499fc9f48a Align responses API streaming hooks with chat pipeline 2026-01-06 10:54:19 +08:00
Yuta Saito 694bcb6186 feat: add user_mcp_management_mode for view_all visibility 2026-01-06 11:22:28 +09:00
Eric84626andGitHub f59e9cef55 Merge branch 'main' into main 2026-01-06 06:57:25 +08:00
Yuta Saito a8092ab4c4 fix: ensure_async_clients_test error 2026-01-06 07:13:13 +09:00