Commit Graph

29705 Commits

Author SHA1 Message Date
Yuta Saito 271ee0959b test: focus 2026-01-08 16:53:09 +09:00
Yuta Saito c00d83fea2 feat: add support focus export 2026-01-08 16:48:06 +09:00
Yuta Saito 3af9bab6a5 feat: add focus schema 2026-01-08 12:17:14 +09:00
Yuta Saito 565a622cf9 feat: scaffold Focus export logging skeleton 2026-01-08 12:09:58 +09:00
YutaSaito 9dd9f9fc43 Merge pull request #18738 from BerriAI/litellm_feat_allow_arize_project_name
[feat] allow configuring arize project name for OpenTelemetry service name
2026-01-07 15:01:28 +09:00
Yuta Saito e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Yuta Saito 1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
yuneng-jiang 7dca991a5f Merge pull request #18736 from BerriAI/litellm_ui_team_settings_budget_duration
[Feature] UI - Reusable Duration Select + Team Update Member Budget Duration
2026-01-06 18:24:45 -08:00
yuneng-jiang 4d7ed62456 Merge pull request #18735 from BerriAI/litellm_fs_team_member_budget_duration
[Feature] Allow editing team_member_budget_duration in /team/update
2026-01-06 18:24:34 -08:00
yuneng-jiang 8b3782b06a Reusable Duration Select and update team member budget UI 2026-01-06 18:15:16 -08:00
yuneng-jiang 2a6f2a3fb8 add team member budget duration in team/update 2026-01-06 17:43:17 -08:00
yuneng-jiang 6078f4687e Merge pull request #18732 from BerriAI/litellm_ui_build_fix_3
[Infra] Fixing UI Build
2026-01-06 17:22:34 -08:00
yuneng-jiang ae7df51e69 Fixing e2e 2026-01-06 17:06:48 -08:00
yuneng-jiang 8878b43466 Adding timeout for flaky test 2026-01-06 16:56:54 -08:00
YutaSaito c6b1e0512f Merge pull request #18726 from gkarthi-signoz/main
[Docs]: Adding SigNoz integration to observability docs
2026-01-07 09:47:18 +09:00
yuneng-jiang 874e8d1a6e Fixing build 2026-01-06 16:33:08 -08:00
Goutham Karthi 2865b17988 adding signoz integration to observability docs 2026-01-06 15:29:44 -08:00
Alexsander Hamir bb4c01ffa0 Add LITELLM_DISABLE_LAZY_LOADING env var to fix VCR cassette creation issue (#18725) 2026-01-06 14:49:11 -08:00
Otavio Brito 18ca6b2add Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665)
* Handle not supported region for vertex ai count tokens

* add unit test
2026-01-07 00:05:00 +05:30
Lundin Matthews 762345172c Add LlamaGate as a new provider (#18673)
Adds LlamaGate (https://llamagate.dev) as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 17 models across categories:
  - General purpose (Llama 3.1/3.2, Mistral, Qwen, Dolphin)
  - Reasoning (DeepSeek R1, OpenThinker)
  - Code (Qwen Coder, DeepSeek Coder, CodeLlama)
  - Vision (Qwen VL, LLaVA, Gemma 3)
  - Embeddings (Nomic, Qwen3 Embedding)

Provider details:
- Base URL: https://api.llamagate.dev/v1
- Auth: Bearer token via LLAMAGATE_API_KEY
- Pricing: $0.02-$0.55 per 1M tokens
- All models are open-weights
2026-01-07 00:00:30 +05:30
Lize Cai fe9b05e23e Add header for SAP AI Core Tracking (#18714)
Signed-off-by: Lize Cai <lize.cai@sap.com>
2026-01-06 23:59:02 +05:30
Rohit Ravikant Rane a7c39ccc12 fix(router): correct num_retries tracking in retry logic (#18712)
* fix(router): correct num_retries tracking in retry logic

- Fix off-by-one error in num_retries attribute when retries exhausted
- Correct remaining_retries calculation
- Add comprehensive tests for retry tracking edge cases

Fixes incorrect retry count in error messages and logging

* chore: trigger CI re-run

* chore: trigger CI tests again
2026-01-06 23:58:41 +05:30
Kazuki Matsumaru 26bdf7b7a8 Remove redundant comments about setting litellm.callbacks (#18711)
- Removed duplicate comment in test_router_endpoints.py
- Removed duplicate comment in logging.md
- Kept clearer comment: 'Set litellm.callbacks = [proxy_handler_instance] on the proxy'
2026-01-06 23:58:01 +05:30
Isaac Reis a17757159c add amazon.nova-2-multimodal-embeddings-v1:0 to model_prices_and_context_window.json (#18710) 2026-01-06 23:57:35 +05:30
Pascal Bro cac2a8d158 Fix/gcs cache docs missing for proxy mode (#13328)
* fixed issues with gcs cache to verify functionality

* restore changes

* Fix capitalization of 'S3 Bucket Cache'

---------

Co-authored-by: Nelson Alfonso <45660392+Dashing-Nelson@users.noreply.github.com>
2026-01-06 23:49:08 +05:30
Kris Xia 5e00a49e7f fix(streaming): normalize status code extraction to prevent 4xx errors from triggering mid-stream fallback (#18698)
在流式处理错误时,添加状态码标准化逻辑,确保 4xx 客户端错误直接抛出而不是被包装成 MidStreamFallbackError。

- 新增 _normalize_status_code 函数用于从异常对象提取状态码
- 优先从异常的 status_code 属性获取,其次从 response.status_code 获取
- 当映射异常或原始异常的状态码在 400-499 范围内时,直接抛出映射异常
- 添加单元测试验证 Vertex AI 400 错误正确抛出为 BadRequestError
- 确保流式处理中的客户端错误能够正确传播,而不会触发回退机制
2026-01-06 23:41:23 +05:30
Ishaan Jaff 69aa111fdd [UI] - Feat add request provider form on UI (#18704)
* add request provider form

* fix link to github

* add button

* fix link
2026-01-06 18:54:57 +05:30
Sameer Kankute ce0f71fbe9 Merge pull request #18706 from BerriAI/litellm_fix_reasoning_summary_default
[Bug] fix model map
2026-01-06 18:31:33 +05:30
Sameer Kankute 0cd92e895f fix model map 2026-01-06 18:14:00 +05:30
Sameer Kankute e3cbd5ff56 Merge pull request #18705 from BerriAI/litellm_fix_reasoning_summary_default
Add the LITELLM_REASONING_AUTO_SUMMARY in doc
2026-01-06 18:05:55 +05:30
Sameer Kankute 1c177a576b Add the LITELLM_REASONING_AUTO_SUMMARY in doc 2026-01-06 18:04:09 +05:30
Sameer Kankute 353769d2ac Merge pull request #18688 from BerriAI/litellm_fix_reasoning_summary_default
[Fix] Put automatic reasoning summary inclusion behind feat flag
2026-01-06 17:56:40 +05:30
Sameer Kankute aca656f036 Merge pull request #18702 from BerriAI/litellm_fix_mapped_test_3
fix: remove display name
2026-01-06 16:35:24 +05:30
Sameer Kankute ffc462465d fix: remove display name 2026-01-06 16:31:07 +05:30
Ishaan Jaff 76eda472be [Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697)
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
2026-01-06 16:24:04 +05:30
Sameer Kankute 2e668d1dfe Merge pull request #18701 from BerriAI/revert-17330-add-model-metadata
Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries"
2026-01-06 15:30:19 +05:30
Sameer Kankute 2baec27657 Revert "feat(model_cost): add display_name, model_vendor, and model_version metadata to model entries" 2026-01-06 15:29:42 +05:30
Sameer Kankute eb0193a8a5 Merge pull request #18695 from BerriAI/litellm_fix_mapped_test_060126
Fix mapped test 060126
2026-01-06 15:05:19 +05:30
Sameer Kankute 84b24ad030 fix:mypy mcp management 2026-01-06 14:48:31 +05:30
Sameer Kankute 15a28c7fe2 fix:test_api_error_handling 2026-01-06 14:44:34 +05:30
Sameer Kankute 0d050dc0ea fix:test_anthropic_beta_header 2026-01-06 14:28:30 +05:30
Sameer Kankute 8aff258a93 fix: test_databricks_embeddings[True] 2026-01-06 14:20:30 +05:30
Sameer Kankute 386ea1354a fix: async def test_bedrock_apply_guardrail_blocked() 2026-01-06 14:15:06 +05:30
Sameer Kankute 9c795a2baa fix: test_all_models_have_display_name 2026-01-06 14:09:43 +05:30
Sameer Kankute a087df365e fix: test_aaamodel_prices_and_context_window_json_is_valid 2026-01-06 14:04:09 +05:30
Sameer Kankute 865c7a2215 fix: test_update_ui_settings_allowlisted_value 2026-01-06 13:58:37 +05:30
Sameer Kankute 9d59d3eef6 fix: test_secret_manager_failure_does_not_block_email 2026-01-06 13:58:15 +05:30
Sameer Kankute 9f65f82c56 Fix: ImportError: qualifire package is required for QualifireGuardrail. Install it with: pip install qualifire 2026-01-06 13:52:26 +05:30
YutaSaito facc4b0b79 Merge pull request #18693 from BerriAI/litellm_fix_main_test
fix main test
2026-01-06 17:17:33 +09:00
Yuta Saito ca14160375 Revert "fix: model eol"
This reverts commit 5aa1665d79.
2026-01-06 16:49:30 +09:00