Commit Graph
30881 Commits
Author SHA1 Message Date
91b5c66cf2 fix(proxy): return json error response instead of sse format for initial streaming errors (#18757)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* fix(proxy): return json error response instead of sse format for initial streaming errors

when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.

- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename

* test(proxy): add comprehensive tests for error extraction from sse chunks

- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:26:47 +05:30
Ishaan Jaffer 6c2408f957 litellm_mapped_tests_integrations 2026-01-07 21:22:10 +05:30
Ishaan Jaffer 6122ff9fce TestEncryptResponseId 2026-01-07 21:03:22 +05:30
Cesar GarciaandGitHub e34e8b4650 Fix component label automation to prevent false positives (#18765)
* Fix component label automation to prevent false positives

The GitHub Actions workflow was applying component labels (SDK, Proxy, UI Dashboard, Docs) too broadly by only checking if the component name appeared anywhere in the issue body. This caused issues to be mislabeled when users mentioned these terms in their descriptions.

Changes:
- Add more specific condition that checks for both the dropdown field header "What part of LiteLLM is this about?" AND the component name
- Applied to all 4 component labels: SDK, Proxy, UI Dashboard, and Docs
- Labels will now only be applied when users actually select the option from the dropdown

Fixes issues being incorrectly labeled with 'docs' and other component labels.

* Use more specific pattern to match dropdown selection exactly

Updated the label conditions to use a more precise pattern that matches
the dropdown header immediately followed by the selected value. This
prevents false positives when users mention component names in their
descriptions but select a different component.

Before: Checked for header AND component name anywhere in body
After: Checks for exact pattern "header\n\ncomponent"

This ensures labels are only applied when the component is actually
selected from the dropdown, not just mentioned in the issue text.

* Fix component label automation and require explicit user selection

This PR fixes two issues with component labeling:

1. **Improved label accuracy**: Updated the workflow to use exact pattern
   matching ("### What part of LiteLLM is this about?\n\nDocs") instead of
   broad substring matching. This prevents false positives where issues were
   mislabeled when users mentioned component names in their descriptions.

2. **Require explicit component selection**: Added empty string ('') as the
   first dropdown option to prevent GitHub from auto-selecting "SDK" as the
   default. Users must now consciously select which component their issue
   relates to.

Changes:
- Updated all component label conditions in label-component.yml workflow
- Added empty string as first option in bug_report.yml dropdown
- Added empty string as first option in feature_request.yml dropdown
- Labels only apply when users actually select a component from the dropdown

This ensures accurate labeling and prevents the default SDK label from
being applied to all new issues.
2026-01-07 20:01:14 +05:30
Ishaan Jaffer dc553440d3 pynacl==1.6.2 2026-01-07 18:50:32 +05:30
Ishaan Jaffer 9471d616fc aiohttp==3.13.3 2026-01-07 18:25:23 +05:30
Ishaan Jaffer b855ad5541 test_encode_decode_helpers_roundtrip_in_cache_context 2026-01-07 18:23:17 +05:30
Ishaan Jaffer dd67235d4d TestLevoIntegration 2026-01-07 18:17:22 +05:30
Ishaan Jaffer dd24252a9f bump: version 1.80.11 → 1.80.12 2026-01-07 18:11:14 +05:30
Ishaan Jaffer 407575efb3 test_completion_bedrock_claude_aws_session_token 2026-01-07 18:09:07 +05:30
Krish DholakiaandGitHub 80ead21c3a Litellm improve endpoint discovery (#18762)
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
drorIvryandGitHub 000913fa12 Hotfix - docs qualifire (#18724)
* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire
2026-01-07 17:23:12 +05:30
Ishaan Jaffer bdbbc9db62 run_secret_detection 2026-01-07 16:43:31 +05:30
Ishaan Jaffer ebdc2747e7 fix gigachat_models 2026-01-07 16:41:54 +05:30
Sameer KankuteandGitHub 7aca09397a Merge pull request #18758 from BerriAI/litellm_fix_image_editing
fix: test_azure_image_edit_cost_tracking
2026-01-07 15:37:05 +05:30
Sameer Kankute bb1f65c546 fix: test_azure_image_edit_cost_tracking 2026-01-07 15:22:13 +05:30
Ishaan Jaffer 45f840d274 test_azure_image_edit_cost_tracking 2026-01-07 15:12:51 +05:30
Ishaan Jaffer 5873cd4a32 test_completion_bedrock_titan_null_response 2026-01-07 15:09:44 +05:30
Ishaan Jaffer 49f4005001 fix 2026-01-07 15:07:32 +05:30
Ishaan Jaffer d56054e747 test_anthropic_messages_to_wildcard_model 2026-01-07 15:03:06 +05:30
Ishaan Jaffer 269771a7c9 test_bedrock_httpx_streaming 2026-01-07 15:02:10 +05:30
Ishaan Jaffer 645ca64780 a121 fixes 2026-01-07 15:00:49 +05:30
Ishaan Jaffer a5332a6d51 fix code qa check 2026-01-07 14:54:00 +05:30
Ishaan Jaffer 676e362d43 bump extrs 2026-01-07 14:40:30 +05:30
Ishaan Jaffer ee2b51b2d0 test_openai_image_edit_cost_tracking 2026-01-07 14:36:50 +05:30
Ishaan Jaffer bab43ee9dd fix list keys 2026-01-07 14:34:37 +05:30
Sameer Kankute fdb9679657 Add annotations to completions responses API bridge 2026-01-07 14:30:31 +05:30
Ishaan Jaffer 38ccfb4234 test_completion_claude_3_function_call_with_otel 2026-01-07 14:22:54 +05:30
Ishaan Jaffer fa1b387237 test_routing_strategy_init 2026-01-07 14:21:03 +05:30
Ishaan Jaffer 3530218930 fix aupload_container_file 2026-01-07 14:19:36 +05:30
Ishaan Jaffer b7798b7f7c fix metadata.cost_breakdown 2026-01-07 14:17:08 +05:30
Ishaan JaffandGitHub b5d74722ba Revert "Litellm fixes a2a sdk (#18748)" (#18752)
This reverts commit 1661707492.
2026-01-07 14:04:10 +05:30
Ishaan JaffandGitHub 1f141f0dbb [Feat] Litellm new endpoint add container file upload (#18743)
* init upload_container_file

* init upload_container_file

* _prepare_multipart_file_upload

* fix upload_container_file

* aupload_container_file, upload_container_file

* register_container_file_endpoints
2026-01-07 13:36:55 +05:30
Ishaan JaffandGitHub 861dac1c8d [Fix] A2a endpoint - fix timeout (#18747)
* fix DEFAULT_A2A_AGENT_TIMEOUT

* use DEFAULT_A2A_AGENT_TIMEOUT

* grpcio
2026-01-07 13:31:53 +05:30
Ishaan JaffandGitHub 1661707492 Litellm fixes a2a sdk (#18748)
* add a2a SDK to req

* fix
2026-01-07 13:31:45 +05:30
Sameer Kankute d3e24ab9cd Fix: Gemini generate content request with audio file id 2026-01-07 12:58:54 +05:30
yuneng-jiangandGitHub a912665a86 Merge pull request #18682 from BerriAI/litellm_ui_e2e_admin_settings
[Infra] UI - E2E Test: Can View Admin Setting Page
2026-01-06 23:25:28 -08:00
yuneng-jiangandGitHub f143a16e9b Merge pull request #18742 from BerriAI/litellm_ui_unit_test_coverage_05
[Infra] UI - Adding Unit Test for Coverage
2026-01-06 23:18:29 -08:00
yuneng-jiang 6fd7b1cf56 Adding unit tests for coverage 2026-01-06 22:46:06 -08:00
YutaSaitoandGitHub 9dd9f9fc43 Merge pull request #18738 from BerriAI/litellm_feat_allow_arize_project_name
[feat] allow configuring arize project name for OpenTelemetry service name
2026-01-07 15:01:28 +09:00
Sameer Kankute bf506378b8 Fix: tool content should be str 2026-01-07 11:01:31 +05:30
Yuta Saito e5be160ae0 docs: sets ARIZE_PROJECT_NAME 2026-01-07 14:27:16 +09:00
Yuta Saito 1d16a8526e feat: allow configuring project name for OpenTelemetry service name 2026-01-07 14:20:10 +09:00
Sameer Kankute cc45423294 Fix: Nonetype object has no method .get() for call tool 2026-01-07 10:42:02 +05:30
yuneng-jiangandGitHub 7dca991a5f Merge pull request #18736 from BerriAI/litellm_ui_team_settings_budget_duration
[Feature] UI - Reusable Duration Select + Team Update Member Budget Duration
2026-01-06 18:24:45 -08:00
yuneng-jiangandGitHub 4d7ed62456 Merge pull request #18735 from BerriAI/litellm_fs_team_member_budget_duration
[Feature] Allow editing team_member_budget_duration in /team/update
2026-01-06 18:24:34 -08:00
yuneng-jiang 8b3782b06a Reusable Duration Select and update team member budget UI 2026-01-06 18:15:16 -08:00
Stephen Matta b40a6a0f6c [Fix] Nova model detection for Bedrock provider (#17910)
Resolves issue #17910 where Amazon Nova models (like amazon.nova-pro-v1:0)
were incorrectly identified as Amazon Titan models, causing requests to
use textGenerationConfig instead of inferenceConfig.

The fix moves the "nova" check before the initial provider check on the
split model name. This ensures that models containing "nova" (like
amazon.nova-pro-v1:0 or amazon.nova-2-lite-v1:0) are correctly identified
as Nova models, rather than matching "amazon" first.
2026-01-06 21:12:30 -05:00
yuneng-jiang 2a6f2a3fb8 add team member budget duration in team/update 2026-01-06 17:43:17 -08:00
yuneng-jiangandGitHub 6078f4687e Merge pull request #18732 from BerriAI/litellm_ui_build_fix_3
[Infra] Fixing UI Build
2026-01-06 17:22:34 -08:00