Commit Graph

5193 Commits

Author SHA1 Message Date
houdataali cbb72045a3 fix(ui): use non-streaming method for endpoint v1/a2a/message/send in… (#19025)
* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Fix linter errors: remove unused imports and variables

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* Add end to end integration tests for batches

* chore: document temporary grype ignore for CVE-2019-1010022

* chore: add config option

* chore: add ALLOWED_CVES

* refetch after key create

* test: remove flaky azure oidc embedding test

* fixing build

* bump: version 1.80.15 → 1.80.16

* [Fix] MSFT SSO - allow setting custom MSFT Base URLs (#18977)

* fix TestCustomMicrosoftSSO

* init CustomMicrosoftSSO

* use CustomMicrosoftSSO

* docs fix

* docs fix

* [Feat] UI Feedback Form - why LiteLLM  (#18999)

* init survey prompt

* init survey modal

* init Survey Modal

* POST feedback hook

* survey Modal

* add other

* in product survey fixes

* fix survey prompt

* fix survey

* fix build

* ui new build

* [Feat] MSFT SSO - allow overriding env var attribute names  (#18998)

* add MSFT SSO constants

* fix MSFT SSO env vars

* test_microsoft_sso_handler_openid_from_response_with_custom_attributes

* Add pricing of azure_ai/claude-opus-4-5

* test: temporarily disable flaky responses_id_security tests

* fix(ui): use non-streaming method for endpoint v1/a2a/message/send in A2A playground

'

---------

Co-authored-by: Ephrim Stanley <ephrim.stanley@point72.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Sameer Kankute <sameer@berri.ai>
2026-01-14 03:29:10 +05:30
Ishaan Jaffer f5fc38dcf9 docs litellm cloud 2026-01-12 13:55:56 -08:00
Ishaan Jaffer 5c300b2414 docs fix 2026-01-12 09:50:40 -08:00
Sameer Kankute d3dbe4ffab Add preview to v1.80.15 release note 2026-01-12 22:36:43 +05:30
Sameer Kankute 4cf4d205ba Add preview to v1.80.15 release note 2026-01-12 22:14:14 +05:30
Sameer Kankute 9a27a52424 Merge pull request #18956 from BerriAI/litellm_staging_01_12_2026
Litellm staging 01 12 2026
2026-01-12 18:27:57 +05:30
Cesar Garcia c81cd081e9 feat(bedrock): add OpenAI-compatible service_tier parameter translation (#18091)
* feat(bedrock): add OpenAI-compatible service_tier parameter translation

Translates OpenAI's service_tier parameter (string) to Bedrock's
serviceTier format (object with type field).

* docs(bedrock): add OpenAI-compatible service_tier parameter documentation

Document the automatic translation from OpenAI-style service_tier
parameter to Bedrock's native serviceTier format.

* feat(bedrock): add service_tier to response when present

According to OpenAI's API documentation, when service_tier is sent in the
request, it should be returned in the response. This commit implements
this behavior for Bedrock Converse API to maintain compatibility with
OpenAI's API.

Changes:
- Added serviceTier field to ConverseResponseBlock type definition
- Moved ServiceTierBlock definition before ConverseResponseBlock to fix
  type reference order
- Added response transformation to map Bedrock serviceTier (object) to
  OpenAI service_tier (string format)
- Added 4 new tests for response transformation with service_tier

The service_tier is only added to the response when present in Bedrock's
response, maintaining backward compatibility.
2026-01-12 17:28:49 +05:30
Cesar Garcia 087ddee227 docs: update message content types link and add content types table (#18209)
* docs: update message content types link and add content types table

- Update "See All Message Values" link to point to main branch (line 664)
  instead of outdated commit 8600ec7 (line 392)
- Add Content Types table documenting all 6 multimodal content types:
  text, image_url, input_audio, video_url, file, document
- Link to existing docs for vision, audio, and document understanding

* docs: add type definition links for text and video_url

* docs: fix text type definition link to line 598

* docs: remove provider labels from file/document types

* docs: add examples for all content types per review feedback
2026-01-12 17:09:23 +05:30
Harshit Jain 3257cc7129 doc: updated pass_through with guided param (#18886) 2026-01-12 16:56:16 +05:30
Harshit Jain 45ac107bee doc: update load balancing and routing with enable_pre_call_checks (#18888) 2026-01-12 16:47:25 +05:30
Harshit Jain f9430d1cab docs: add Redis requirement warning for high-traffic deployments (#18892) 2026-01-12 16:46:52 +05:30
Ishaan Jaffer f768b698a9 docs fix 2026-01-11 11:57:23 -08:00
Ishaan Jaffer 1271044b06 1.80.15 2026-01-11 11:57:04 -08:00
Alexsander Hamir 624c9420b9 perf release notes (#18915) 2026-01-10 16:41:54 -08:00
yuneng-jiang 039e11cbe5 Endpoint activity writeup 2026-01-10 15:42:20 -08:00
Ishaan Jaffer 58bc308d47 docs levo ai 2026-01-10 15:07:58 -08:00
Ishaan Jaffer 451d240a41 fix 2026-01-10 15:05:38 -08:00
Ishaan Jaffer 64d029bce7 docs fix 2026-01-10 15:04:06 -08:00
Ishaan Jaffer a4758ab532 QA release notes 2026-01-10 14:57:16 -08:00
Ishaan Jaffer 17995c5192 rc1 writeup 2026-01-10 14:51:56 -08:00
Ishaan Jaffer 9b4f3308fc docs fix 2026-01-10 14:45:55 -08:00
Ishaan Jaffer f37ccca19c docs fix 2026-01-10 14:04:47 -08:00
Ishaan Jaffer ff8e9aeb5c Revert "Add support for Vertex AI API keys"
This reverts commit ad501048f3.
2026-01-10 13:39:49 -08:00
Ishaan Jaff c0cf8bc27d [Feat] Manus FILES API - Add File upload, get, delete, list (#18904)
* add MANUS get response

* init TwoStepFileUploadRequest

* init TwoStepFileUploadConfig

* add async_create_file to handle 2 step uploads

* init ManusFilesConfig

* add add get_provider_files_config MANUS

* fix validate_environment

* test_manus_files_api_e2e_all_methods

* aws fix base

* init files API MANUS

* test_manus_responses_api_with_file_upload

* mypy lint fixes

* fix BedrockFilesConfig

* manus docs

* docs manus

* mypy lint

* add add fix resposne api utils MANUS
2026-01-10 13:27:54 -08:00
yuneng-jiang 5c46053307 Adding image 2026-01-10 13:15:23 -08:00
yuneng-jiang ff938e7c27 v1.80.13 docs work in progress 2026-01-10 13:04:11 -08:00
Elkhan Eminov 062f5892da update OpenRouter docs to include embedding support (#18874) 2026-01-10 11:42:02 -08:00
DominikHallab fa2b0fb533 docs: Update header to be markdown bold by removing space (#18846) 2026-01-10 00:32:21 +05:30
Sameer Kankute 844c766c65 Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
Yuta Saito 022db6c9ed feat: add mcp registry 2026-01-09 15:07:39 +09:00
Sameer Kankute d9b275e62a Merge pull request #18806 from BerriAI/litellm_vertex_ai_api_key_support
[FEAT]: Add support for Vertex AI API keys
2026-01-09 09:44:36 +05:30
YutaSaito e678540843 Merge pull request #18836 from drorIvry/main
feat: added qualifire eval webhook
2026-01-09 11:06:45 +09:00
Yuta Saito c38294dc16 docs: add focus 2026-01-09 07:55:55 +09:00
YutaSaito 661f03058c Merge pull request #18802 from BerriAI/litellm_feat_focus_backend
[feat] Focus export support
2026-01-09 07:21:04 +09:00
Dror Ivry e6c41c8f47 docs 2026-01-09 00:08:47 +02:00
Dror Ivry 5793f8b866 docs 2026-01-09 00:08:03 +02:00
Dror Ivry 8ff4cb89e1 feat: added qualifire eval webhook 2026-01-09 00:03:26 +02:00
Cesar Garcia 7743c739a3 docs: fix PDF documentation inconsistency in Anthropic page (#18816)
Updated description to match the code example which uses `file`
content type with `file_data` field, instead of incorrectly
mentioning `image_url`.
2026-01-08 23:46:17 +05:30
Chongshun 60edf13a21 feat(tag-routing): support toggling tag matching between ANY and ALL (#18776) 2026-01-08 23:39:03 +05:30
Ishaan Jaff cbac70a4ec MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Sameer Kankute ad501048f3 Add support for Vertex AI API keys 2026-01-08 15:22:14 +05:30
Yuta Saito 790c80070f docs: add FOCUS env 2026-01-08 17:24:51 +09:00
Sameer Kankute af6883712e Add tests for kimi 2 bedrock model 2026-01-08 10:07:33 +05:30
Alexsander Hamir 98d7a428b6 Fix: Clarify database_connection_pool_limit applies per worker, not per instance (#18780) 2026-01-07 13:57:03 -08:00
Krish Dholakia c89a4115eb Update production proxy resource recommendations (#18771)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-08 00:37:12 +05:30
Ishaan Jaff 929af510fa [Feat] New provider - Add Azure BFL FLux for image edits (#18766)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs

* add Image Editing

* add azure ai image edits

* AzureFoundryFlux2ImageEditConfig

* TestAzureAIFlux2ImageEdit
2026-01-07 23:28:39 +05:30
Ishaan Jaff 3430325919 [Feat] Add Azure BFL - Flux 2 models (#18764)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs
2026-01-07 23:28:28 +05:30
Abliteration AI dc4ce7c5a2 feat: Add abliteration.ai provider (#18678)
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:46:54 +05:30
kothamah 1b8708fccc Litellm embeddings calltype fix for guardrail precallhook (#18740)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

* feat: allow configuring project name for OpenTelemetry service name

* docs: sets ARIZE_PROJECT_NAME

* added valid callType for bedrock guardrail pre hook

This is to resolve the error when bedrock guardrails are enabled and invoke the embedding models.   {"error":{"message":"'embeddings' is not a valid CallTypes","type":"None","param":"None","code":"500"}}*

* updated the test case to reflect valid callType

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
2026-01-07 21:40:36 +05:30
Kris Xia 91b5c66cf2 fix(proxy): return json error response instead of sse format for initial streaming errors (#18757)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* fix(proxy): return json error response instead of sse format for initial streaming errors

when the first chunk of a streaming response contains an error,
return a standard json error response instead of sse format.
this ensures clients receive properly formatted error responses
before the stream actually begins.

- rename create_streaming_response to create_response
- add logic to detect error in first chunk and return JSONResponse
- add _extract_error_from_sse_chunk helper function
- update all call sites to use the new function name
- update tests to reflect the function rename

* test(proxy): add comprehensive tests for error extraction from sse chunks

- Add new test class TestExtractErrorFromSSEChunk with 10 test cases
- Update existing tests to verify JSONResponse returned for initial streaming errors
- Add tests for error code as string, bytes input, invalid JSON, and edge cases
- Verify correct error format extraction from SSE chunks

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:26:47 +05:30