Commit Graph

4375 Commits

Author SHA1 Message Date
Krish Dholakia 64083111d3 (Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
(Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
2025-09-30 21:14:16 -07:00
Ishaan Jaff 0ca11eefde [Feat] Guardrails - add logging for important status fields (#15090)
* add StandardLoggingPayloadStatusFields

* add status_fields

* add StandardLoggingPayloadStatusFields

* noma guard: add_standard_logging_guardrail_information_to_request_data

* fix: StandardLoggingPayloadStatusFields

* fix tests

* fix StandardLoggingPayloadStatus

* get_standard_logging_object_payload

* test_bedrock_guardrail_status_failure

* fix: _get_status_fields

* fixes new guardrail tracing

* fix ruff
2025-09-30 18:38:07 -07:00
Ishaan Jaffer f46f9d3fd9 docs azure passthrough api fixes 2025-09-30 15:54:09 -07:00
Krish Dholakia c475723c67 Merge pull request #15044 from BerriAI/litellm_dev_09_29_2025_p1
MCP - enforce server permissions on call tools + Teams - add model specific tpm/rpm limits to teams on LiteLLM
2025-09-30 15:32:53 -07:00
Krish Dholakia 39d1d2a379 Merge pull request #14840 from eddierichter-amd/lemonade-integration
Add AMD Lemonade provider support
2025-09-30 12:34:30 -07:00
Ishaan Jaffer 45bfd2599c docs fix 2025-09-30 11:35:15 -07:00
Eddie Richter abaf77da43 Small updates to documentation 2025-09-30 12:12:24 -06:00
Eddie Richter 929510ef5d Adding unit tests and documentation 2025-09-30 12:12:24 -06:00
Krish Dholakia 551a171243 Merge pull request #15043 from cedarm/fix-remove-vertex-latest
fix: remove invalid vertex -latest models
2025-09-29 21:54:53 -07:00
Yuta Saito def4afedd7 doc: add missing api_key parameter 2025-09-30 12:52:17 +09:00
Krrish Dholakia 91f420160f docs(mcp.md): document oauth support 2025-09-29 13:47:21 -07:00
Ishaan Jaff 038863a1fe [Feat] Add new claude-sonnet-4-5 model family (#15041)
* add new claude-sonnet-4-5

* docs fix

* fix tool_use_system_prompt_tokens

* add anthropic.claude-sonnet-4-5-20250929 to bedrock converse models
2025-09-29 13:09:00 -07:00
Cedar Myers 5357b1e102 fix: remove invalid vertex -latest models 2025-09-29 16:04:33 -04:00
Krish Dholakia e7939b0521 Merge pull request #14983 from abhijitjavelin/main
Feat: Add Javelin standalone guardrails integration for LiteLLM Proxy
2025-09-28 17:59:07 -07:00
Cursor Agent c684a18e38 feat: Add OAuth2 auth and scheduled key rotation
Co-authored-by: teddy <teddy@berri.ai>
2025-09-28 16:39:35 +00:00
Krish Dholakia c328b4a036 Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia e6810b5f87 docs(mcp.md): add allow/disallowed tools to docs 2025-09-28 08:50:40 -07:00
eycjur 4f1e409082 use extra_query for get request 2025-09-28 18:03:32 +09:00
Sameer Kankute f510ac15f8 Merge branch 'main' into litellm_live_api_passthrough 2025-09-28 09:45:57 +05:30
abhijitjavelin aedcedb2b6 Merge branch 'BerriAI:main' into main 2025-09-28 07:53:06 +05:30
Krrish Dholakia db27600ce9 docs(mcp.md): update docs with new 'extra_headers' tutorial 2025-09-27 18:13:19 -07:00
Ishaan Jaff 6299f07e54 [Draft] v1.77.5 Release note (#14985)
* docs draft

* docs fix

* docs

* docs fix

* doc fix

* docs

* docs fix
2025-09-27 16:33:58 -07:00
Ishaan Jaffer c366036312 docs fix 2025-09-27 13:51:55 -07:00
Ishaan Jaffer 329e494094 docs notes 2025-09-27 13:50:44 -07:00
Ishaan Jaffer e270e0a797 docs fix 2025-09-27 13:42:15 -07:00
abhijitjavelin adea1bfbc4 Merge branch 'BerriAI:main' into main 2025-09-28 01:08:16 +05:30
Abhijit L 7bba372ac0 feat: add javelin guardrails 2025-09-28 01:07:08 +05:30
Krish Dholakia 3e3e3837a1 Merge branch 'main' into litellm_dev_09_24_2025_p1 2025-09-27 11:21:07 -07:00
Krrish Dholakia 5c6a863e40 docs: cleanup 2025-09-27 11:10:44 -07:00
Teddy Amkie fdfff39222 Add Azure passthrough documentation and sidebar entry (#14958)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-27 10:13:16 -07:00
Sameer Kankute 94edbd1b35 Merge pull request #14957 from BerriAI/main
merge main
2025-09-27 01:54:44 +05:30
Ishaan Jaff ea8d0bb7d5 fix: re-add scheduled rotations 2025-09-26 11:40:46 -07:00
Ishaan Jaff d04c6d4eea [Feat] Add new anthropic web fetch tool support (#14951)
* add web_fetch tool for ANTHROPIC_HOSTED_TOOLS

* add ANTHROPIC_BETA_HEADER_VALUES, ANTHROPIC_HOSTED_TOOLS

* feat: add web fetch tool anthropic

* test_anthropic_tool_use

* docs web fetch

* docs fix

* docs fix
2025-09-26 11:04:11 -07:00
Olivier Cornelis 6fe8c33448 docs: add documentation for additional cost-related keys in custom pricing (#14949)
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4) <aider@aider.chat>
2025-09-26 10:32:30 -07:00
Ishaan Jaff 360befa216 [Feat] Add support for Gemini 2.5 Flash and Flash-lite preview models (09-2025 release) (#14948)
* add gemini-2.5-flash-preview-09-2025

* docs add gemini-2.5-flash-preview-09-2025 model family
2025-09-26 09:51:38 -07:00
Krish Dholakia 79ebb2c95e Merge pull request #14888 from mrFranklin/feat/improve-opik
feat: improve opik integration code
2025-09-25 23:40:41 -07:00
Teddy Amkie 0e8f60fe67 Remove aiohttp_ prefix from config (#14920)
* Fix: Correct model name in load test advanced docs

Co-authored-by: teddy <teddy@berri.ai>

* Fix: Update load testing provider to openai/fake

Co-authored-by: teddy <teddy@berri.ai>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 16:09:41 -07:00
Sameer Kankute 1681bf7175 (Feat) Add BitBucket Integration for Prompt Management (#14882)
* Add bitbucket integration for prompt management

* remove not needed file

* remove not needed file

* Add the correct readme

* Add the correct readme

* fix test for bitbucket

* fix test for bitbucket
2025-09-25 15:51:00 -07:00
Teddy Amkie dcbccd1fea Corrected docs updates sept 2025 (#14916)
* docs: Corrected documentation updates from Sept 2025

This PR contains the actual intended documentation changes, properly synced with main:

 Real changes applied:
- Added AWS authentication link to bedrock guardrails documentation
- Updated Vertex AI with Gemini API alternative configuration
- Added async_post_call_success_hook code snippet to custom callback docs
- Added SSO free for up to 5 users information to enterprise and custom_sso docs
- Added SSO free information block to security.md
- Added cancel response API usage and curl example to response_api.md
- Added image for modifying default user budget via admin UI
- Re-ordered sidebars in documentation

 Sync issues resolved:
- Kept all upstream changes that were added to main after branch diverged
- Preserved Provider-Specific Metadata Parameters section that was added upstream
- Maintained proper curl parameter formatting (-d instead of -D)

This corrects the sync issues from the original PR #14769.

* docs: Restore missing files from original PR

Added back ~16 missing documentation files that were part of the original PR:

 Restored files:
- docs/my-website/docs/completion/usage.md
- docs/my-website/docs/fine_tuning.md
- docs/my-website/docs/getting_started.md
- docs/my-website/docs/image_edits.md
- docs/my-website/docs/image_generation.md
- docs/my-website/docs/index.md
- docs/my-website/docs/moderation.md
- docs/my-website/docs/observability/callbacks.md
- docs/my-website/docs/providers/bedrock.md
- docs/my-website/docs/proxy/caching.md
- docs/my-website/docs/proxy/config_settings.md
- docs/my-website/docs/proxy/db_deadlocks.md
- docs/my-website/docs/proxy/load_balancing.md
- docs/my-website/docs/proxy_api.md
- docs/my-website/docs/rerank.md

 Fixed context-caching issue:
- Restored provider_specific_params.md to main version (preserving Provider-Specific Metadata Parameters section)
- Your original PR didn't intend to modify this file - it was just a sync issue

Now includes all ~26 documentation files from the original PR #14769.

* docs: Remove files that were deleted in original PR

- Removed docs/my-website/docs/providers/azure_ai_img_edit.md (was deleted in original PR)
- sdk/headers.md was already not present

Now matches the complete intended changes from original PR #14769.

* docs: Restore azure_ai_img_edit.md from main

- Restored docs/my-website/docs/providers/azure_ai_img_edit.md from main branch
- This file should not have been deleted as it was a newer commit
- SDK headers file doesn't exist in main (was reverted) and wasn't part of your original changes

Fixes the file restoration issues.

* docs: Fix vertex.md - preserve context caching from newer commit

- Restored vertex.md to main version to preserve context caching content (lines 817-887)
- Added back only your intended change: alternative gemini config example
- Context caching content from newer commit is now preserved

Fixes the vertex.md sync issue where newer content was incorrectly deleted.

* docs: Fix providers/bedrock.md - restore deleted content from newer commit

- Restored providers/bedrock.md to main version
- Preserves 'Usage - Request Metadata' section that was added in newer commit
- Your actual intended change was to proxy/guardrails/bedrock.md (authentication tip) which is preserved
- Now only has additions, no subtractions as intended

Fixes the bedrock.md sync issue.

* docs: Restore missing IAM policy section in bedrock.md

Added back your intended IAM policy documentation that was lost when restoring main version:

 Added IAM AssumeRole Policy section:
- Explains requirement for sts:AssumeRole permission
- Shows error message example when permission missing
- Provides complete IAM policy JSON example
- Links to AWS AssumeRole documentation
- Clarifies trust policy requirements

Now bedrock.md has both:
- All newer content preserved (Request Metadata section)
- Your intended IAM policy addition restored

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:49:19 -07:00
Ishaan Jaff 2dd38420a7 [Feat] - Cost Tracking - show input, output, tool call cost breakdown in StandardLoggingPayload (#14921)
* add new CostBreakdown typed dict

* fix CostBreakdown type

* fix fix _store_cost_breakdown_in_logging_obj

* fix CostBreakdown

* test_cost_breakdown_in_standard_logging_payload
2025-09-25 15:48:22 -07:00
Teddy Amkie be44735de4 Update docs to reflect session management for all models (#14914)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:45:13 -07:00
Sameerlite 9d4eb814d4 initial int live api 2025-09-25 22:40:54 +05:30
mrFranklin f717e53d3f doc: update opik integration doc 2025-09-25 16:28:20 +08:00
mrFranklin 7f06b7bb4e doc: update opik integration doc 2025-09-25 16:26:34 +08:00
Ishaan Jaffer b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaff ded823a3a3 [Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
dependabot[bot] 268b66b7ea Bump tar-fs from 3.0.10 to 3.1.1 in /docs/my-website (#14872)
Bumps [tar-fs](https://github.com/mafintosh/tar-fs) from 3.0.10 to 3.1.1.
- [Commits](https://github.com/mafintosh/tar-fs/compare/v3.0.10...v3.1.1)

---
updated-dependencies:
- dependency-name: tar-fs
  dependency-version: 3.1.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-24 16:13:13 -07:00
Krish Dholakia e92a73d603 Merge pull request #14831 from otaviofbrito/minor/fix-context-caching-vertex
Vertex AI Context Caching: use Vertex ai API v1 instead of v1beta1 and accept 'cachedContent' param
2025-09-23 18:29:51 -07:00
Krish Dholakia 64a305f9dd Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Mubashir Osmani fc1c39645a docs: Letta Guide (#14798)
* fix: flaky passthrough tests

* Revert "fix: flaky passthrough tests"

This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* fix: serialize prisma objects

* docs: added letta

* arranged endpoints in alphabetical order

* added user_api_key fields to custom auth docs

* user onboarding

* cleaning up

This reverts commit 40e2aade73632cea371c6092d766ba193f9ac4a3.

* cleaning up
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* Revert "fix: serialize prisma objects"

This reverts commit 1e7bd13c26dcac8bff1f818c39b2b78f22f0ba28.
2025-09-23 16:18:57 -07:00