Commit Graph

4342 Commits

Author SHA1 Message Date
Ishaan Jaff d04c6d4eea [Feat] Add new anthropic web fetch tool support (#14951)
* add web_fetch tool for ANTHROPIC_HOSTED_TOOLS

* add ANTHROPIC_BETA_HEADER_VALUES, ANTHROPIC_HOSTED_TOOLS

* feat: add web fetch tool anthropic

* test_anthropic_tool_use

* docs web fetch

* docs fix

* docs fix
2025-09-26 11:04:11 -07:00
Olivier Cornelis 6fe8c33448 docs: add documentation for additional cost-related keys in custom pricing (#14949)
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4) <aider@aider.chat>
2025-09-26 10:32:30 -07:00
Ishaan Jaff 360befa216 [Feat] Add support for Gemini 2.5 Flash and Flash-lite preview models (09-2025 release) (#14948)
* add gemini-2.5-flash-preview-09-2025

* docs add gemini-2.5-flash-preview-09-2025 model family
2025-09-26 09:51:38 -07:00
Krish Dholakia 79ebb2c95e Merge pull request #14888 from mrFranklin/feat/improve-opik
feat: improve opik integration code
2025-09-25 23:40:41 -07:00
Teddy Amkie 0e8f60fe67 Remove aiohttp_ prefix from config (#14920)
* Fix: Correct model name in load test advanced docs

Co-authored-by: teddy <teddy@berri.ai>

* Fix: Update load testing provider to openai/fake

Co-authored-by: teddy <teddy@berri.ai>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 16:09:41 -07:00
Sameer Kankute 1681bf7175 (Feat) Add BitBucket Integration for Prompt Management (#14882)
* Add bitbucket integration for prompt management

* remove not needed file

* remove not needed file

* Add the correct readme

* Add the correct readme

* fix test for bitbucket

* fix test for bitbucket
2025-09-25 15:51:00 -07:00
Teddy Amkie dcbccd1fea Corrected docs updates sept 2025 (#14916)
* docs: Corrected documentation updates from Sept 2025

This PR contains the actual intended documentation changes, properly synced with main:

 Real changes applied:
- Added AWS authentication link to bedrock guardrails documentation
- Updated Vertex AI with Gemini API alternative configuration
- Added async_post_call_success_hook code snippet to custom callback docs
- Added SSO free for up to 5 users information to enterprise and custom_sso docs
- Added SSO free information block to security.md
- Added cancel response API usage and curl example to response_api.md
- Added image for modifying default user budget via admin UI
- Re-ordered sidebars in documentation

 Sync issues resolved:
- Kept all upstream changes that were added to main after branch diverged
- Preserved Provider-Specific Metadata Parameters section that was added upstream
- Maintained proper curl parameter formatting (-d instead of -D)

This corrects the sync issues from the original PR #14769.

* docs: Restore missing files from original PR

Added back ~16 missing documentation files that were part of the original PR:

 Restored files:
- docs/my-website/docs/completion/usage.md
- docs/my-website/docs/fine_tuning.md
- docs/my-website/docs/getting_started.md
- docs/my-website/docs/image_edits.md
- docs/my-website/docs/image_generation.md
- docs/my-website/docs/index.md
- docs/my-website/docs/moderation.md
- docs/my-website/docs/observability/callbacks.md
- docs/my-website/docs/providers/bedrock.md
- docs/my-website/docs/proxy/caching.md
- docs/my-website/docs/proxy/config_settings.md
- docs/my-website/docs/proxy/db_deadlocks.md
- docs/my-website/docs/proxy/load_balancing.md
- docs/my-website/docs/proxy_api.md
- docs/my-website/docs/rerank.md

 Fixed context-caching issue:
- Restored provider_specific_params.md to main version (preserving Provider-Specific Metadata Parameters section)
- Your original PR didn't intend to modify this file - it was just a sync issue

Now includes all ~26 documentation files from the original PR #14769.

* docs: Remove files that were deleted in original PR

- Removed docs/my-website/docs/providers/azure_ai_img_edit.md (was deleted in original PR)
- sdk/headers.md was already not present

Now matches the complete intended changes from original PR #14769.

* docs: Restore azure_ai_img_edit.md from main

- Restored docs/my-website/docs/providers/azure_ai_img_edit.md from main branch
- This file should not have been deleted as it was a newer commit
- SDK headers file doesn't exist in main (was reverted) and wasn't part of your original changes

Fixes the file restoration issues.

* docs: Fix vertex.md - preserve context caching from newer commit

- Restored vertex.md to main version to preserve context caching content (lines 817-887)
- Added back only your intended change: alternative gemini config example
- Context caching content from newer commit is now preserved

Fixes the vertex.md sync issue where newer content was incorrectly deleted.

* docs: Fix providers/bedrock.md - restore deleted content from newer commit

- Restored providers/bedrock.md to main version
- Preserves 'Usage - Request Metadata' section that was added in newer commit
- Your actual intended change was to proxy/guardrails/bedrock.md (authentication tip) which is preserved
- Now only has additions, no subtractions as intended

Fixes the bedrock.md sync issue.

* docs: Restore missing IAM policy section in bedrock.md

Added back your intended IAM policy documentation that was lost when restoring main version:

 Added IAM AssumeRole Policy section:
- Explains requirement for sts:AssumeRole permission
- Shows error message example when permission missing
- Provides complete IAM policy JSON example
- Links to AWS AssumeRole documentation
- Clarifies trust policy requirements

Now bedrock.md has both:
- All newer content preserved (Request Metadata section)
- Your intended IAM policy addition restored

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:49:19 -07:00
Ishaan Jaff 2dd38420a7 [Feat] - Cost Tracking - show input, output, tool call cost breakdown in StandardLoggingPayload (#14921)
* add new CostBreakdown typed dict

* fix CostBreakdown type

* fix fix _store_cost_breakdown_in_logging_obj

* fix CostBreakdown

* test_cost_breakdown_in_standard_logging_payload
2025-09-25 15:48:22 -07:00
Teddy Amkie be44735de4 Update docs to reflect session management for all models (#14914)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-09-25 15:45:13 -07:00
mrFranklin f717e53d3f doc: update opik integration doc 2025-09-25 16:28:20 +08:00
mrFranklin 7f06b7bb4e doc: update opik integration doc 2025-09-25 16:26:34 +08:00
Ishaan Jaffer b1e56c55ad merge 2025-09-24 22:11:37 -07:00
Ishaan Jaff ded823a3a3 [Feat] Initial support for scheduled key rotations (#14877)
* add KeyRotationSettings

* add KeyRotationManager

* add key rotation manager

* add KeyRotationManager

* fix _initialize_spend_tracking_background_jobs

* fix add_key_rotation_fields

* fixes

* new fields in schema

* update schema

* fix fixes for init key rotation manager

* fixes for init key rotation manager

* fix KeyRotationManager

* tests for key rotation

* fix key_rotation_settings

* fix KeyRotationManager

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix fixes for init key rotation manager

* ruff check fix

* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS

* fix _initialize_spend_tracking_background_jobs

* docs fix

* docs auto rotate

* schema fix

* bump proxy extras

* fix config.yml
2025-09-24 21:37:56 -07:00
dependabot[bot] 268b66b7ea Bump tar-fs from 3.0.10 to 3.1.1 in /docs/my-website (#14872)
Bumps [tar-fs](https://github.com/mafintosh/tar-fs) from 3.0.10 to 3.1.1.
- [Commits](https://github.com/mafintosh/tar-fs/compare/v3.0.10...v3.1.1)

---
updated-dependencies:
- dependency-name: tar-fs
  dependency-version: 3.1.1
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-24 16:13:13 -07:00
Krish Dholakia e92a73d603 Merge pull request #14831 from otaviofbrito/minor/fix-context-caching-vertex
Vertex AI Context Caching: use Vertex ai API v1 instead of v1beta1 and accept 'cachedContent' param
2025-09-23 18:29:51 -07:00
Krish Dholakia 64a305f9dd Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Mubashir Osmani fc1c39645a docs: Letta Guide (#14798)
* fix: flaky passthrough tests

* Revert "fix: flaky passthrough tests"

This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* fix: serialize prisma objects

* docs: added letta

* arranged endpoints in alphabetical order

* added user_api_key fields to custom auth docs

* user onboarding

* cleaning up

This reverts commit 40e2aade73632cea371c6092d766ba193f9ac4a3.

* cleaning up
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* Revert "fix: serialize prisma objects"

This reverts commit 1e7bd13c26dcac8bff1f818c39b2b78f22f0ba28.
2025-09-23 16:18:57 -07:00
Ishaan Jaff e0526c4554 [Fix] Priority Reservation: keys without priority metadata receive higher priority than keys with explicit priority configurations. (#14832)
* add PriorityReservationSettings

* add priority_reservation_settings

* add _get_priority_weight

* docs update
2025-09-23 15:45:05 -07:00
Otavio Brito 2e7d9d1822 update example 2025-09-23 19:09:03 -03:00
Otavio Brito d6c9406608 update context cache param 2025-09-23 18:31:04 -03:00
Ishaan Jaffer 45f835227b Revert "Merge pull request #14769 from TeddyAmkie/doc-updates-sept-2025"
This reverts commit 666bcac2af, reversing
changes made to b7803bcbb0.
2025-09-23 14:14:58 -07:00
Ishaan Jaffer 426c6fea9f Revert "Merge pull request #14761 from uzaxirr/feat/sdk-additional-headers"
This reverts commit 8628c265b9, reversing
changes made to be193fbffd.
2025-09-23 13:59:54 -07:00
Dharamendra Kumar 34f51a20eb Merge branch 'main' into reuse-aiohttp-session-http-handler 2025-09-23 10:36:35 -07:00
Krish Dholakia e377e30e95 Merge pull request #14775 from SmartManoj/patch-3
Docs: Update model references from gemini-pro to gemini-2.5-pro
2025-09-22 22:41:27 -07:00
Krish Dholakia af151e6ba8 Merge branch 'main' into doc-updates-sept-2025 2025-09-22 22:41:02 -07:00
Krish Dholakia 66f7e4a832 Merge pull request #14790 from eycjur/support_flux_image_edit
[Feat] Support flux image edit
2025-09-22 22:38:45 -07:00
eycjur f24d65b807 add docs 2025-09-23 02:51:19 +00:00
Krrish Dholakia 4c66e1f6bf docs(provider_specific_params.md): fix docs 2025-09-22 17:18:57 -07:00
மனோஜ்குமார் பழனிச்சாமி ed4c2b6883 Update model references from gemini-pro to gemini-2.5-pro 2025-09-22 15:28:11 +05:30
Krish Dholakia 9096d9cb25 Merge branch 'main' into feat/issue-14562-bedrock-converse-request-metadata 2025-09-21 21:26:37 -07:00
berri-teddy d9417f70bb Re-ordered sidebars in docs 2025-09-21 20:31:45 -07:00
berri-teddy 3bb24625ed Added image for modifying default user budget via admin UI 2025-09-21 18:45:43 -07:00
berri-teddy 8af3ecf3bd docs: add cancel response API usage and curl example to response_api.md 2025-09-21 18:36:03 -07:00
berri-teddy 665bf81baf Added SSO free for up to 5 users to several docs 2025-09-21 18:25:35 -07:00
berri-teddy 53201c7869 Add async_post_call_success_hook code snippet 2025-09-21 18:14:57 -07:00
berri-teddy 164b0294e4 Updated vertex with gemini api alternative config 2025-09-21 18:02:40 -07:00
berri-teddy 1c6667021a Linked authentication for AWS in bedrock guardrails doc 2025-09-21 17:47:28 -07:00
berri-teddy 97ec8f5b0e Added models.litellm.ai to various files for full models list 2025-09-21 17:42:24 -07:00
uzaxirr d8d5581f29 Resolve merge conflicts with main branch
- Accept main branch's consolidation of Cohere providers
- Preserve header implementation with proper three-tier merging
- Replace outdated header handling in Cohere sections with consolidated approach
- Maintain backward compatibility and functionality
2025-09-22 05:59:28 +05:30
berri-teddy 861ec4e18f Removed broken links to callback management guide as it didn't exist. Reformatted, and linked cookbooks 2025-09-21 17:17:33 -07:00
berri-teddy dc6c6fe4f5 Getting Started now has transform utils to show how requests are transformed in litellm 2025-09-21 16:47:10 -07:00
berri-teddy cdb7c99ab6 Max_connections in config_settings update 2025-09-21 16:03:53 -07:00
berri-teddy 23716c73d2 Add max_connections cache_params 2025-09-21 15:52:14 -07:00
berri-teddy 88e08c98fb Clarify IAM AssumeRole Policy requirement 2025-09-21 15:21:49 -07:00
berri-teddy 27a755eb84 Update docs to explainb bridging between endpoints and mode 2025-09-21 15:08:44 -07:00
uzaxirr 3986b073c9 feat: Add SDK support for additional headers 2025-09-21 14:58:14 +05:30
Ishaan Jaffer be193fbffd docs fix 2025-09-20 17:43:38 -07:00
Ishaan Jaffer b0c70fb2e0 docs fix 2025-09-20 17:42:56 -07:00
Ishaan Jaffer bfaa2c75ae docs fix 2025-09-20 17:33:52 -07:00
Ishaan Jaffer 78506d103e docs fix 2025-09-20 17:32:47 -07:00