Commit Graph

4299 Commits

Author SHA1 Message Date
berri-teddy dc6c6fe4f5 Getting Started now has transform utils to show how requests are transformed in litellm 2025-09-21 16:47:10 -07:00
berri-teddy cdb7c99ab6 Max_connections in config_settings update 2025-09-21 16:03:53 -07:00
berri-teddy 23716c73d2 Add max_connections cache_params 2025-09-21 15:52:14 -07:00
berri-teddy 88e08c98fb Clarify IAM AssumeRole Policy requirement 2025-09-21 15:21:49 -07:00
berri-teddy 27a755eb84 Update docs to explainb bridging between endpoints and mode 2025-09-21 15:08:44 -07:00
Ishaan Jaffer be193fbffd docs fix 2025-09-20 17:43:38 -07:00
Ishaan Jaffer b0c70fb2e0 docs fix 2025-09-20 17:42:56 -07:00
Ishaan Jaffer bfaa2c75ae docs fix 2025-09-20 17:33:52 -07:00
Ishaan Jaffer 78506d103e docs fix 2025-09-20 17:32:47 -07:00
Ishaan Jaffer 41ce31bd1b docs fix 2025-09-20 17:30:03 -07:00
Ishaan Jaffer fce28a4c84 docs fix 2025-09-20 17:24:04 -07:00
Ishaan Jaffer ea24d88458 docs fix 2025-09-20 17:22:41 -07:00
Ishaan Jaff 10de012e12 [Docs] - v1.77.3 (#14751)
* fix sidebar

* v1

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix
2025-09-20 15:23:44 -07:00
Ishaan Jaffer 39cb7f67f0 fix sidebar 2025-09-20 12:30:55 -07:00
Ishaan Jaffer d8d4e46c97 docs fix 2025-09-20 10:24:55 -07:00
Ishaan Jaffer 374a903ff0 docs fix 2025-09-20 09:13:20 -07:00
Krish Dholakia 981e8470ef Merge pull request #14578 from timelfrink/fix/issue-14373-bedrock-inference-profiles
Fix: Bedrock inference profiles for Nova Canvas image generation
2025-09-19 23:31:23 -07:00
Felipe Gare d59e813b58 docs: add Vertex batch provider documentation and sidebar entry 2025-09-20 00:20:51 -03:00
tosi dd89bae2ff fix: add download prometheus.yml to avoid error (#14725) 2025-09-19 14:20:01 -07:00
Ishaan Jaffer afbb2fc20c docs: v1.77.2.rc.2 2025-09-19 08:28:27 -07:00
Krish Dholakia aa54994994 Merge pull request #14666 from michaeltansg/feat/add-bangkok-timezone
Added Indochina Time timezone support for budget resets
2025-09-18 23:41:27 -07:00
Krish Dholakia ad6ba8f5c5 Merge pull request #14695 from uc4w6c/fix/mcp-gateway-tools-list
Fix/mcp gateway tools list
2025-09-18 23:40:14 -07:00
Krish Dholakia d5a839d971 Merge pull request #14700 from BerriAI/litellm_contributor_prs_09_18_2025_p2
Update Bedrock documentation for Titan V2 encoding_format support + Anthropic - account for 1h vs. 5m cache creation token cost difference + UI - add langsmith_sampling_rate as a dynamic param
2025-09-18 23:38:29 -07:00
Ishaan Jaffer 2249badd2f docs fix 2025-09-18 19:51:00 -07:00
Ishaan Jaffer 8139569975 docs fix 2025-09-18 19:46:08 -07:00
Krish Dholakia 63c26d7a4f Merge branch 'litellm_contributor_prs_09_18_2025_p2' into fix/issue-14685-bedrock-titan-v2-encoding-format 2025-09-18 17:54:33 -07:00
Ishaan Jaff 4c983f985a [Feat] Add Bedrock Twelve Labs embedding provider support (#14697)
* fix: add 12 labs to bedrock embedding

* fix: get_bedrock_embedding_provider

* test: test_text_embedding

* fix: 12 labs embedding transform

* fix: refactor 12 labs transform logic

* fix: test_e2e_bedrock_embedding

* fix: test_e2e_bedrock_embedding

* feat: add bedrock twelvelabs pricing

* DOCS: docs bedrock embedding

* DOCS: 12 labs bedrock overview

* fix: bedrock embeddings 12 labs
2025-09-18 17:16:45 -07:00
Yuta Saito 654f1d3290 fix: stop including spec_version in MCP server registration inserts 2025-09-19 07:06:15 +09:00
Tim Elfrink 978cd80653 Update Bedrock documentation for Titan V2 encoding_format support
- Add encoding_format parameter to supported parameters table
- Document float and base64 encoding format options
- Add usage examples for both encoding formats
- Update parameter documentation for amazon.titan-embed-text-v2:0
2025-09-18 20:24:56 +02:00
Tim Elfrink cb573f61c8 Document model_id parameter for Bedrock inference profiles with image generation
Add documentation for using AWS Bedrock Application Inference Profiles
with image generation APIs, specifically for Nova Canvas models.

The documentation includes:
- SDK examples showing model_id parameter usage
- Proxy configuration examples
- Follows the same pattern as chat completions inference profiles
2025-09-18 10:57:12 +02:00
Michael Tan 6721189b7c feat: add Asia/Bangkok timezone support for budget resets
- Add Asia/Bangkok (UTC+7) to timezone_map in duration_parser.py
- Update documentation to include Bangkok in common timezone values
- Add test case to verify Bangkok timezone functionality
2025-09-18 14:56:12 +07:00
Alexsander Hamir 8d96626044 fix: iscoroutine removed from hot path +50 RPS (#14649)
* fix: iscoroutine removed from hot path

* fix: replace all instances & separate concerns

1. Replaced all instances of iscoroutine with is_async_callable
2. Place the coroutine checker in its own file

* fix: PR comment changes

* fix: missing config setting declaration

* fix: revert non-performance related changes

* fix: revert to initial implementation

* fix: remove dead const
2025-09-17 19:01:43 -07:00
Ishaan Jaffer e2be7e0b1f docs fix posthog 2025-09-17 17:02:23 -07:00
Carlos Marchal e168161e64 Feat/add posthog observability (#14610)
* feat: add posthog observability

* docs: add posthog logging docs

* docs: posthog integration in proxy mode
2025-09-17 08:24:04 -07:00
Krish Dholakia a74fda1159 Merge pull request #14625 from timelfrink/fix/mdx-compilation-error-compactifai
Fix: MDX compilation error in CompactifAI documentation
2025-09-16 23:06:50 -07:00
Tim Elfrink 79d1992de0 Fix: MDX compilation error in CompactifAI documentation
- Replace (<5%) with (under 5%) in two locations to fix JSX parsing
- Resolves webpack build failure in Docusaurus documentation
- Maintains same meaning while avoiding MDX syntax conflicts

Fixes #14624
2025-09-17 07:50:38 +02:00
Krish Dholakia ef14270dec Merge pull request #14448 from vvidovic/propagate_metadata_to_vertexai_labels_docs
Describing the `labels` field use in the Vertex AI
2025-09-16 22:46:28 -07:00
Krish Dholakia 701b4fffee Merge pull request #14600 from mubashir1osmani/fix_all_docs
docs: helicone integration and mcp
2025-09-16 22:37:38 -07:00
Sameer Kankute ab1fb2b2e7 Add Support for Bedrock Guardrails to supportive selective Guarding (#14575)
* Add Support for Bedrock Guardrails to supportive selective Guarding

* Add method for better handling

* Add guarded_text content type

* Add guarded_text content type

* Update Dockerfile

* Update Dockerfile
2025-09-16 16:43:34 -07:00
mubashir1osmani a2d5bde837 changed docs 2025-09-16 00:58:08 -04:00
Krish Dholakia 3f90fe938d Merge pull request #14514 from iabhi4/fix-13581
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-15 21:22:25 -07:00
Krish Dholakia f4e2870490 Merge pull request #14532 from timelfrink/feat/issue-14476-compactifai-provider
Add CompactifAI provider support
2025-09-15 21:15:00 -07:00
Ishaan Jaffer eb3e159b7c docs update 2025-09-15 17:22:03 -07:00
Tim Elfrink 9521414efa Resolve merge conflict by including both CompactifAI and OVHCloud providers
- Keep CompactifAI provider detection logic
- Include new OVHCloud provider from main branch
- Both providers now work correctly with model prefix detection
2025-09-14 23:03:18 +02:00
Tim Elfrink 6ac37093e5 Update CompactifAI model references and move tests to unit test directory
- Update all model references from llama-2-7b-compressed to cai-llama-3-1-8b-slim
- Move CompactifAI tests from tests/llm_translation to tests/test_litellm/llms/compactifai/
- Update documentation examples to use the new model name
- Remove integration test inheritance to make tests pure mock tests

This addresses review feedback to use mock tests and updated model naming.
2025-09-14 23:00:27 +02:00
iabhi4 dc27bccb45 feat(proxy): Assign default budget to auto-generated JWT teams 2025-09-14 12:04:43 -07:00
Krish Dholakia 56fd60b140 Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider
feat: Add OVHCloud AI Endpoints as a provider
2025-09-14 00:45:08 -07:00
Krrish Dholakia 7ef8c808cf docs: update doc 2025-09-14 00:28:11 -07:00
Krish Dholakia 11822e63f1 Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail
feat: add tool-permission guardrail
2025-09-13 23:22:31 -07:00
Ishaan Jaff f37dd6bb95 Litellm 1.77.2 stable notes (#14544)
* fix release notes instructions

* docs v1

* fix doc

* fix highlights

* docs fix

* docs fix
2025-09-13 18:41:34 -07:00