d59e813b58
docs: add Vertex batch provider documentation and sidebar entry
2025-09-20 00:20:51 -03:00
dd89bae2ff
fix: add download prometheus.yml to avoid error ( #14725 )
2025-09-19 14:20:01 -07:00
afbb2fc20c
docs: v1.77.2.rc.2
2025-09-19 08:28:27 -07:00
aa54994994
Merge pull request #14666 from michaeltansg/feat/add-bangkok-timezone
...
Added Indochina Time timezone support for budget resets
2025-09-18 23:41:27 -07:00
ad6ba8f5c5
Merge pull request #14695 from uc4w6c/fix/mcp-gateway-tools-list
...
Fix/mcp gateway tools list
2025-09-18 23:40:14 -07:00
d5a839d971
Merge pull request #14700 from BerriAI/litellm_contributor_prs_09_18_2025_p2
...
Update Bedrock documentation for Titan V2 encoding_format support + Anthropic - account for 1h vs. 5m cache creation token cost difference + UI - add langsmith_sampling_rate as a dynamic param
2025-09-18 23:38:29 -07:00
2249badd2f
docs fix
2025-09-18 19:51:00 -07:00
8139569975
docs fix
2025-09-18 19:46:08 -07:00
63c26d7a4f
Merge branch 'litellm_contributor_prs_09_18_2025_p2' into fix/issue-14685-bedrock-titan-v2-encoding-format
2025-09-18 17:54:33 -07:00
4c983f985a
[Feat] Add Bedrock Twelve Labs embedding provider support ( #14697 )
...
* fix: add 12 labs to bedrock embedding
* fix: get_bedrock_embedding_provider
* test: test_text_embedding
* fix: 12 labs embedding transform
* fix: refactor 12 labs transform logic
* fix: test_e2e_bedrock_embedding
* fix: test_e2e_bedrock_embedding
* feat: add bedrock twelvelabs pricing
* DOCS: docs bedrock embedding
* DOCS: 12 labs bedrock overview
* fix: bedrock embeddings 12 labs
2025-09-18 17:16:45 -07:00
654f1d3290
fix: stop including spec_version in MCP server registration inserts
2025-09-19 07:06:15 +09:00
978cd80653
Update Bedrock documentation for Titan V2 encoding_format support
...
- Add encoding_format parameter to supported parameters table
- Document float and base64 encoding format options
- Add usage examples for both encoding formats
- Update parameter documentation for amazon.titan-embed-text-v2:0
2025-09-18 20:24:56 +02:00
6721189b7c
feat: add Asia/Bangkok timezone support for budget resets
...
- Add Asia/Bangkok (UTC+7) to timezone_map in duration_parser.py
- Update documentation to include Bangkok in common timezone values
- Add test case to verify Bangkok timezone functionality
2025-09-18 14:56:12 +07:00
8d96626044
fix: iscoroutine removed from hot path +50 RPS ( #14649 )
...
* fix: iscoroutine removed from hot path
* fix: replace all instances & separate concerns
1. Replaced all instances of iscoroutine with is_async_callable
2. Place the coroutine checker in its own file
* fix: PR comment changes
* fix: missing config setting declaration
* fix: revert non-performance related changes
* fix: revert to initial implementation
* fix: remove dead const
2025-09-17 19:01:43 -07:00
e2be7e0b1f
docs fix posthog
2025-09-17 17:02:23 -07:00
e168161e64
Feat/add posthog observability ( #14610 )
...
* feat: add posthog observability
* docs: add posthog logging docs
* docs: posthog integration in proxy mode
2025-09-17 08:24:04 -07:00
a74fda1159
Merge pull request #14625 from timelfrink/fix/mdx-compilation-error-compactifai
...
Fix: MDX compilation error in CompactifAI documentation
2025-09-16 23:06:50 -07:00
79d1992de0
Fix: MDX compilation error in CompactifAI documentation
...
- Replace (<5%) with (under 5%) in two locations to fix JSX parsing
- Resolves webpack build failure in Docusaurus documentation
- Maintains same meaning while avoiding MDX syntax conflicts
Fixes #14624
2025-09-17 07:50:38 +02:00
ef14270dec
Merge pull request #14448 from vvidovic/propagate_metadata_to_vertexai_labels_docs
...
Describing the `labels` field use in the Vertex AI
2025-09-16 22:46:28 -07:00
701b4fffee
Merge pull request #14600 from mubashir1osmani/fix_all_docs
...
docs: helicone integration and mcp
2025-09-16 22:37:38 -07:00
ab1fb2b2e7
Add Support for Bedrock Guardrails to supportive selective Guarding ( #14575 )
...
* Add Support for Bedrock Guardrails to supportive selective Guarding
* Add method for better handling
* Add guarded_text content type
* Add guarded_text content type
* Update Dockerfile
* Update Dockerfile
2025-09-16 16:43:34 -07:00
a2d5bde837
changed docs
2025-09-16 00:58:08 -04:00
3f90fe938d
Merge pull request #14514 from iabhi4/fix-13581
...
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-15 21:22:25 -07:00
f4e2870490
Merge pull request #14532 from timelfrink/feat/issue-14476-compactifai-provider
...
Add CompactifAI provider support
2025-09-15 21:15:00 -07:00
eb3e159b7c
docs update
2025-09-15 17:22:03 -07:00
9521414efa
Resolve merge conflict by including both CompactifAI and OVHCloud providers
...
- Keep CompactifAI provider detection logic
- Include new OVHCloud provider from main branch
- Both providers now work correctly with model prefix detection
2025-09-14 23:03:18 +02:00
6ac37093e5
Update CompactifAI model references and move tests to unit test directory
...
- Update all model references from llama-2-7b-compressed to cai-llama-3-1-8b-slim
- Move CompactifAI tests from tests/llm_translation to tests/test_litellm/llms/compactifai/
- Update documentation examples to use the new model name
- Remove integration test inheritance to make tests pure mock tests
This addresses review feedback to use mock tests and updated model naming.
2025-09-14 23:00:27 +02:00
dc27bccb45
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-14 12:04:43 -07:00
56fd60b140
Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider
...
feat: Add OVHCloud AI Endpoints as a provider
2025-09-14 00:45:08 -07:00
7ef8c808cf
docs: update doc
2025-09-14 00:28:11 -07:00
11822e63f1
Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail
...
feat: add tool-permission guardrail
2025-09-13 23:22:31 -07:00
f37dd6bb95
Litellm 1.77.2 stable notes ( #14544 )
...
* fix release notes instructions
* docs v1
* fix doc
* fix highlights
* docs fix
* docs fix
2025-09-13 18:41:34 -07:00
95da14cb96
Docs update on user header mapping ( #14527 )
2025-09-13 16:58:10 -07:00
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1
2025-09-13 10:10:30 -07:00
9ee9745781
docs(vllm.md): document new endpoint
2025-09-13 09:46:39 -07:00
38efd358eb
Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode
...
Noma non blocking monitor mode & anonymize input support
2025-09-13 09:41:41 -07:00
ad9515a81e
Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1
2025-09-13 09:38:43 -07:00
1987556a50
Add CompactifAI provider documentation and config
...
- Create comprehensive provider documentation with usage examples
- Cover basic completion, streaming, async, and function calling
- Document AWS Marketplace subscription and API key setup process
- Include proxy configuration and advanced parameter examples
- Add error handling examples and model information
- Update website sidebar to include CompactifAI in provider list
- Update README.md with CompactifAI provider reference
2025-09-13 08:42:56 +02:00
de8cf40ffa
Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3
...
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
2025-09-12 19:56:53 -07:00
8b3b943557
docs fix
2025-09-12 19:51:14 -07:00
05e3e3685b
docs(forward_client_headers.md): document new forwarding client headers to llm api feature
2025-09-12 19:38:07 -07:00
93af8fd6ba
[QA] E2E - Testing for bedrock batches api ( #14525 )
...
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0
* test_bedrock_batches_api
* fix
* fix import
* test_bedrock_batches_api
2025-09-12 19:31:19 -07:00
20c390dc71
[Docs] - Bedrock Batches API ( #14526 )
...
* docs bedrock batch
* docs fix
* docs bedrock batches
* fix Create Batch Request
* docs fix
2025-09-12 19:08:13 -07:00
bdd960c451
docs(admin_ui_sso.md): clarify sso usage on docs
2025-09-12 18:03:03 -07:00
1de7f076ac
feat: add tool-permission guardrail
2025-09-13 07:34:29 +09:00
54f49b430d
fix: edit readme to add OVHCloud
2025-09-12 14:29:33 +02:00
ef9d1ddc40
feat: Add OVHCloud AI Endpoints as a provider
2025-09-12 13:37:03 +02:00
c802c472b5
docs(debugging.md): document new feature
...
Closes https://github.com/BerriAI/litellm/issues/13814
2025-09-11 20:17:39 -07:00
dda115cc6d
[Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) ( #14471 )
...
* add dashscope logo
* docs fix
* docs fix
* fix supports_batch_calling
* fix naming
* fix input_cost_per_audio_token
* use output_cost_per_reasoning_token
* add tiered_pricing in get_model_info
* test fixes
* fix cost calc
* ruff fix
2025-09-11 18:14:39 -07:00
e6a6300b70
Describing the labels field use in the Vertex AI
2025-09-11 15:28:55 +02:00
Felipe Gare