3f4d2c6ada
Add Cohere Embed v4 support for AWS Bedrock
...
Add Cohere Embed v4 support for AWS Bedrock
2025-10-07 19:10:22 -07:00
a8243079d3
doc fix
2025-10-07 18:51:27 -07:00
36c971a6fd
[MCP Gateway] QA/Fixes - Ensure Team/Key level enforcement works for MCPs ( #15305 )
...
* fix: _set_object_permission
* fix: _set_object_permission on teams
* fix: _set_object_permission
* fixes for team/key permissions
* statsh: object permission view
* fix: MCPServerPermissions
* fix: _get_team_object_permission
* test mcp checks for permissions
* fix server checks with prefix names
* test_list_tools_strips_prefix_when_matching_permissions
* ruff fix
* docs - refactor MCP
* docs update MCP docs
* docs allowed tools
2025-10-07 17:34:48 -07:00
d71d801e4d
Add Cohere Embed v4 support for AWS Bedrock
...
- Add cohere.embed-v4:0 to model pricing configs
- Update bedrock_embedding_models constant
- Update documentation with v4 model support
Fixes #15272
2025-10-07 22:08:12 +02:00
c0d0424eb8
Added streaming support for response api streaming image generation ( #15269 )
2025-10-07 08:15:57 -07:00
faeb7484db
docs(vertex.md): fix doc
2025-10-06 20:45:58 -07:00
8b357c24c2
Merge pull request #15226 from otaviofbrito/chore/vertex-ai-context-caching
...
Chore/vertex ai context caching
2025-10-06 20:05:24 -07:00
1ad4ef267d
Add GPT-5 Pro model configuration and documentation ( #15258 )
...
- Added gpt-5-pro entry to model_prices_and_context_window.json with complete specifications
- Mode: responses (Responses API only)
- Pricing: $15.00 input / $120.00 output (Standard), $7.50 input / $60.00 output (Batch)
- Context: 400,000 input tokens, 272,000 output tokens
- Endpoints: /v1/batch, /v1/responses only
- Features: Web Search, Function Calling, Vision, PDF Input, Prompt Caching, Reasoning
- No streaming support, no Code Interpreter, no Computer Use
- Added gpt-5-pro to supported models list in docs/my-website/src/pages/completion/supported.md
- Added gpt-5-pro to OpenAI provider documentation in docs/my-website/docs/providers/openai.md
- Added comprehensive GPT-5 Pro Special Notes section with usage examples and limitations
2025-10-06 19:43:40 -07:00
1d468a59f3
[MCP Gateway] Fine-grained Database Object Storage Control ( #15255 )
...
* add supported_db_objects
* add _should_load_db_object
* add docs on storing MCP objects in DB
* test_should_load_db_object_with_supported_db_objects
* type fix
2025-10-06 19:31:44 -07:00
fbf7ca17ba
docs(security_encryption_faq.md): answers common questions about data at rest vs. in transit
2025-10-06 17:34:10 -07:00
b2a734c1f8
fix ttl tests
2025-10-06 09:30:23 -03:00
251d56ba5e
update docs
2025-10-05 23:47:24 -03:00
b348a26bdc
docs fix
2025-10-04 18:32:45 -07:00
b2dd50dd3e
docs key rotations
2025-10-04 18:29:01 -07:00
e58c2c5c3e
docs fix
2025-10-04 18:13:08 -07:00
163416c683
docs fix
2025-10-04 18:12:47 -07:00
6cf1806d3b
docs fix
2025-10-04 18:12:20 -07:00
bd2559e65e
docs fix
2025-10-04 18:11:58 -07:00
525b86687c
fix 1.77.7 stable
2025-10-04 18:11:01 -07:00
4e88e21266
docs fix
2025-10-04 18:04:11 -07:00
93022361e6
docs fix
2025-10-04 18:03:04 -07:00
d12da2e56e
docs fix
2025-10-04 18:02:04 -07:00
9d6c06dc7a
doc: perf update ( #15211 )
2025-10-04 17:59:08 -07:00
02cb7a4c3b
docs fix
2025-10-04 17:29:06 -07:00
8c495590b1
doc improvement
2025-10-04 17:21:41 -07:00
553801c7b4
docs
2025-10-04 17:21:00 -07:00
b7ca138a8d
docs(prometheus.md): fix
2025-10-04 16:23:54 -07:00
8dc53c0438
docs: document updates
2025-10-04 16:06:18 -07:00
cb385e080f
Fix "azure_ai/grok-4-fast-reasoning" entry in "model_prices_and_context_window.json" ( #15204 )
...
* fix: azure_ai/grok-4-fast-non-reasoning
* fix pricing
2025-10-04 14:50:44 -07:00
e1ee428573
docs fix
2025-10-04 13:20:39 -07:00
685e027d94
docs Dynamic Rate Limiter v3
2025-10-04 13:19:17 -07:00
c947994239
docs fix notes
2025-10-04 13:16:15 -07:00
22b6a82105
docs fix
2025-10-04 13:10:27 -07:00
7a176804f3
Add sync models GitHub documentation with Loom video and cross-references ( #15191 )
...
- Add comprehensive sync_models_github.md with API endpoints and examples
- Include Loom video tutorial for Admin UI sync process
- Add cross-references from model_management.md, cost_tracking.md, and ui.md
- Provide both manual and automated sync options
- Include Python SDK usage examples
2025-10-04 12:32:01 -07:00
29a31e17dd
[Doc] Perf: Last week improvement ( #15193 )
...
* doc: perf update
* fix: mixed up changes
* fix: add gist
2025-10-04 10:43:13 -07:00
10d6d72ae3
[Feat] VertexAI - Support googlemap grounding in vertex ai ( #15179 )
...
* add VertexToolName
* test_vertex_tool_params
* fix: working maps grounding
* test_gemini_google_maps_tool_simple
* test_vertex_ai_map_google_maps_tool_with_location
* fix # noqa: PLR0915
* _extract_google_maps_retrieval_config
* fixes for linting
* docs: **Google Maps**
2025-10-03 16:07:51 -07:00
3095f43e92
Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var
...
feature/add max requests env var
2025-10-03 15:30:15 -07:00
c5de073732
Merge pull request #15072 from speglich/fix/oci-support
...
Fix OCI Generative AI Integration when using Proxy
2025-10-03 15:29:21 -07:00
efa782d6d2
[Feat] Add Nvidia NIM Rerank Support ( #15152 )
...
* feat: add NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix: NvidiaNimRerankConfig
* fix routing to nvidia nim
* docs nvidia nim rerank
* TestNvidiaNim
* nvidia nim rerank fixes
* fix rerank
* transform_rerank_response
* Usage with LiteLLM Proxy
* fixes linting
* NvidiaNimRerankConfig.DEFAULT_NIM_RERANK_API_BASE
* fix Custom API Base URL
* fix rerank base
* fix main.py
* fix transform
* fix linting
* map_cohere_rerank_params
* ruff fix
* linting fixes
* ruff fix
2025-10-02 18:58:52 -07:00
544db8d140
(feat)Litellm x twelvelabs bedrock[Async Invoke Support] ( #14871 )
...
* Add async invoke support
* Add docs and correct embedding response
* fix cicd erros
* fix cicd erros
* fix mypy error
* Add litellm param input_type
* Update the docs
2025-10-02 18:52:33 -07:00
7b8426af53
Merge pull request #15130 from deepanshululla/feature/logging_payload_spec_update
...
Add provider name to payload specification
2025-10-02 17:29:24 -07:00
8991657d67
added railtracks to projects using litellm ( #15144 )
2025-10-02 14:21:38 -07:00
ebba9e0b2a
docs: cleanup docs
2025-10-02 09:51:16 -07:00
2512d89872
Add provider name to payload specification
2025-10-02 10:23:26 -04:00
cb39a1bb60
Merge pull request #15024 from kowyo/main
...
docs: use docker compose instead of docker-compose
2025-10-01 21:34:42 -07:00
68adca04c8
Gitlab based Prompt manager ( #14988 )
...
* add prompt
* add prompt
* add prompt
* add prompt
* add prompt management via gitlab
* gitlab client
* gitlab client
* gitlab client
* fix lint issues
* fix lint issues
* remove router changes
---------
Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com >
2025-10-01 18:13:11 -07:00
e73d053de3
[Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes ( #15115 )
...
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints
* fix: is_registered_pass_through_route
* docs fix
2025-10-01 14:09:01 -07:00
933b3979eb
docs: update oci docs with oci_serving_mode
2025-10-01 10:45:50 -03:00
64083111d3
(Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
...
(Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
2025-09-30 21:14:16 -07:00
0ca11eefde
[Feat] Guardrails - add logging for important status fields ( #15090 )
...
* add StandardLoggingPayloadStatusFields
* add status_fields
* add StandardLoggingPayloadStatusFields
* noma guard: add_standard_logging_guardrail_information_to_request_data
* fix: StandardLoggingPayloadStatusFields
* fix tests
* fix StandardLoggingPayloadStatus
* get_standard_logging_object_payload
* test_bedrock_guardrail_status_failure
* fix: _get_status_fields
* fixes new guardrail tracing
* fix ruff
2025-09-30 18:38:07 -07:00
Krish Dholakia