Commit Graph

5306 Commits

Author SHA1 Message Date
Ishaan Jaffer 4e88e21266 docs fix 2025-10-04 18:04:11 -07:00
Ishaan Jaffer 93022361e6 docs fix 2025-10-04 18:03:04 -07:00
Ishaan Jaffer d12da2e56e docs fix 2025-10-04 18:02:04 -07:00
Alexsander Hamir 9d6c06dc7a doc: perf update (#15211) 2025-10-04 17:59:08 -07:00
Ishaan Jaffer 02cb7a4c3b docs fix 2025-10-04 17:29:06 -07:00
Ishaan Jaffer 8c495590b1 doc improvement 2025-10-04 17:21:41 -07:00
Ishaan Jaffer 553801c7b4 docs 2025-10-04 17:21:00 -07:00
Krrish Dholakia b7ca138a8d docs(prometheus.md): fix 2025-10-04 16:23:54 -07:00
Krrish Dholakia 8dc53c0438 docs: document updates 2025-10-04 16:06:18 -07:00
Ishaan Jaff cb385e080f Fix "azure_ai/grok-4-fast-reasoning" entry in "model_prices_and_context_window.json" (#15204)
* fix: azure_ai/grok-4-fast-non-reasoning

* fix pricing
2025-10-04 14:50:44 -07:00
Ishaan Jaffer e1ee428573 docs fix 2025-10-04 13:20:39 -07:00
Ishaan Jaffer 685e027d94 docs Dynamic Rate Limiter v3 2025-10-04 13:19:17 -07:00
Ishaan Jaffer c947994239 docs fix notes 2025-10-04 13:16:15 -07:00
Ishaan Jaffer 22b6a82105 docs fix 2025-10-04 13:10:27 -07:00
Teddy Amkie 7a176804f3 Add sync models GitHub documentation with Loom video and cross-references (#15191)
- Add comprehensive sync_models_github.md with API endpoints and examples
- Include Loom video tutorial for Admin UI sync process
- Add cross-references from model_management.md, cost_tracking.md, and ui.md
- Provide both manual and automated sync options
- Include Python SDK usage examples
2025-10-04 12:32:01 -07:00
Alexsander Hamir 29a31e17dd [Doc] Perf: Last week improvement (#15193)
* doc: perf update

* fix: mixed up changes

* fix: add gist
2025-10-04 10:43:13 -07:00
Ishaan Jaff 10d6d72ae3 [Feat] VertexAI - Support googlemap grounding in vertex ai (#15179)
* add VertexToolName

* test_vertex_tool_params

* fix: working maps grounding

* test_gemini_google_maps_tool_simple

* test_vertex_ai_map_google_maps_tool_with_location

* fix  # noqa: PLR0915

* _extract_google_maps_retrieval_config

* fixes for linting

* docs: **Google Maps**
2025-10-03 16:07:51 -07:00
Krish Dholakia 3095f43e92 Merge pull request #15007 from TobiMayr/feature/add-max-requests-env-var
feature/add max requests env var
2025-10-03 15:30:15 -07:00
Krish Dholakia c5de073732 Merge pull request #15072 from speglich/fix/oci-support
Fix OCI Generative AI  Integration when using Proxy
2025-10-03 15:29:21 -07:00
Ishaan Jaff efa782d6d2 [Feat] Add Nvidia NIM Rerank Support (#15152)
* feat: add NvidiaNimRerankConfig

* fix: NvidiaNimRerankConfig

* fix: NvidiaNimRerankConfig

* fix routing to nvidia nim

* docs nvidia nim rerank

* TestNvidiaNim

* nvidia nim rerank fixes

* fix rerank

* transform_rerank_response

* Usage with LiteLLM Proxy

* fixes linting

* NvidiaNimRerankConfig.DEFAULT_NIM_RERANK_API_BASE

* fix Custom API Base URL

* fix rerank base

* fix main.py

* fix transform

* fix linting

* map_cohere_rerank_params

* ruff fix

* linting fixes

* ruff fix
2025-10-02 18:58:52 -07:00
Sameer Kankute 544db8d140 (feat)Litellm x twelvelabs bedrock[Async Invoke Support] (#14871)
* Add async invoke support

* Add docs and correct embedding response

* fix cicd erros

* fix cicd erros

* fix mypy error

* Add litellm param input_type

* Update the docs
2025-10-02 18:52:33 -07:00
Krish Dholakia 7b8426af53 Merge pull request #15130 from deepanshululla/feature/logging_payload_spec_update
Add provider name to payload specification
2025-10-02 17:29:24 -07:00
Amir Refaee 8991657d67 added railtracks to projects using litellm (#15144) 2025-10-02 14:21:38 -07:00
Krrish Dholakia ebba9e0b2a docs: cleanup docs 2025-10-02 09:51:16 -07:00
deepanshu 2512d89872 Add provider name to payload specification 2025-10-02 10:23:26 -04:00
Krish Dholakia cb39a1bb60 Merge pull request #15024 from kowyo/main
docs: use docker compose instead of docker-compose
2025-10-01 21:34:42 -07:00
Deepanshu Lulla 68adca04c8 Gitlab based Prompt manager (#14988)
* add prompt

* add prompt

* add prompt

* add prompt

* add prompt management via gitlab

* gitlab client

* gitlab client

* gitlab client

* fix lint issues

* fix lint issues

* remove router changes

---------

Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
2025-10-01 18:13:11 -07:00
Ishaan Jaff e73d053de3 [Fix] Proxy Auth - Ensure LLM_API_KEYs can access pass through routes (#15115)
* test_virtual_key_llm_api_routes_allows_registered_pass_through_endpoints

* fix: is_registered_pass_through_route

* docs fix
2025-10-01 14:09:01 -07:00
João Speglich 933b3979eb docs: update oci docs with oci_serving_mode 2025-10-01 10:45:50 -03:00
Krish Dholakia 64083111d3 (Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
(Feat) Add Vertex AI Live API WebSocket Passthrough with Cost Tracking
2025-09-30 21:14:16 -07:00
Ishaan Jaff 0ca11eefde [Feat] Guardrails - add logging for important status fields (#15090)
* add StandardLoggingPayloadStatusFields

* add status_fields

* add StandardLoggingPayloadStatusFields

* noma guard: add_standard_logging_guardrail_information_to_request_data

* fix: StandardLoggingPayloadStatusFields

* fix tests

* fix StandardLoggingPayloadStatus

* get_standard_logging_object_payload

* test_bedrock_guardrail_status_failure

* fix: _get_status_fields

* fixes new guardrail tracing

* fix ruff
2025-09-30 18:38:07 -07:00
Ishaan Jaffer f46f9d3fd9 docs azure passthrough api fixes 2025-09-30 15:54:09 -07:00
Krish Dholakia c475723c67 Merge pull request #15044 from BerriAI/litellm_dev_09_29_2025_p1
MCP - enforce server permissions on call tools + Teams - add model specific tpm/rpm limits to teams on LiteLLM
2025-09-30 15:32:53 -07:00
Krish Dholakia 39d1d2a379 Merge pull request #14840 from eddierichter-amd/lemonade-integration
Add AMD Lemonade provider support
2025-09-30 12:34:30 -07:00
Ishaan Jaffer 45bfd2599c docs fix 2025-09-30 11:35:15 -07:00
Eddie Richter abaf77da43 Small updates to documentation 2025-09-30 12:12:24 -06:00
Eddie Richter 929510ef5d Adding unit tests and documentation 2025-09-30 12:12:24 -06:00
Krish Dholakia 551a171243 Merge pull request #15043 from cedarm/fix-remove-vertex-latest
fix: remove invalid vertex -latest models
2025-09-29 21:54:53 -07:00
Yuta Saito def4afedd7 doc: add missing api_key parameter 2025-09-30 12:52:17 +09:00
Krrish Dholakia 91f420160f docs(mcp.md): document oauth support 2025-09-29 13:47:21 -07:00
Ishaan Jaff 038863a1fe [Feat] Add new claude-sonnet-4-5 model family (#15041)
* add new claude-sonnet-4-5

* docs fix

* fix tool_use_system_prompt_tokens

* add anthropic.claude-sonnet-4-5-20250929 to bedrock converse models
2025-09-29 13:09:00 -07:00
Cedar Myers 5357b1e102 fix: remove invalid vertex -latest models 2025-09-29 16:04:33 -04:00
Kowyo 858f557bce docs: use docker compose instead of docker-compose 2025-09-29 11:59:53 +00:00
Krish Dholakia e7939b0521 Merge pull request #14983 from abhijitjavelin/main
Feat: Add Javelin standalone guardrails integration for LiteLLM Proxy
2025-09-28 17:59:07 -07:00
TobiMayr 3c99d2236a feature/add max requests env var 2025-09-28 19:18:56 +01:00
Cursor Agent c684a18e38 feat: Add OAuth2 auth and scheduled key rotation
Co-authored-by: teddy <teddy@berri.ai>
2025-09-28 16:39:35 +00:00
Krish Dholakia c328b4a036 Merge pull request #15002 from BerriAI/litellm_dev_09_27_2025_p3
MCP - specify forwardable headers, specify allowed/disallowed tools for MCP servers
2025-09-28 09:21:52 -07:00
Krrish Dholakia e6810b5f87 docs(mcp.md): add allow/disallowed tools to docs 2025-09-28 08:50:40 -07:00
eycjur 4f1e409082 use extra_query for get request 2025-09-28 18:03:32 +09:00
Sameer Kankute f510ac15f8 Merge branch 'main' into litellm_live_api_passthrough 2025-09-28 09:45:57 +05:30