Commit Graph
27921 Commits
Author SHA1 Message Date
Ishaan Jaffer d4be511130 UI new build 2025-11-27 12:33:56 -08:00
Ishaan Jaffer b854218819 mypy: fix mypy linting errors 2025-11-27 12:33:02 -08:00
Ishaan Jaffer 19f03d4be3 ui fix linting errors 2025-11-27 12:32:51 -08:00
Ishaan JaffandGitHub ffb75b04fd [Feat] UI - allow adding pass through guardrails through UI (#17226)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* init add pass through guardrails

* ui allow setting target fields on gd

* docs ui settings guardrails
2025-11-27 12:27:16 -08:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
d612d71ef4 [Feat] Add guardrails for pass through endpoints (#17221)
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-27 12:06:53 -08:00
yuneng-jiangandGitHub ef1b3f954b Merge pull request #17223 from BerriAI/litellm_router_fallback_dropdown_fix
[Fix] Change Add Fallback Modal to use Antd Select
2025-11-27 11:40:59 -08:00
yuneng-jiang d59e5dc1f5 Change add fallback to use antd select 2025-11-27 11:31:07 -08:00
Raghav JhavarandGitHub e402b8cd26 do not include plaintext message in exception (#17216) 2025-11-27 10:25:08 -08:00
Yannay HammerandGitHub d7ad2913be Upgrade websockets to v15 (#16734) 2025-11-27 10:08:16 -08:00
Cesar GarciaandGitHub 5197380dd2 docs: add OpenAI Agents SDK to projects (#17203)
* docs: add OpenAI Agents SDK to projects

Add documentation for OpenAI Agents SDK which has an official
LiteLLM extension enabling 100+ LLM providers in multi-agent workflows.

* Update project items in sidebars.js
2025-11-27 09:47:26 -08:00
yuneng-jiangandGitHub 37b1797c59 Merge pull request #17213 from BerriAI/litellm_yuneng_ui_build_2
[Infra] Rebuilding UI
2025-11-27 09:28:57 -08:00
yuneng-jiang f09a6a4187 Rebuilding UI 2025-11-27 09:26:47 -08:00
yuneng-jiangandGitHub 4d00f5bb9b Merge pull request #17212 from BerriAI/litellm_yuneng_ui_build
[Infra] Building UI
2025-11-27 09:15:43 -08:00
Ishaan Jaffer 96a0f960a9 test_e2e_batches_files v1.80.6-nightly 2025-11-27 09:14:43 -08:00
yuneng-jiang 23a979d6fc Building UI 2025-11-27 09:13:48 -08:00
Ishaan JaffandGitHub 31ecd4ce49 Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer KankuteandGitHub 83c1138067 Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header
Respect custom llm provider in header
2025-11-27 22:27:42 +05:30
yuneng-jiangandGitHub 6825593735 Merge pull request #17181 from BerriAI/litellm_ui_org_usage_2
[Feature] UI - Organization Usage in Usage Tab (#16614)
2025-11-27 08:57:31 -08:00
Sameer KankuteandGitHub 688066fa2e Merge pull request #17096 from abi-jey/main
feat: add GA protocol as configurable parameter for azure openai realtime api
2025-11-27 22:20:07 +05:30
Ishaan Jaffer 3b330c3f0f docs config settings 2025-11-27 08:15:51 -08:00
abbas jafariandGitHub af5f31eb9f Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer KankuteandGitHub 1f6d8fc151 Merge pull request #17079 from naaa760/fix/vertex-batch-support
fix: support Vertex AI batch listing in LiteLLM proxy
2025-11-27 16:50:17 +05:30
Sameer Kankute d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
yuneng-jiang 40db4527f7 [Feature] UI - Organization Usage in Usage Tab (#16614)
* Organization Usage UI

* Resolved build issues

* Added a test
2025-11-26 21:51:19 -08:00
yuneng-jiangandGitHub e093429740 Merge pull request #17177 from BerriAI/litellm_ui_model_perf_2
[Infra] UI - Migrate Provider Fields to React Query
2025-11-26 20:07:57 -08:00
Ishaan Jaffer 772be1778a test_append_system_prompt_messages 2025-11-26 19:00:31 -08:00
Ishaan Jaffer 01fd4d7cef fix fireworks test 2025-11-26 18:58:32 -08:00
Ishaan Jaffer 65f5cc29dd fix ai/ml api 2025-11-26 18:55:55 -08:00
Sameer KankuteandGitHub b09c64e4f3 Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking
Add cost tracking for streaming in vertex ai passthrough
2025-11-27 08:24:41 +05:30
Sameer KankuteandGitHub aab0684bb9 Merge pull request #16877 from BerriAI/litellm_mcp_responses_api_header_passing
feat: Add header passing support for MCP tools in Responses API
2025-11-27 08:10:43 +05:30
1cb5fcddba make generic api OSS + support multiple generic API's (#17152)
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-26 18:38:38 -08:00
Sameer Kankute 30a22f1fed type the secrets field v1.80.5.dev32 2025-11-27 07:58:35 +05:30
Sameer Kankute 605bc4e476 type the secrets field 2025-11-27 07:58:06 +05:30
Ishaan Jaffer 48eb34a875 fix cos tracking 2025-11-26 18:26:07 -08:00
Ishaan Jaffer b487e67dec sec fix 2025-11-26 18:23:18 -08:00
yuneng-jiang 7e3f3c6f65 Migrate /public/provider/fields to react query 2025-11-26 18:16:52 -08:00
Ishaan Jaffer 5cfcc98d2e fix img gen 2025-11-26 17:56:59 -08:00
yuneng-jiangandGitHub ac1827cbfc Merge pull request #17168 from BerriAI/litellm_ui_users_loading
[Feature] UI - Better Loading State for Internal User Page
2025-11-26 17:28:40 -08:00
yuneng-jiangandGitHub 9a4d3bc347 Merge pull request #17170 from BerriAI/litellm_key_create_duration_fix
[Fix] UI - Create Key Duration Fix
2025-11-26 17:24:30 -08:00
Ishaan Jaffer 0346d1ea23 fix 2025-11-26 17:11:33 -08:00
yuneng-jiang f0e5921bbd Add emoji for exact text match 2025-11-26 17:09:07 -08:00
Ishaan JaffandGitHub 831694897e [Feat] RAG API - QA - allow internal user keys to access api, allow using litellm credentials with API, raise clear exception when RAG API fails (#17169)
* allow using a cred with RAG API

* add /rag/ingest to llm api routes

* add rag endpoints under llm api routes

* raise clear exception when RAG API fails

* use async methods for bedrock ingest

* fix ingestion

* fix _create_opensearch_collection

* fix qa check and linting
2025-11-26 17:07:30 -08:00
yuneng-jiang 4b951c3ced Removing flaky tests 2025-11-26 17:04:12 -08:00
yuneng-jiang aad0075366 Change create key duration initial value to null 2025-11-26 17:00:56 -08:00
yuneng-jiang 67f9c6cc08 Adjusting e2e tests for new loading state 2025-11-26 16:47:37 -08:00
yuneng-jiang 87b4e9ebad User table loading state 2025-11-26 16:24:29 -08:00
Ishaan JaffandGitHub 379655e16b [Feat] LiteLLM RAG API - Add support for Vertex RAG engine (#17117)
* add VertexAIVectorStoreOptions

* Revert "add VertexAIVectorStoreOptions"

This reverts commit b086adf10b122a72abc7071dce5a7061f456f575.

* add VertexAIVectorStoreOptions

* add get_rag_ingestion_class

* add VertexAIRAGTransformation

* test ingestion

* docs vertex ai rag engine
2025-11-26 15:49:04 -08:00
SamAcctXandGitHub 32617d1e72 Add OpenRouter Opus 4.5 (#17144) 2025-11-26 15:45:45 -08:00
yuneng-jiangandGitHub 1b34312488 Merge pull request #17166 from BerriAI/litellm_ui_mh_server_root
[Fix] UI - Change model_hub_table to call getUiConfig before Fetching Public Data
2025-11-26 15:30:16 -08:00
yuneng-jiang 86af4891fa Change model_hub_table to call getUiConfig before fetching public data 2025-11-26 15:12:40 -08:00