Commit Graph
27476 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 2880cb45a2 [Fix] AI Gateway Auth - Ensure Team Tags works when using JWT Auth (#16797)
* fix setting team_metadata

* test_team_metadata_with_tags_flows_through_jwt_auth
v1.80.0.dev2
2025-11-18 17:36:38 -08:00
70e1e83102 feat(managed_files.py): support /delete for files + feat(managed_batches): support /cancel for batches (#16387)
* feat(managed_files.py): initial commit fixing managed file delete on litellm

* fix(managed_files.py): fix file delete

* feat(batches_endpoints/endpoints.py): fix cancelling a batch

ensures managed batches works

---------

Co-authored-by: Ishaan Jaffer <ishaanjaffer0324@gmail.com>
2025-11-18 17:36:26 -08:00
Ishaan JaffandGitHub 35ab0e109c [Docs] SSO - Manage User Roles via Azure App Roles (#16796)
* add img 2

* add app roles

* docs
2025-11-18 16:00:36 -08:00
Ishaan JaffandGitHub e2fc225201 [Feat] SSO - Ensure role from SSO provider is used when a user is inserted onto LiteLLM (#16794)
* test_apply_user_info_values_sso_role_takes_precedence

* fix SSO
v1.80.0.dev1
2025-11-18 15:35:38 -08:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
97bb899f52 Bump js-yaml in /tests/proxy_admin_ui_tests/ui_unit_tests (#16755)
Bumps [js-yaml](https://github.com/nodeca/js-yaml) from 3.14.1 to 3.14.2.
- [Changelog](https://github.com/nodeca/js-yaml/blob/master/CHANGELOG.md)
- [Commits](https://github.com/nodeca/js-yaml/compare/3.14.1...3.14.2)

---
updated-dependencies:
- dependency-name: js-yaml
  dependency-version: 3.14.2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-11-18 11:38:54 -08:00
Sameer KankuteandGitHub f3344a0d07 Fix videos tagging (#16770) 2025-11-18 11:37:05 -08:00
Cesar GarciaandGitHub 0908208076 chore: cleanup repo and improve AI docs (#16775)
* chore: remove development setup files from repository

Removes VERTEX_ENV_SETUP.md and setup_vertex_env.sh from the
repository as they are not referenced in documentation or tests.

These files were added in PR #15824 alongside the VertexAI Search
feature. The setup information is already well-documented in the
official docs at:
docs/my-website/docs/pass_through/vertex_ai_search_datastores.md

* docs: add poetry run python usage to CLAUDE.md and AGENTS.md
2025-11-18 11:36:27 -08:00
CatBraaainandGitHub 9ec31bdd5b fix: correct wrong system message handling for gemma (#16767) 2025-11-18 11:35:56 -08:00
Marty SullivanandGitHub a032b077db update veo 3 pricing and add prod models (#16781) 2025-11-18 11:29:45 -08:00
yuneng-jiangandGitHub f9ec353b80 [Feature] UI - Allow setting base_url in API reference docs (#16674)
* Allow setting base_url in API reference docs

* Add logic to change base url for test key page
2025-11-18 11:27:28 -08:00
Sameer KankuteandGitHub acf206bec6 Add Day 0 gemini-3-pro-preview support (#16719)
* Add thinking signature support for gemini

* Add docs related to thinking signature

* remove double base64 import

* fix mypy errors

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* Add new gemini 3 model and features

* Add docs related to gemini 3

* Update gemini 3 pricing

* fix llm translation tests

* fix mapped tests
2025-11-18 09:44:45 -08:00
4dbbec233c Snowflake provider support: added embeddings, PAT, account_id (#15727)
* added oauth mcp to docs

* added azure ai/grok-4 model family

* Revert "added oauth mcp to docs"

This reverts commit 950b7cef44f14b2db1429f6fbd32548a7c95d325.

* fix: arize ui integration

* need to remove a file

This reverts commit d6c877b73ac763464f204b77135f3786342373b7.

* snowflake support PAT, account_id and embeddings

* format

* test embeddings

* format

* complete test

* fix: add arize from ui

* updated clarifai functions to openai compatible (#15615)

* fix: npm build errors

* update tests

* SnowflakeBaseConfig moved to utils

* rename pat_key => api_ke

* key_type=PAT => 'pat/key'

* fix if api_key is None

* doc update

* doc update

---------

Co-authored-by: mubashir1osmani <mubashir.osmani777@gmail.com>
Co-authored-by: Mubashir Osmani <ilikewafflesomcuh@gmail.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
Co-authored-by: mogith-pn <143642606+mogith-pn@users.noreply.github.com>
2025-11-17 20:27:46 -08:00
BenjaminLevyandGitHub 070db16f87 this yaml actually works (#16757) 2025-11-17 20:09:44 -08:00
YutaSaitoandGitHub 86ada061ec fix: prompt injection not working (#16701) 2025-11-17 20:04:57 -08:00
superpoussin22andGitHub 775740275c Correct ui build (#16702)
* Remove unused import of darkStyles

* Fix typo in onAutoRotationChange prop
2025-11-17 20:04:38 -08:00
pnookala-godaddyandGitHub 52337961dc fix(openai-video): inherit BaseVideoConfig to enable async content response (#16708) 2025-11-17 20:04:10 -08:00
John LathouwersandGitHub d93e13be36 OCI Provider - Add oci_endpoint_id Parameter for OCI Dedicated Endpoints #16723 2025-11-17 19:59:34 -08:00
BradleyandGitHub d0c880e555 Add support for strict parameter in Anthropic tool schemas (#16725)
* support anthropic strict tools

* correct comment from copy-paste
2025-11-17 19:57:13 -08:00
Lucas SugiandGitHub 57fa6bda5a fix: Get custom_llm_provider from query param (#16731) 2025-11-17 19:56:41 -08:00
mmandic-coatueandGitHub 355eff8723 fix haiku-4-5 bedrock configs (#16732) 2025-11-17 19:52:01 -08:00
Cesar GarciaandGitHub 88b71863ae docs(openai): Add gpt-5.1-codex and gpt-5.1-codex-mini models to documentation (#16735)
- Add gpt-5.1, gpt-5.1-codex, and gpt-5.1-codex-mini to OpenAI Chat Completion Models table
- Add gpt-5.1-codex and gpt-5.1-codex-mini to reasoning_effort supported models table
- Clarify that GPT-5-Codex models (gpt-5-codex, gpt-5.1-codex, gpt-5.1-codex-mini) do NOT support verbosity parameter
- Update verbosity section to exclude Codex variants from supported models list

Note: Model configurations already exist in model_prices_and_context_window.json
2025-11-17 19:50:58 -08:00
25d97f50c7 Fallbacks icon button tooltips and delete with friction (#16737)
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-11-17 19:50:41 -08:00
yuneng-jiangandGitHub 11f009a5a4 Teams table empty state (#16738) 2025-11-17 19:49:33 -08:00
Ishaan JaffandGitHub bdb1e16dcf [Feat] AI Gateway Auth - Allow using JWTs for signing in with Proxy CLI (#16756)
* fix auth

* get_cli_jwt_auth_token

* fix linting

* test fixes

* docs

* test fixes

* fix refactor
2025-11-17 19:47:29 -08:00
yuneng-jiangandGitHub 54425eb57b Fix flaky tests due to antd Notification Manager (#16740) 2025-11-17 19:47:20 -08:00
Cesar GarciaandGitHub 5ae99e2761 docs: respect system color scheme preference in Docusaurus (#16748)
Configure Docusaurus to automatically detect and respect the user's
system/browser color scheme preference (prefers-color-scheme).

This improves UX by matching the documentation theme to the user's
OS-level dark/light mode setting, while still allowing manual override
via the theme switcher.

Changes:
- Add colorMode configuration to docusaurus.config.js
- Enable respectPrefersColorScheme option
2025-11-17 19:46:56 -08:00
Krrish Dholakia e156c66575 fix: fix linting error 2025-11-17 19:46:39 -08:00
Krrish Dholakia f2314bab34 docs: improve dev docs 2025-11-17 19:46:39 -08:00
yuneng-jiangandGitHub f1c5ed19aa Delete user and mcp server modal and mcp table tooltips (#16751) 2025-11-17 19:45:24 -08:00
Alexsander HamirandGitHub 6b7035e32f fix: add None check for litellm_params (#16754)
We currently cover the first case where the `litellm_params` may not be there, but not when it could be None
2025-11-17 19:44:29 -08:00
Sameer KankuteandGitHub b9bc903536 remove deprecated embedding model (#16724) 2025-11-17 18:46:20 -08:00
Sameer KankuteandGitHub 7cebc151b0 Add managed files support for responses API (#16733)
* Fix responses api with managed files

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py mypy

* fix mypy errors
2025-11-17 18:41:26 -08:00
Sameer KankuteandGitHub 20ba3fce70 Add deepseek-v3p1-terminus and kimi-k2-instruct in model map for fireworks ai (#16720) 2025-11-17 18:30:32 -08:00
Ishaan JaffandGitHub 83ea037bc9 [Feat] AI Gateway - Allow admins to disable, dynamic callback controls (#16750)
* add flag to allow_dynamic_callback_disabling

* fix EnterpriseCallbackControls

* test controls

* add docs on dynamic logging
2025-11-17 18:29:07 -08:00
Krrish Dholakia fdb5df1f27 docs(managed_batches.md): update docs 2025-11-17 18:00:08 -08:00
Krrish Dholakia e73ac28178 docs(ui_logs.md): link to spec showing what gets logged 2025-11-17 17:56:24 -08:00
Krrish Dholakia 1cdd4065a6 docs: fix docs 2025-11-17 17:54:26 -08:00
YutaSaitoandGitHub 6444bf366c [Docs] mcp oauth flow details (#16742)
* docs: mcp oauth flow details

* fix: Exception (AsyncHTTPHandler.__init__() got an unexpected keyword argument 'follow_redirects')
2025-11-17 17:45:03 -08:00
Ishaan JaffandGitHub 08e115ecff [Feat] Add SSML Support for Azure Text-to-Speech (AVA) (#16747)
* detect SSML in input

* transform_text_to_speech_request

* test_litellm_speech_with_ssml_passthrough

* add Passing Raw SSML

* fix is_ssml_input
2025-11-17 15:41:22 -08:00
Krrish Dholakia 88f5110e11 docs: improve docs 2025-11-17 09:54:13 -08:00
Krrish Dholakia 3c6f81e6ce docs: simplify docs 2025-11-17 09:39:32 -08:00
Alexsander HamirandGitHub 0292b84dc4 docs: add missing details to benchmark comparison (#16690) 2025-11-15 20:12:32 -08:00
Matt CowgerandGitHub 4be0c6a226 JSONpanel (#16687) 2025-11-15 20:11:42 -08:00
Matt MorgisandGitHub f9ecf56715 Update Azure Pricing (#16371)
* add azure eu & us gpt-5 pricing

* add azure us gpt-4.1 pricing

* fix azure/o3-2025-04-16 to match azure/o3

* add azure us o3 pricing
2025-11-15 19:36:13 -08:00
Krrish Dholakia b79e92a21b docs(index.md): document new agent hub 2025-11-15 18:49:51 -08:00
Krrish Dholakia dd02310b30 bump: version 1.80.2 → 1.80.3 2025-11-15 18:26:36 -08:00
Krish DholakiaandGitHub 39917f2ff7 Agents - AI Hub, make agents discoverable on model hub page for internal discovery (#16678)
* feat: initial commit adding agent hub to ui

* feat: add viewable agent hub

* feat: working support for making both config + db agents public via new 'public_agent_groups' list

* fix: agents.py

fix types

* feat: working PATCH endpoint for UI changes

* feat: add new agents panel with working crud

* refactor: refactor to show created_at on be/fe

* style: align new page with the agents table

* style: more style alignment logic

* feat: return if agent is public or not in /v1/agents

* feat: initial commit adding ui flow for making agents discoverable

* feat: new batch make public endpoint

* feat(public_model_hub.tsx): show public agents on public model hub table page

* fix(public_model_hub.tsx): add code examples for using the agent in a2a

* fix: fix indicating if agent has already been made public

* docs: document expected spec for agents is A2A

* docs: add agent hub docs

* docs: document making agents discoverable

* docs: add demo video to docs

* fix: fix ui linting errors

* fix: update tests
2025-11-15 18:25:16 -08:00
Ishaan Jaffer 4fbaf99aab fix lint 2025-11-15 18:05:06 -08:00
yuneng-jiangandGitHub 6375959afe Edit add callbacks route to use data from backend (#16699) 2025-11-15 18:00:36 -08:00
YutaSaitoandGitHub 84df0634f1 fix: key never expires #16005 (#16692) 2025-11-15 17:55:13 -08:00