Commit Graph
22064 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub af73a8e3a9 fix: vertex show clear exception on failed refresh (#10969)
* fix: vertex show clear exception on failed refresh

* fix: show clear debug log
v1.67.0-stable.patch2
2025-05-19 21:51:15 -07:00
7d8ed6f362 [Fix] List Guardrails - Show config.yaml guardrails on litellm ui (#10959)
* fix: listing guardrails defined on litellm config

* fix: list guardrails on litellm config

* fix: list guardrails on litellm config

* test: list guardrails on litellm config

* fix: linting

* Update litellm/proxy/guardrails/guardrail_endpoints.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: GuardrailInfoLiteLLMParamsResponse

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-19 21:25:23 -07:00
Krrish Dholakia d099092bc1 build: ui/
new build
2025-05-19 21:23:45 -07:00
Jugal D. BhattandGitHub c6260fe31a add cla to docs (#10963)
* add cla to docs

* cla docs clarity
2025-05-19 21:23:22 -07:00
Krrish Dholakia b486849bc2 build(ui/): new ui build 2025-05-19 21:22:55 -07:00
Krrish Dholakia 1857f5d264 test: update test 2025-05-19 21:21:44 -07:00
Krrish Dholakia 584660b3cd bump: version 1.70.1 → 1.70.2 2025-05-19 21:03:33 -07:00
Krish DholakiaandGitHub d282babd3e Validate migrating keys to teams + Fix mistral image url on async translation (#10966)
* feat(key_management_endpoints.py): add validation checks for migrating key to team

Ensures requests with migrated key can actually succeed

Prevent migrated keys from failing in prod due to team missing required permissions

* fix(mistral/): fix image url handling for mistral on async call

* fix(key_management_endpoints.py): improve check for running team validation on key update
2025-05-19 21:01:53 -07:00
Krish DholakiaandGitHub 6cfb6e5253 Litellm dev 05 19 2025 p3 (#10965)
* feat(model_info_view.tsx): enable updating model info for existing models on UI

Fixes LIT-154

* fix(model_info_view.tsx): instantly show model info updates on UI

* feat(proxy_server.py): enable flag on `/models` to include model access groups

This enables admin to assign model access groups to keys/teams on UI

* feat(ui/): add model access groups on ui dropdown when creating teams + keys

* refactor(parallel_request_limiter_v2.py): Migrate multi instance rate limiting to OSS

Closes https://github.com/BerriAI/litellm/issues/10052
2025-05-19 20:49:21 -07:00
Krrish Dholakia b091832733 test: update tests 2025-05-19 20:48:26 -07:00
Krish DholakiaandGitHub 8eccc787ba Enable key reassignment on UI + Show 'updated at' column for key in all keys table (#10960)
* feat(key_edit_view.tsx): initial commit enabling reassigning keys to teams

* style(key_edit_view.tsx): cleaner implementation with teams in dropdown

* fix(all_keys_table.tsx): set max width to keys column

* feat(all_keys_table.tsx): show last updated at column for key
2025-05-19 20:27:46 -07:00
Krrish Dholakia edfd8a138d fix: update test to reflect change 2025-05-19 20:26:48 -07:00
Krrish Dholakia defd602513 fix: fix model param mapping 2025-05-19 20:24:47 -07:00
Krrish Dholakia 4e3c8ae94f test: update test due to cohere ssl issues 2025-05-19 20:07:57 -07:00
Krrish Dholakia 38470d7164 refactor(vertex_llm_base.py): remove check on credential project id - allow for cross credential calling 2025-05-19 20:03:27 -07:00
Ishaan Jaff 7075168939 bump: litellm proxy extras 2025-05-19 15:40:24 -07:00
Ishaan JaffandGitHub 3b6c6d05dd [Fix] Invitation Email does not include the invitation link (#10958)
* fix: email invites should link to the invitation

* fix: email invites should link to the invitation

* fix: email invites should link to the invitation
2025-05-19 15:38:38 -07:00
Cole McIntoshandGitHub 4381ddc963 Add new documentation files for LiteLLM (#10961)
- Created `llms-full.txt` with comprehensive details on LiteLLM features, usage, and supported models.
- Added `llms.txt` for quick access to key links and resources related to LiteLLM, including guides, release notes, and integration documentation.
2025-05-19 15:17:44 -07:00
Daniel StaigerandGitHub be672b2b18 Update github.md (#10946)
Updated clarification in the use of the models form github. (Github uses the model name: <company>/<model-Name> while litellm wants github/<model-Name>

Updated the example to a model that is actually supported / available on github right now
2025-05-19 13:21:50 -07:00
tanjiroandGitHub 0676c840a1 add keys and members (#10950) 2025-05-19 13:21:02 -07:00
Caffeine CoderandGitHub 90e1647566 fix: handle DB_USER, DB_PASSWORD, DB_HOST problem I faced, since this… (#10842)
* fix: handle DB_USER, DB_PASSWORD, DB_HOST problem I faced, since this could be with special character, so better be url encoded, similar problem also happen in DATABASE_URL

* test: added the test cases

* add: test case of url with sepcial character
2025-05-19 09:29:12 -07:00
Paul SeldenandGitHub fde0c5e53f Allow passed in vertex_ai credentials to be authorized_user type (#10899) 2025-05-19 08:52:35 -07:00
mohittaleleandGitHub d36b6fa60b add skip server startup flag to cli (#10665)
* add flag

* fix ruff linting

* add unit test

* fix  ruff errors

* fix lintings issues

* fix linting errors

* add global noqa for print
2025-05-19 08:00:41 -07:00
Bryan LowandGitHub 8a880ccd2f fix cohere rerank provider (#10822) 2025-05-18 20:52:47 -07:00
Jorge Piedrahita OrtizandGitHub fd40bc6ddd update sambanova models and parameters (#10900)
* add sambanova to completion input params table

* update sambanova supported args

* update sambanova supported models

* minor changes

* fix sambanova model list

* update sambanova models

* update sambanova models

* update sambanova docs

* minor chnage sambanova url

* update type to match OpenAIGPTConfig

* minor change
2025-05-18 20:45:20 -07:00
6ac3c6ba35 Enable structured JSON schema outputs in LM Studio (for validated responses) (#10929)
- docs/my-website/docs/providers/lm_studio.md: add Structured Output section with JSON schema and Pydantic examples
- litellm/llms/lm_studio/chat/transformation.py: extend map_openai_params to handle `response_format` mappings (`json_schema`, `json_object`) and move them to optional_params
- litellm/utils.py: include `LM_STUDIO` in `supports_response_schema` list
- tests/litellm/llms/lm_studio/test_lm_studio_chat_transformation.py: add tests for Pydantic model and dict-based JSON schema handling

Co-authored-by: Earl St Sauver <estasuver@gmail.com>
2025-05-18 20:43:49 -07:00
Krish DholakiaandGitHub 4942e25707 fix(vertex_llm_base.py): remove quota_project_id parameter from credential refresh request (#10915)
Fixes https://github.com/BerriAI/litellm/issues/9863
2025-05-18 20:43:01 -07:00
Krrish Dholakia 16b2158d25 docs: update release notes 2025-05-17 19:47:57 -07:00
Krrish Dholakia 6bfd05bb76 docs: update docs with key highlights 2025-05-17 19:47:57 -07:00
DarinVerheijkeandGitHub 54a0766ff9 Add provider Featherless AI (access to 4200+ models) (#10596)
* add featherless provider

* change docs

* clean lint

* fix provider logic

* Add fixes per review

* update parameters

* update error msg

* remove featherless

* add tests

* add mock test e2e

* update to openai mock test
2025-05-17 19:38:46 -07:00
Krrish Dholakia b53f1e7677 docs: clarify enterprise feature 2025-05-17 19:36:35 -07:00
Ishaan Jaff 8a05c57071 docs pii masking cleanup 2025-05-17 18:55:58 -07:00
Ishaan JaffandGitHub d367eb3460 [Docs] Pii masking with LiteLLM (#10924)
* doc pii masking

* remove old doc

* docs add deployment options

* docs guardrail pii masking

* docs pii masking / tracing

* add images of tracing guards litellm ui

* docs presidio pii
2025-05-17 18:35:33 -07:00
Ishaan JaffandGitHub cdf6026fdd docs apply guard (#10923) 2025-05-17 18:34:35 -07:00
Krish DholakiaandGitHub b4fc703d3b LiteLLM Stable release notes (#10919)
* docs(index/v1.70.1-stable): style improvements

* style: add style improvements to docs

* docs: cleanup docs

* docs: more style improvements

* docs: style improvements

* docs(gemini/realtime): add docs on realtime api via Google AI Studio

* docs: add openai example to anthropic web search docs

* docs: add missing doc links

* docs: doc cleanup

* docs: add more doc links

* fix: cleanup

* docs: add docker information

* docs: update doc links

* docs: add demo instance details to doc

s
2025-05-17 17:54:25 -07:00
Ishaan Jaff ac541392ed fix: apply_guardrail endpoint 2025-05-17 17:51:19 -07:00
Ishaan Jaff 22aa33e8b5 bump litellm_enterprise-0.1.4 2025-05-17 17:28:59 -07:00
Ishaan Jaff b861a650ad ui new build 2025-05-17 17:22:32 -07:00
Ishaan JaffandGitHub 5ab9fc0b7a fix linting cryptography (#10921) 2025-05-17 17:21:22 -07:00
Ishaan Jaff e87b536d03 fix config.yml 2025-05-17 16:59:03 -07:00
Ishaan Jaff 01d0983c29 fix config.yml 2025-05-17 16:57:17 -07:00
Ishaan Jaff c79cba47ec fix linting errors from ryptography.hazmat.bindings._rust 2025-05-17 16:31:30 -07:00
Ishaan JaffandGitHub 93ec0c48bc [UI QA Guardrails] - Minor UI Fixes (#10920)
* fix: presidio params on ui

* move mode and always on to the top

* explain each mode

* show switch for default on / off for guards

* allow multiple modes for guardrails

* fix: presidio output parsing with stream

* Revert "git commit fix linting error on cryptography bindings"

This reverts commit 2615f04afd.
2025-05-17 16:27:57 -07:00
Ishaan JaffandGitHub 50a6f289cd [QA/Guardrails] Allow editing guardrail entity configs (#10918)
* allow editing guardrail entity

* fix: allow patching guardrail entity config

* fix: test init guardrails

* fix: update in mem guardrail params

* fix: update in mem guardrail params

* allow editing guardrail entities on ui

* fix pii entity config

* fixes for unselect/select entities

* fix: test fixes
2025-05-17 16:27:02 -07:00
Krrish Dholakia d79cd70a1a docs(index/v1.70.1-stable): add initial release note 2025-05-17 16:13:44 -07:00
Jugal D. BhattandGitHub b342aa9253 add docs for spend logs (#10913)
* add docs for spend logs

* change docs

* change docs

* change docs and change default run loops.

There was a calc error previously, it was not a million when run 100 times, but 100k, now default run would delete 500k records in 50s (running 500 loops of function before exiting)

* add docs changes to ui logs to metion deletion
2025-05-17 16:00:28 -07:00
Ishaan Jaff 9846abb5c0 allow using output parsing for guardrails 2025-05-17 14:52:39 -07:00
Ishaan Jaff ddf1b20f4f Revert "git commit fix linting error on cryptography bindings"
This reverts commit 2615f04afd.
2025-05-17 14:49:54 -07:00
Ishaan Jaff 2615f04afd git commit fix linting error on cryptography bindings 2025-05-17 12:16:37 -07:00
Ishaan Jaff db624c90f6 (UI) new build 2025-05-17 11:38:45 -07:00