Commit Graph

1380 Commits

Author SHA1 Message Date
tanjiro 1c652b67b6 Model filter on logs (#11048)
* add model filter

* remove calling all models
2025-05-22 07:31:43 -07:00
tanjiro bfb04d3e75 added cloding tags for </TabGroup> </Col> </Grid> + indentation changes (#11046) 2025-05-22 07:23:26 -07:00
tanjiro 0cde73ffb7 Spend rounded to 4 for Organizations and Users page (#11023)
* spend rounded to 4

* fixed for organization and users table
2025-05-21 20:41:54 -07:00
Jugal D. Bhatt 03cda24681 Verbose error on admin add (#10978) 2025-05-21 19:30:18 -07:00
Tyler Wagner b6508731dc fix(ui): call tool when no arguments needed (#11012)
Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-05-21 14:06:22 -07:00
tanjiro 9b0e1bb16c put organization and team buttons at the top (#10948) 2025-05-21 12:59:14 -07:00
tanjiro de5ec3fd9a spend rounded to 4 (#11013) 2025-05-21 09:55:44 -07:00
Krrish Dholakia b486849bc2 build(ui/): new ui build 2025-05-19 21:22:55 -07:00
Krish Dholakia 6cfb6e5253 Litellm dev 05 19 2025 p3 (#10965)
* feat(model_info_view.tsx): enable updating model info for existing models on UI

Fixes LIT-154

* fix(model_info_view.tsx): instantly show model info updates on UI

* feat(proxy_server.py): enable flag on `/models` to include model access groups

This enables admin to assign model access groups to keys/teams on UI

* feat(ui/): add model access groups on ui dropdown when creating teams + keys

* refactor(parallel_request_limiter_v2.py): Migrate multi instance rate limiting to OSS

Closes https://github.com/BerriAI/litellm/issues/10052
2025-05-19 20:49:21 -07:00
Krish Dholakia 8eccc787ba Enable key reassignment on UI + Show 'updated at' column for key in all keys table (#10960)
* feat(key_edit_view.tsx): initial commit enabling reassigning keys to teams

* style(key_edit_view.tsx): cleaner implementation with teams in dropdown

* fix(all_keys_table.tsx): set max width to keys column

* feat(all_keys_table.tsx): show last updated at column for key
2025-05-19 20:27:46 -07:00
tanjiro 0676c840a1 add keys and members (#10950) 2025-05-19 13:21:02 -07:00
Ishaan Jaff b861a650ad ui new build 2025-05-17 17:22:32 -07:00
Ishaan Jaff 93ec0c48bc [UI QA Guardrails] - Minor UI Fixes (#10920)
* fix: presidio params on ui

* move mode and always on to the top

* explain each mode

* show switch for default on / off for guards

* allow multiple modes for guardrails

* fix: presidio output parsing with stream

* Revert "git commit fix linting error on cryptography bindings"

This reverts commit 2615f04afd.
2025-05-17 16:27:57 -07:00
Ishaan Jaff 50a6f289cd [QA/Guardrails] Allow editing guardrail entity configs (#10918)
* allow editing guardrail entity

* fix: allow patching guardrail entity config

* fix: test init guardrails

* fix: update in mem guardrail params

* fix: update in mem guardrail params

* allow editing guardrail entities on ui

* fix pii entity config

* fixes for unselect/select entities

* fix: test fixes
2025-05-17 16:27:02 -07:00
Ishaan Jaff db624c90f6 (UI) new build 2025-05-17 11:38:45 -07:00
Ishaan Jaff 88153e9a37 (ui) cleanup logs filter 2025-05-17 07:45:48 -07:00
Ishaan Jaff e0cccb80dd ui - fixes leftnav 2025-05-16 20:55:09 -07:00
Ishaan Jaff 148814658e ui new build 2025-05-16 18:37:42 -07:00
Ishaan Jaff 76de6e374c [UI] Allow editing guardrails (#10907)
* ui qa guardrails

* ui fixes guardrail info

* feat: add patch guardrail endpoint

* fix: update_guardrail_in_db

* ui add support for editing guardrails
2025-05-16 18:35:03 -07:00
Ishaan Jaff ffafc77791 [UI] Fixes for using Lakera Guardrail on LiteLLM UI (#10906)
* add lakera v2 on ui

* fix: lakera init on ui

* ui fixes for exposed guardrails

* fix: lakera pii masking

* fix: lakera pii masking
2025-05-16 18:24:40 -07:00
tanjiro fdacf07ccb Key alias filter on logs (#10905)
* key hash filter added

* key alias filter added
2025-05-16 17:49:14 -07:00
Ishaan Jaff 888c4130bb [Feat] UI: Allow clicking into a guardrail (#10904)
* ui allow clicking into guardrail

* feat: add guardrail info endpoint

* fix: guardrails/{guardrail_id}/info

* ui click into guard

* fix guardrail info view

* fix linting error
2025-05-16 16:58:40 -07:00
tanjiro dc8945cce8 key hash filter added (#10903) 2025-05-16 16:53:52 -07:00
Ishaan Jaff 298912bd38 [UI] - Add Guardrail Tracing to LiteLLM SpendLogs (#10893)
* feat: trace guardrail SLP in spendLogs

* test: trace guardrail SLP in spendLogs

* add guardrail viewer

* checkpoint - working guardrail view on logs

* ui add guardrail view to SpendLogs

* test: fixes guardrails

* trace: fixes guardrails
2025-05-16 12:20:20 -07:00
Ishaan Jaff f335bb91dd Model filter added on logs tab. (#10877) (#10891)
* model filter added

* Make status logic it's own helper + add a unit test in test_spend_management_endpoints

Co-authored-by: tanjiro <56165694+NANDINI-star@users.noreply.github.com>
2025-05-16 10:04:02 -07:00
Ishaan Jaff dc16e47df6 [UI] Allow adding Bedrock, Presidio, Lakera, AIM guardrails on UI (#10874)
* ui fix bedrock guard

* polish: logo should appear after selecting provider

* fix ui config bedrock

* fix: refactor - use specific configs per provider

* fix: refactor - use specific configs per provider

* feat: ui, show provider specific params for guardrails

* fix: updated type of LiteLLM params for guardrails

* fix: updated type of LiteLLM params for guardrails

* ui, use endpoint for adding presidio, bedrock guardrails

* fix: linting error

* add llama guard and secret detector on UI

* add aim on ui

* allow adding lakera AI on litellm ui

* fix: fixes for params to init guardrails

* test: test_guardrail_info_response

* test: test_initialize_presidio_guardrail

* fix: init guardrails

* fix: init guardrails

* add showSearch

* working bedrock guard
2025-05-15 21:22:56 -07:00
Ishaan Jaff f2dc261efc [Feat] UI: Add support for Deleting Guardrail on UI (#10869)
* show id on guardrails UI

* feat: show guardrail_id on UI

* guardrailToDelete

* ui - add DELETE guardrail

* Update ui/litellm-dashboard/src/components/guardrails.tsx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update ui/litellm-dashboard/src/components/guardrails.tsx

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix ui linting

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-15 15:38:18 -07:00
Ishaan Jaff 4a0d711bed ui: fix render error on test key page 2025-05-14 18:57:51 -07:00
Ishaan Jaff 235ae79037 ui new build 2025-05-14 18:01:48 -07:00
Ishaan Jaff 91f32cd227 ui linting fixes 2025-05-14 18:00:50 -07:00
Ishaan Jaff 2a994d7016 [Feat] Presidio Improvements - Allow adding presidio api base on UI, Test presidio on Test Key, fixes for running presidio hook (#10840)
* feat: add GuardrailProviderSpecificParams

* feat: add add apply_guardrail helper for presidio

* ui cleanup

* fixes pii config on ui

* fixes for adding presidio pii

* refactor: InitializeGuardrails

* feat: init guardrails from DB

* allow running guardrails from test key pg

* fix: running a request with guardrails on UI

* fix: types/guardrails.py

* test: test_presidio_pre_call_hook_with_different_call_types

* test: test_initialize_presidio_guardrail

* test: fix custom guardrail tests
2025-05-14 17:41:33 -07:00
Ishaan Jaff 9ac47cd05a [UI] Fixes for bulk invite users - add validation for bad inputs (#10836)
* fixes for bulk invite users

* add validation for bulk import
2025-05-14 17:36:30 -07:00
Ishaan Jaff b9c3a3835c [Feat UI] Add Guardrails on LiteLLM UI (#10834)
* feat: add DB Add, Edit, Delete for Guardrails

* feat: endpoints for guardrail management

* add guardrail info helpers

* add presidio logo

* add createGuardrailCall

* basic add guardrails on UI

* fix cleanup form

* feat: working add guardrails

* ui view guardrails

* allow viweing list of guardrails

* fix: show created_at and updated_at for guardrails on UI

* cleanup guardrail view

* use 1 file for guardrail table

* docs adding guardrails

* fix: expose endpoint to show allowed modes, entities, actions

* fix allow adding entity configs for PII

* fixes guardrails

* fix adding guardrails on UI

* feat: add PII_ENTITY_CATEGORIES_MAP

* use categories for pii

* use step based form

* fixes pii configs

* fix pii config

* refactor pii config on ui

* clear form on submit

* add ability to create guardrails

* fix linting error
2025-05-14 14:21:35 -07:00
Ishaan Jaff ee1557afcd [Feat] Add endpoints for adding, deleting, editing guardrails in DB (#10833)
* feat: add DB Add, Edit, Delete for Guardrails

* feat: endpoints for guardrail management

* add guardrail info helpers

* add presidio logo

* add createGuardrailCall
2025-05-14 14:19:51 -07:00
tanjiro 1fc5320e9f Team id + Status filter on logs (#10831)
* added team_id filter

* improve hook

* pagination fixed

* fix pagination for team id filter

* minor

* added status filter

* fixed pagination
2025-05-14 13:06:42 -07:00
Jugal D. Bhatt 2b5a781fa4 add ollama api base defaults (#10805) 2025-05-13 14:58:36 -07:00
Ishaan Jaff 4d8f667b5e ui new build 2025-05-10 17:31:44 -07:00
Ishaan Jaff 02f0e13642 [UI] QA Logs page - Fix bug where log did not remain in focus + text overflow on error logs (#10725)
* logs page, ensure that the selected log remains in focus

* fix error view
2025-05-10 14:20:59 -07:00
Ishaan Jaff e88ac57176 [UI] Bug Fix - Allow Copying Request / Response on Logs Page (#10720)
* dont show country with API req

* ui: allow copying request / response on logs
2025-05-10 12:54:16 -07:00
Ishaan Jaff 2c8f4efd33 (UI) fix regression on Logs page 2025-05-10 09:25:21 -07:00
Ishaan Jaff 8ab4ad1355 fix merge conflicts 2025-05-10 09:08:43 -07:00
Ishaan Jaff 56b5626554 Revert "Filter logs on status and model (#10670)"
This reverts commit d4f7403cb9.
2025-05-10 09:07:49 -07:00
Ishaan Jaff 9bc8130ad5 Revert "Fix log table bugs (after filtering logic was added) (#10712)"
This reverts commit 3fafe37eb9.
2025-05-10 09:07:32 -07:00
Krish Dholakia 9bfd3e4819 fix(router.py): write file to all deployments (#10708)
* fix(router.py): write file to all deployments

allows unified file id to work across multiple deployments

* fix(view_logs/index.tsx): show call type in request logs

* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs

* fix(batch_utils.py): broaden check

* fix(router_utils.py): handle null type for function name

* fix(proxy_track_cost_callback.py): fix ruff check error

* fix(router.py): handle healthy_deployments as a dict

* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)

* feat(managed_files.py): support encoding / decoding unified batch id when using managed files

allows routing retrieve batch to the right model id

* fix: fix linting error

* test: add unit tests

* fix: fix ruff check
2025-05-10 00:08:30 -07:00
tanjiro 3fafe37eb9 Fix log table bugs (after filtering logic was added) (#10712)
* fix status filter

* fix refresh button

* minor

* fix refresh and auto refresh
2025-05-09 23:46:05 -07:00
Ishaan Jaff 42b8be526d ui new build 2025-05-08 20:21:14 -07:00
tanjiro d4f7403cb9 Filter logs on status and model (#10670)
* added status filtering on logs

* added model filter

* fix linter

* fix model filtering

* modified status filter to use status column from LiteLLM_SpendLogs

* remove json import
2025-05-08 13:50:17 -07:00
Ishaan Jaff 24acee3596 new ui build 2025-05-07 21:10:29 -07:00
Ishaan Jaff ad970ca41d [Feat] Add endpoints to manage email settings (#10646)
* add email notifs endpoints

* ui refactor email settings

* allow controlling email settings / notifs through ui

* add email settings to enterprise router

* change order of email events

* manage email settings in general_settings

* fix location of email settings types

* testing for email settings
2025-05-07 18:56:17 -07:00
tanjiro 959ba21585 Filter on logs table (#10644)
* remove existing filter

* added team id based filtering
2025-05-07 17:51:03 -07:00