Commit Graph
1543 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 02f0e13642 [UI] QA Logs page - Fix bug where log did not remain in focus + text overflow on error logs (#10725)
* logs page, ensure that the selected log remains in focus

* fix error view
2025-05-10 14:20:59 -07:00
Ishaan JaffandGitHub e88ac57176 [UI] Bug Fix - Allow Copying Request / Response on Logs Page (#10720)
* dont show country with API req

* ui: allow copying request / response on logs
2025-05-10 12:54:16 -07:00
Ishaan Jaff 2c8f4efd33 (UI) fix regression on Logs page 2025-05-10 09:25:21 -07:00
Ishaan Jaff 8ab4ad1355 fix merge conflicts 2025-05-10 09:08:43 -07:00
Ishaan Jaff 56b5626554 Revert "Filter logs on status and model (#10670)"
This reverts commit d4f7403cb9.
2025-05-10 09:07:49 -07:00
Ishaan Jaff 9bc8130ad5 Revert "Fix log table bugs (after filtering logic was added) (#10712)"
This reverts commit 3fafe37eb9.
2025-05-10 09:07:32 -07:00
Krish DholakiaandGitHub 9bfd3e4819 fix(router.py): write file to all deployments (#10708)
* fix(router.py): write file to all deployments

allows unified file id to work across multiple deployments

* fix(view_logs/index.tsx): show call type in request logs

* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs

* fix(batch_utils.py): broaden check

* fix(router_utils.py): handle null type for function name

* fix(proxy_track_cost_callback.py): fix ruff check error

* fix(router.py): handle healthy_deployments as a dict

* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)

* feat(managed_files.py): support encoding / decoding unified batch id when using managed files

allows routing retrieve batch to the right model id

* fix: fix linting error

* test: add unit tests

* fix: fix ruff check
2025-05-10 00:08:30 -07:00
tanjiroandGitHub 3fafe37eb9 Fix log table bugs (after filtering logic was added) (#10712)
* fix status filter

* fix refresh button

* minor

* fix refresh and auto refresh
2025-05-09 23:46:05 -07:00
Ishaan Jaff 42b8be526d ui new build 2025-05-08 20:21:14 -07:00
tanjiroandGitHub d4f7403cb9 Filter logs on status and model (#10670)
* added status filtering on logs

* added model filter

* fix linter

* fix model filtering

* modified status filter to use status column from LiteLLM_SpendLogs

* remove json import
2025-05-08 13:50:17 -07:00
Ishaan Jaff 24acee3596 new ui build 2025-05-07 21:10:29 -07:00
Ishaan JaffandGitHub ad970ca41d [Feat] Add endpoints to manage email settings (#10646)
* add email notifs endpoints

* ui refactor email settings

* allow controlling email settings / notifs through ui

* add email settings to enterprise router

* change order of email events

* manage email settings in general_settings

* fix location of email settings types

* testing for email settings
2025-05-07 18:56:17 -07:00
tanjiroandGitHub 959ba21585 Filter on logs table (#10644)
* remove existing filter

* added team id based filtering
2025-05-07 17:51:03 -07:00
Ishaan JaffandGitHub 1dd71d5727 [Fix] SCIM - Creating SCIM tokens on Admin UI (#10628)
* fix SCIM token creation ui

* fix scim token creation

* add parseErrorMessage util

* fixes for SCIM parsing error msg
2025-05-07 10:01:26 -07:00
Ishaan Jaff 9801a3a416 ui new build 2025-05-03 21:33:48 -07:00
Krish DholakiaandGitHub 880c2a736b fix(model_management_endpoints.py): allow team admin to update model … (#10539)
* fix(model_management_endpoints.py): allow team admin to update model via `/model/{model_id}/update` route

Fixes ui regression where team admin could not modify their own models

* fix(provider_specific_fields.tsx): style fix

* fix(table.tsx): allow expanding multiple rows

* fix(organization_endpoints.py): more robust check if user can give org model access

handle when user has models=["all-proxy-models"]

* fix(organization_endpoints.py): enable proxy admin with 'all-proxy-model' access to create new org with specific models

Fixes LIT-135

* fix: fix linting error

* fix: fix ui linting error

* fix(index.tsx): fix linting errors
2025-05-03 19:34:35 -07:00
Ishaan Jaff 14646bdbc6 ui new build 2025-05-03 12:08:27 -07:00
Krrish Dholakia 0e91f31908 build: update version + new ui build 2025-05-03 10:53:38 -07:00
tanjiroandGitHub f858a7d670 fix edit credentials modal (#10519) 2025-05-03 08:53:25 -07:00
Krish DholakiaandGitHub 7273bb442a UI - allow reassigning team to other org (#10527)
* feat(team_info.tsx): allow user to reassign team to another org

* style(team_info.tsx): fix org id styling

* feat(team_endpoints.py): add validation check before migrating team to another org

ensure model access, budgets and membership is respected

* fix(team_endpoints.py): update model migration validation to check if org has 'all-proxy-models' access

* fix(organization_view.tsx): show teams belonging to org

* feat(team_endpoints.py): handle wildcard model check on org migration

* fix(team_endpoints.py): nest router check

* test: update testing - use model with higher quota

* build: update poetry lock
2025-05-03 08:44:43 -07:00
Ishaan JaffandGitHub 988e20aa36 [QA] Bedrock Vector Stores Integration - Allow using with registry + in OpenAI API spec with tools (#10516)
* refactor KB implementation to use central registry

* allow passing tools when making KB calls

* test fixes

* linting fix

* fix kb tests

* QA for KB stored in DB

* fix, use litellm_credential_name when adding KB on litellm UI

* QA list endpoint vector stores

* allow using UI creds with KBs
2025-05-03 08:30:38 -07:00
b412d70232 UI - fix adding vertex models with reusable credentials + fix pagination on keys table + fix showing org budgets on table (#10528)
* feat(provider_specific_fields.tsx): Use correct form instance

Fixes https://github.com/BerriAI/litellm/issues/10115

* Fix broken pagination by correctly passing page and pageSize to keyListCall (#10498)

* [Organization] Include litellm_budget_table in /organization/list response (#10488)

* join litellm_budget_table in /organization/list endpoint

* update test

---------

Co-authored-by: tanjiro <56165694+NANDINI-star@users.noreply.github.com>
2025-05-03 08:16:53 -07:00
Ishaan JaffandGitHub e013d7e529 [Feat] Show Vector Store / KB Request on LiteLLM Logs Page (#10514)
* ensure vector store results are logged in SLP

* fix tests

* fix tests with vector_store_request_metadata

* fix linting

* track duration of vector store, only log content when user opts into it

* working vector store viewer

* fix custom llm provider - Vector Store Requests

* fix vector store viewer

* fix logging redacted vector searches

* testing for storing KB queries in DB
2025-05-02 16:14:09 -07:00
Krrish Dholakia c884c9f296 build: update litellm version 2025-05-02 10:07:53 -07:00
Krish DholakiaandGitHub c0a464e4eb fix(all_keys_table.tsx): fix filtering on key alias across multiple p… (#10455)
* fix(all_keys_table.tsx): fix filtering on key alias across multiple pages

* fix(key_management_endpoints.py): enable global sorting on `/key/list`

* feat(all_keys_table.tsx): support sorting on keys table

* feat(all_keys_table.tsx): enable global sorting

* ci(config.yml): add requests mock
2025-04-30 22:21:41 -07:00
Ishaan JaffandGitHub be885e4a17 [Feat] Vector Stores/KnowledgeBases - Allow defining Vector Store Configs (#10448)
* init vector store configs

* working kb init

* add vector store endpoints

* use litellm_credential_name

* working CRUD vector stores litellm

* working creds with vector DB

* ui cleanup

* clean up vector store id

* fix delete button

* refactored vector store component

* working selector for KBs

* ui vector stores

* add vector store tool calls usage on chat ui

* fixes for vector stores litellm

* test fix

* docs Knowledge Bases

* fixes for vector stores litellm

* fix linting

* add managed vectorstores

* fix orjson ci/cd test

* fix linting

* add types.tsx file
2025-04-30 21:49:59 -07:00
Ishaan JaffandGitHub 7c679abe85 ui - add nvidia triton models (#10456) 2025-04-30 21:42:15 -07:00
Ishaan Jaff fcaac91724 ui new build 2025-04-26 18:25:50 -07:00
Krish DholakiaandGitHub 2ab00bd12c Litellm UI improvements 04 26 2025 p1 (#10346)
* fix(provider_info_helpers.tsx): fix together ai provider name

* fix(user_edit_view.tsx): all admin to edit user's personal models

* fix(model_dashboard.tsx): fix model filtering by team id check

* fix(proxy_server.py): support returning available models for a user on `/model_group/info`

Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)

* test(test_models.py): add unit test for model group info check on personal key
2025-04-26 18:24:49 -07:00
Ishaan Jaff d6103c3962 ui fix linting 2025-04-26 17:44:09 -07:00
Ishaan JaffandGitHub c2480db73d [Bug Fix] UI QA - Fix wildcard model test connection not working (#10347)
* fix setFieldsValue for wildcard

* fix async_completion_with_fallbacks

* fix ahealth_check_wildcard_models
2025-04-26 17:42:06 -07:00
Ishaan Jaff f30479557e fix remove Column Selector, it seems to not be working 2025-04-26 16:36:14 -07:00
Ishaan JaffandGitHub f2c9406980 fix /sso/callback (#10345) 2025-04-26 16:27:40 -07:00
Ishaan JaffandGitHub 9ab9744fac ui - fix infinite scroll on test key page (#10343) 2025-04-26 16:18:54 -07:00
Ishaan JaffandGitHub 58878aa0bb [UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key (#10342)
* ui fix use same trace id on test key page

* _get_session_id_for_spend_log

* fix linting
2025-04-26 16:02:58 -07:00
Ishaan Jaff 93759b4cc7 ui new build 2025-04-26 08:28:49 -07:00
Christian OwusuandGitHub 350bae9be0 Internal Users: Refresh user list on create (#10296)
* Clean up

* Refactor

* Internal Users: Refresh user list on create
2025-04-26 08:01:24 -07:00
Ishaan Jaff 8d73259561 ui session management - link to docs 2025-04-26 07:55:28 -07:00
ab9705781f create key table render fix (#10224)
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-04-26 07:51:56 -07:00
Ishaan JaffandGitHub 331e784db4 [Feat] Responses API - Add session management support for non-openai models (#10321)
* add session id in spendLogs

* fix log proxy server request as independant field

* use trace id for SpendLogs

* add _ENTERPRISE_ResponsesSessionHandler

* use _ENTERPRISE_ResponsesSessionHandler

* working session_ids

* working session management

* working session_ids

* test_async_gcs_pub_sub_v1

* test_spend_logs_payload_e2e

* working session_ids

* test_get_standard_logging_payload_trace_id

* test_get_standard_logging_payload_trace_id

* test_gcs_pub_sub.py

* fix all linting errors

* test_spend_logs_payload_with_prompts_enabled

* _ENTERPRISE_ResponsesSessionHandler

* _ENTERPRISE_ResponsesSessionHandler

* expose session id on ui

* get spend logs by session

* add sessionSpendLogsCall

* add session handling

* session logs

* ui session details

* fix on rowExpandDetails

* ui working sessions
2025-04-25 23:24:24 -07:00
Krish DholakiaandGitHub c66c821f96 UI (Keys Page) - Support cross filtering, filter by user id, filter by key hash (#10322)
* feat(filter.tsx): initial commit making filter component more generic - same style as user table filters

* refactor(all_keys_table.tsx): refactor to simplify update logic

* fix: partially revert changes - reduce scope of pr

* fix(filter_logic.tsx): fix filter update logic

* fix(all_keys_table.tsx): fix filtering + search logic

* refactor: cleanup unused params

* Revert "fix(all_keys_table.tsx): fix filtering + search logic"

This reverts commit 5fbc3319702080fa987bee7b0a89e1cb635dd6be.

* feat(filter_logic.tsx): allow filter by user id

* fix(key_management_endpoints.py): support filtering `/key/list` by  key hash

Enables lookup by key hash on ui

* fix(key_list.tsx): fix update

* fix(key_management.py): fix linting error

* test: update testing

* fix(prometheus.py): fix key hash

* style(all_keys_table.tsx): style improvements

* test: fix test
2025-04-25 21:30:56 -07:00
Krish DholakiaandGitHub fee3dc970c UI (Teams Page) - Support filtering by team id + team name (#10324)
* feat(team_endpoints.py): support new `/v2/team/list` endpoint - paginated + partial filtering support

Allows UI to support partial filtering on team tab

* feat(teams/): working team filtering based on partial alias

allows easier search on team alias on UI

* fix(teams.tsx): clarify team id needs to be specified (partial match not supported here)

working team id lookup on litellm UI

* fix(proxy/_types.py): allow `/v2/team/list` to be called for internal user

allows filtering

* fix(team_endpoints.py): fix returning non-admin only teams they're a member of

* fix(team_endpoints.py): fix check
2025-04-25 18:19:29 -07:00
Krish DholakiaandGitHub 1cd6e78ccb UI - Add team based filtering to models page (#10325)
* feat(model_dashboard.tsx): make it easier to see all models for a specific team

* fix(model_dashboard.tsx): fix filtering to work for team deselect
2025-04-25 17:39:17 -07:00
Marc AbramowitzandGitHub 56d00c43f7 Keys page: Use keys rather than logs terminology (#10253) 2025-04-24 14:25:59 -07:00
Christian OwusuandGitHub b82af5b826 Fix UI Flicker in Dashboard (#10261) 2025-04-23 23:27:44 -07:00
Krrish Dholakia 05d617bea0 build(ui/): new ui build 2025-04-23 22:09:14 -07:00
Krish DholakiaandGitHub ab68af4ff5 Litellm multi admin fixes (#10259)
* fix(create_user_button.tsx): do not set 'no-default-models' when user is a proxy admin

* fix(user_info_view.tsx): show all user personal models

* feat(user_info_view.tsx): allow giving users more personal models

* feat(user_edit_view.tsx): allow proxy admin to edit user role, available models, etc.
2025-04-23 22:02:02 -07:00
Krish DholakiaandGitHub be4152c8d5 UI - fix edit azure public model name + fix editing model name post create
* test(test_router.py): add unit test confirming fallbacks with tag based routing works as expected

* test: update testing

* test: update test to not use gemini-pro

google removed it

* fix(conditional_public_model_name.tsx): edit azure public model name

Fixes https://github.com/BerriAI/litellm/issues/10093

* fix(model_info_view.tsx): migrate to patch model updates

Enables changing model name easily
2025-04-23 21:56:56 -07:00
Christian OwusuandGitHub a260afb74d Reset key alias value when resetting filters (#10099) 2025-04-23 21:04:40 -07:00
Krrish Dholakia 1014529ed6 build(ui/): update ui build 2025-04-23 16:55:35 -07:00