Commit Graph
21656 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 2ab00bd12c Litellm UI improvements 04 26 2025 p1 (#10346)
* fix(provider_info_helpers.tsx): fix together ai provider name

* fix(user_edit_view.tsx): all admin to edit user's personal models

* fix(model_dashboard.tsx): fix model filtering by team id check

* fix(proxy_server.py): support returning available models for a user on `/model_group/info`

Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)

* test(test_models.py): add unit test for model group info check on personal key
2025-04-26 18:24:49 -07:00
Ishaan Jaff 42928601b4 bump litellm-proxy-extras 2025-04-26 18:11:06 -07:00
Ishaan Jaff d6103c3962 ui fix linting 2025-04-26 17:44:09 -07:00
Ishaan JaffandGitHub c2480db73d [Bug Fix] UI QA - Fix wildcard model test connection not working (#10347)
* fix setFieldsValue for wildcard

* fix async_completion_with_fallbacks

* fix ahealth_check_wildcard_models
2025-04-26 17:42:06 -07:00
Krish DholakiaandGitHub 31313dd489 Fix - support azure dall e custom pricing (#10339)
* fix(cost_calculator.py): support custom pricing for image gen

Allow user to set custom pricing on azure image gen models

* test(test_cost_calculator.py): add unit test

* test(test_litellm_logging.py): add more unit testing

* fix(litellm_logging.py): fix ruff check
2025-04-26 17:16:03 -07:00
Ishaan Jaff f30479557e fix remove Column Selector, it seems to not be working 2025-04-26 16:36:14 -07:00
Ishaan JaffandGitHub f2c9406980 fix /sso/callback (#10345) 2025-04-26 16:27:40 -07:00
Ishaan JaffandGitHub 9ab9744fac ui - fix infinite scroll on test key page (#10343) 2025-04-26 16:18:54 -07:00
Ishaan JaffandGitHub f694878155 fix SSO (#10344) 2025-04-26 16:17:38 -07:00
Ishaan JaffandGitHub 58878aa0bb [UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key (#10342)
* ui fix use same trace id on test key page

* _get_session_id_for_spend_log

* fix linting
2025-04-26 16:02:58 -07:00
Ishaan Jaff faf54e3f29 fixes for EE image v1.67.3.dev6 2025-04-26 15:43:21 -07:00
Ishaan Jaff fd3603d4e8 deploy - add build-and-push-image-ee v1.67.3.dev4 2025-04-26 14:40:20 -07:00
Ishaan Jaff dcfa26c428 docs fix index stable release 2025-04-26 14:31:24 -07:00
Ishaan Jaff 9614d5ba69 docs fix stable release 2025-04-26 14:23:09 -07:00
Ishaan Jaff a0b6766321 docs release notes 2025-04-26 14:02:38 -07:00
Ishaan Jaff cd5f0e809e docs responses API session management 2025-04-26 14:01:24 -07:00
Krrish Dholakia 68c74bb342 build(model_prices_and_context_window.json): add gemini/gemini-2.5-pro-exp-03-25
Addresses https://github.com/BerriAI/litellm/discussions/10058
2025-04-26 12:48:08 -07:00
Ishaan Jaff 3d516fee1f docs responses API GET, DELETE examples 2025-04-26 12:40:21 -07:00
Ishaan Jaff 8c8b786267 doc fix stable release add images of UI improvements 2025-04-26 12:13:59 -07:00
mdonajandGitHub b99b0d5010 Fix: Prevent cache token overwrite by last chunk in streaming usage (#10284) 2025-04-26 12:06:12 -07:00
Krish DholakiaandGitHub 93b6df96e0 Prisma Migrate - support setting custom migration dir (#10336)
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db

* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied

* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras

use the one in litellm-proxy-extras

* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs

Fixes https://github.com/BerriAI/litellm/issues/9885

* fix(utils.py): give helpful warning message when permission denied error raised in fs
2025-04-26 12:05:06 -07:00
Ishaan JaffandGitHub f2899cb66e [Docs] v1.67.4-stable (#10338)
* draft 1.67.4

* completed New Models / Updated Models

* docs clean up image gen

* docs azure granularities for whisper

* docs New Models / Updated Models

* docs cohere

* update cohere docs

* complete New Models / Updated Models updates

* docs responses API

* complete Logging / Guardrail Integrations

* completed Logging / Guardrail Integrations

* doc Spend Tracking Improvements

* Logging / Guardrail Integrations
2025-04-26 11:54:18 -07:00
Ishaan Jaff dd8a7e15a8 bump: version 1.67.3 → 1.67.4 v1.67.4-nightly 2025-04-26 08:30:50 -07:00
Ishaan Jaff 93759b4cc7 ui new build 2025-04-26 08:28:49 -07:00
Ishaan JaffandGitHub f7e75fa276 [Docs] UI Session Logs (#10334)
* add ui logs session doc

* docs add instructions on how to do session management

* docs session management

* docs session management

* docs responses api session management

* docs ui logs
2025-04-26 08:26:23 -07:00
Krrish Dholakia 421011baec build(model_prices_and_context_window.json): update azure o1-mini pricing 2025-04-26 08:05:09 -07:00
Christian OwusuandGitHub 350bae9be0 Internal Users: Refresh user list on create (#10296)
* Clean up

* Refactor

* Internal Users: Refresh user list on create
2025-04-26 08:01:24 -07:00
Ishaan Jaff 8d73259561 ui session management - link to docs 2025-04-26 07:55:28 -07:00
ab9705781f create key table render fix (#10224)
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-04-26 07:51:56 -07:00
Ishaan Jaff c114da1c6d bump litellm proxy extras 2025-04-26 07:46:33 -07:00
Ishaan JaffandGitHub 331e784db4 [Feat] Responses API - Add session management support for non-openai models (#10321)
* add session id in spendLogs

* fix log proxy server request as independant field

* use trace id for SpendLogs

* add _ENTERPRISE_ResponsesSessionHandler

* use _ENTERPRISE_ResponsesSessionHandler

* working session_ids

* working session management

* working session_ids

* test_async_gcs_pub_sub_v1

* test_spend_logs_payload_e2e

* working session_ids

* test_get_standard_logging_payload_trace_id

* test_get_standard_logging_payload_trace_id

* test_gcs_pub_sub.py

* fix all linting errors

* test_spend_logs_payload_with_prompts_enabled

* _ENTERPRISE_ResponsesSessionHandler

* _ENTERPRISE_ResponsesSessionHandler

* expose session id on ui

* get spend logs by session

* add sessionSpendLogsCall

* add session handling

* session logs

* ui session details

* fix on rowExpandDetails

* ui working sessions
2025-04-25 23:24:24 -07:00
Krish DholakiaandGitHub c66c821f96 UI (Keys Page) - Support cross filtering, filter by user id, filter by key hash (#10322)
* feat(filter.tsx): initial commit making filter component more generic - same style as user table filters

* refactor(all_keys_table.tsx): refactor to simplify update logic

* fix: partially revert changes - reduce scope of pr

* fix(filter_logic.tsx): fix filter update logic

* fix(all_keys_table.tsx): fix filtering + search logic

* refactor: cleanup unused params

* Revert "fix(all_keys_table.tsx): fix filtering + search logic"

This reverts commit 5fbc3319702080fa987bee7b0a89e1cb635dd6be.

* feat(filter_logic.tsx): allow filter by user id

* fix(key_management_endpoints.py): support filtering `/key/list` by  key hash

Enables lookup by key hash on ui

* fix(key_list.tsx): fix update

* fix(key_management.py): fix linting error

* test: update testing

* fix(prometheus.py): fix key hash

* style(all_keys_table.tsx): style improvements

* test: fix test
2025-04-25 21:30:56 -07:00
Krish DholakiaandGitHub 339351c579 fix(ui_sso.py): support experimental jwt keys for UI auth w/ SSO (#10326) 2025-04-25 21:30:29 -07:00
Marty SullivanandGitHub 11bb622123 add azure/gpt-image-1 pricing (#10327) 2025-04-25 20:18:56 -07:00
Krish DholakiaandGitHub 70f7c73def Move UI to encrypted token usage (#10302)
* test(test_auth_checks.py): add unit tests for ExperimentalUIJWTToken

* test: add appropriate flag

* fix: fix ruff check

* test: add autouse fixture to test salt key

* fix(user_api_key_auth.py): fix auth flow logic

* test: skip flaky test - anthropic does not reliably return 'redacted_thinking'
2025-04-25 18:20:41 -07:00
Krish DholakiaandGitHub fee3dc970c UI (Teams Page) - Support filtering by team id + team name (#10324)
* feat(team_endpoints.py): support new `/v2/team/list` endpoint - paginated + partial filtering support

Allows UI to support partial filtering on team tab

* feat(teams/): working team filtering based on partial alias

allows easier search on team alias on UI

* fix(teams.tsx): clarify team id needs to be specified (partial match not supported here)

working team id lookup on litellm UI

* fix(proxy/_types.py): allow `/v2/team/list` to be called for internal user

allows filtering

* fix(team_endpoints.py): fix returning non-admin only teams they're a member of

* fix(team_endpoints.py): fix check
2025-04-25 18:19:29 -07:00
Krish DholakiaandGitHub 1cd6e78ccb UI - Add team based filtering to models page (#10325)
* feat(model_dashboard.tsx): make it easier to see all models for a specific team

* fix(model_dashboard.tsx): fix filtering to work for team deselect
2025-04-25 17:39:17 -07:00
Krish DholakiaandGitHub 0f9ebc23a5 Fix SSO user login - invalid token error (#10298)
* fix(ui_sso.py): add info statements for litellm sso

* fix(ui_sso.py): use correct user id on existing user sso login

* refactor(ui_sso.py): break down function for easier testing

* test(test_ui_sso.py): add unit testing

* fix(ui_sso.py): fix passing user id from openid

* fix(ui_sso.py): fix returning user email

* fix(ui_sso.py): pass sso id on new sso user create

better tracking of when user is an sso user

* fix(ui_sso.py): don't auto create key for sso user

* docs(internal_user_endpoints.py): add 'sso_user_id' docstring
2025-04-25 09:48:54 -07:00
o-khytrovandGitHub 21e27b13e6 Update deprecation dates and prices (#10308) 2025-04-25 09:43:35 -07:00
Ishaan Jaff 2e9fb2f6ba # expect an error when getting the response again since 2025-04-25 09:42:35 -07:00
Géraud Le FalherandGitHub 0cc0da37f3 Update image_generation.md (#10312)
Copy parameters `size` and `quality` from [OpenAI API page](https://platform.openai.com/docs/api-reference/images/create)
2025-04-25 08:50:12 -07:00
minatoaquaMK2andGitHub 65b99d6bc3 feat(grafana_dashboard): enable datasource selection via templating (#10257)
This commit updates the Grafana dashboard configuration to include a datasource template variable. This allows users to dynamically select the datasource directly within the Grafana dashboard, improving flexibility and user experience.
2025-04-25 08:49:29 -07:00
Ishaan Jaff 8ed3557ce7 test_init_responses_api_endpoints 2025-04-24 21:43:59 -07:00
Ishaan Jaff cb87dbbd51 fix responses test 2025-04-24 21:23:25 -07:00
5a8b35c3c5 Support max_completion_tokens on Sagemaker (#10243) (#10300)
Co-authored-by: Pranav Simha <pranav.simha@alteryx.com>
2025-04-24 21:15:54 -07:00
Ishaan JaffandGitHub 164017119d [Bug Fix] Timestamp Granularities are not properly passed to whisper in Azure (#10299)
* test fix form data parsing

* test fix form data parsing

* fix types
2025-04-24 18:57:11 -07:00
Ishaan JaffandGitHub 5de101ab7b [Feat] Add GET, DELETE Responses endpoints on LiteLLM Proxy (#10297)
* add GET responses endpoints on router

* add GET responses endpoints on router

* add GET responses endpoints on router

* add DELETE responses endpoints on proxy

* fixes for testing GET, DELETE endpoints

* test_basic_responses api e2e
2025-04-24 17:34:26 -07:00
Ryan ChaseandGitHub 0a2c964db7 adding support for cohere command-a-03-2025 (#10295) 2025-04-24 17:07:29 -07:00
Marc AbramowitzandGitHub 56d00c43f7 Keys page: Use keys rather than logs terminology (#10253) 2025-04-24 14:25:59 -07:00
Christian OwusuandGitHub b82af5b826 Fix UI Flicker in Dashboard (#10261) 2025-04-23 23:27:44 -07:00