Commit Graph
23118 Commits
Author SHA1 Message Date
o-khytrovandGitHub 21e27b13e6 Update deprecation dates and prices (#10308) 2025-04-25 09:43:35 -07:00
Ishaan Jaff 2e9fb2f6ba # expect an error when getting the response again since 2025-04-25 09:42:35 -07:00
Géraud Le FalherandGitHub 0cc0da37f3 Update image_generation.md (#10312)
Copy parameters `size` and `quality` from [OpenAI API page](https://platform.openai.com/docs/api-reference/images/create)
2025-04-25 08:50:12 -07:00
minatoaquaMK2andGitHub 65b99d6bc3 feat(grafana_dashboard): enable datasource selection via templating (#10257)
This commit updates the Grafana dashboard configuration to include a datasource template variable. This allows users to dynamically select the datasource directly within the Grafana dashboard, improving flexibility and user experience.
2025-04-25 08:49:29 -07:00
Ishaan Jaff 8ed3557ce7 test_init_responses_api_endpoints 2025-04-24 21:43:59 -07:00
Ishaan Jaff cb87dbbd51 fix responses test 2025-04-24 21:23:25 -07:00
5a8b35c3c5 Support max_completion_tokens on Sagemaker (#10243) (#10300)
Co-authored-by: Pranav Simha <pranav.simha@alteryx.com>
2025-04-24 21:15:54 -07:00
Ishaan JaffandGitHub 164017119d [Bug Fix] Timestamp Granularities are not properly passed to whisper in Azure (#10299)
* test fix form data parsing

* test fix form data parsing

* fix types
2025-04-24 18:57:11 -07:00
Ishaan JaffandGitHub 5de101ab7b [Feat] Add GET, DELETE Responses endpoints on LiteLLM Proxy (#10297)
* add GET responses endpoints on router

* add GET responses endpoints on router

* add GET responses endpoints on router

* add DELETE responses endpoints on proxy

* fixes for testing GET, DELETE endpoints

* test_basic_responses api e2e
2025-04-24 17:34:26 -07:00
Ryan ChaseandGitHub 0a2c964db7 adding support for cohere command-a-03-2025 (#10295) 2025-04-24 17:07:29 -07:00
Marc AbramowitzandGitHub 56d00c43f7 Keys page: Use keys rather than logs terminology (#10253) 2025-04-24 14:25:59 -07:00
Christian OwusuandGitHub b82af5b826 Fix UI Flicker in Dashboard (#10261) 2025-04-23 23:27:44 -07:00
Krrish Dholakia 2adb2fc6a5 test: handle service unavailable error 2025-04-23 22:10:46 -07:00
Krrish Dholakia 620a0f4805 bump: version 1.67.2 → 1.67.3 v1.67.3.dev1 2025-04-23 22:09:25 -07:00
Krrish Dholakia 05d617bea0 build(ui/): new ui build 2025-04-23 22:09:14 -07:00
Krish DholakiaandGitHub ab68af4ff5 Litellm multi admin fixes (#10259)
* fix(create_user_button.tsx): do not set 'no-default-models' when user is a proxy admin

* fix(user_info_view.tsx): show all user personal models

* feat(user_info_view.tsx): allow giving users more personal models

* feat(user_edit_view.tsx): allow proxy admin to edit user role, available models, etc.
2025-04-23 22:02:02 -07:00
Krish DholakiaandGitHub 430cc60e62 Litellm fix UI login (#10260)
* fix(user_dashboard.tsx): add token expiry logic to user dashboard

if token expired redirect to `/sso/key/generate` for login

* fix(user_dashboard.tsx): check key health on login - if invalid -> redirect to login

handles invalid / expired key scenario

* fix(user_dashboard.tsx): fix linting error

* fix(page.tsx): fix invitation link flow
2025-04-23 22:01:38 -07:00
Krish DholakiaandGitHub be4152c8d5 UI - fix edit azure public model name + fix editing model name post create
* test(test_router.py): add unit test confirming fallbacks with tag based routing works as expected

* test: update testing

* test: update test to not use gemini-pro

google removed it

* fix(conditional_public_model_name.tsx): edit azure public model name

Fixes https://github.com/BerriAI/litellm/issues/10093

* fix(model_info_view.tsx): migrate to patch model updates

Enables changing model name easily
2025-04-23 21:56:56 -07:00
Krish DholakiaandGitHub acd2c1783c fix(converse_transformation.py): support all bedrock - openai params for arn models (#10256)
Fixes https://github.com/BerriAI/litellm/issues/10207
2025-04-23 21:56:05 -07:00
Krrish Dholakia 6023427dae docs(gemini.md): cleanup 2025-04-23 21:54:12 -07:00
Krrish Dholakia 2486a106f4 test: mark flaky tests 2025-04-23 21:50:25 -07:00
Christian OwusuandGitHub a260afb74d Reset key alias value when resetting filters (#10099) 2025-04-23 21:04:40 -07:00
Dimitri Papadopoulos OrfanosandGitHub 5e2fd49dd3 Fix typos (#10232) 2025-04-23 20:59:25 -07:00
Ishaan JaffandGitHub f3291bde4d fix for serviceAccountName on migration job (#10258) 2025-04-23 20:56:31 -07:00
Krrish Dholakia 1014529ed6 build(ui/): update ui build 2025-04-23 16:55:35 -07:00
Krish DholakiaandGitHub edd15b0905 fix(user_dashboard.tsx): add token expiry logic to user dashboard (#10250)
* fix(user_dashboard.tsx): add token expiry logic to user dashboard

if token expired redirect to `/sso/key/generate` for login

* fix(user_dashboard.tsx): check key health on login - if invalid -> redirect to login

handles invalid / expired key scenario

* fix(user_dashboard.tsx): fix linting error

* fix(page.tsx): fix invitation link flow
2025-04-23 16:51:27 -07:00
dc9b058dbd [Feat] Add support for GET Responses Endpoint - OpenAI, Azure OpenAI (#10235)
* Added get responses API (#10234)

* test_basic_openai_responses_get_endpoint

* transform_get_response_api_request

* test_basic_openai_responses_get_endpoint

---------

Co-authored-by: Prathamesh Saraf <pratamesh1867@gmail.com>
2025-04-23 15:19:29 -07:00
Ishaan JaffandGitHub 2e58e47b43 [Bug Fix] Add Cost Tracking for gpt-image-1 when quality is unspecified (#10247)
* TestOpenAIGPTImage1

* fixes for cost calc

* fix ImageGenerationRequestQuality.MEDIUM
2025-04-23 15:16:40 -07:00
Ishaan Jaff baa5564f95 cleanup remove stale dir 2025-04-23 14:07:43 -07:00
Ishaan JaffandGitHub 36ee132514 [Feat] Add gpt-image-1 cost tracking (#10241)
* add gpt-image-1

* add gpt-image-1 example to docs
2025-04-23 12:20:55 -07:00
Krrish Dholakia a649f10e63 test: update test to not use gemini-pro
google removed it
v1.67.2-nightly
2025-04-23 11:31:09 -07:00
Krrish Dholakia 8184124217 test: update testing 2025-04-23 11:21:50 -07:00
Krrish Dholakia 174a1aa007 test: update test 2025-04-23 10:51:18 -07:00
Christian OwusuandGitHub 47420d8d68 Require auth for all dashboard pages (#10229)
* Require authentication for all Dashboard pages

* Add test

* Add test
2025-04-23 07:08:25 -07:00
Dimitri Papadopoulos OrfanosandGitHub 34be7ffceb Discard duplicate sentence (#10231) 2025-04-23 07:05:29 -07:00
Krrish Dholakia f5996b2f6b test: update test to skip 'gemini-pro' - model deprecated 2025-04-23 00:01:02 -07:00
Krish DholakiaandGitHub 217681eb5e Litellm dev 04 22 2025 p1 (#10206)
* fix(openai.py): initial commit adding generic event type for openai responses api streaming

Ensures handling for undocumented event types - e.g. "response.reasoning_summary_part.added"

* fix(transformation.py): handle unknown openai response type

* fix(datadog_llm_observability.py): handle dict[str, any] -> dict[str, str] conversion

Fixes https://github.com/BerriAI/litellm/issues/9494

* test: add more unit testing

* test: add unit test

* fix(common_utils.py): fix message with content list

* test: update testing
2025-04-22 23:58:43 -07:00
Krish DholakiaandGitHub f670ebeb2f Users page - new user info pane (#10213)
* feat(user_info_view.tsx): be able to click in and see all teams user is part of

makes it easy to see which teams a user belongs to

* test(ui/): add unit testing for user info view

* fix(user_info_view.tsx): fix linting errors

* fix(login.ts): fix login

* fix: fix linting error
2025-04-22 21:55:47 -07:00
Krrish Dholakia 31f704a370 fix(internal_user_endpoints.py): add check on sortby value 2025-04-22 21:41:13 -07:00
Ishaan Jaff 1e3a1cba23 bump: version 1.67.1 → 1.67.2 2025-04-22 21:35:23 -07:00
96e31d205c feat: Added Missing Attributes For Arize & Phoenix Integration (#10043) (#10215)
* feat: Added Missing Attributes For Arize & Phoenix Integration

* chore: Added noqa for PLR0915 to suppress warning

* chore: Moved Contributor Test to Correct Location

* chore: Removed Redundant Fallback

Co-authored-by: Ali Saleh <saleh.a@turing.com>
2025-04-22 21:34:51 -07:00
Krish DholakiaandGitHub 5f98d4d7de UI - Users page - Enable global sorting (allows finding users with highest spend) (#10211)
* fix(view_users.tsx): add time tracking logic to debounce search - prevent new queries from being overwritten by previous ones

* fix(internal_user_endpoints.py): add sort functionality to user list endpoint

* feat(internal_user_endpoints.py): support sort by on `/user/list`

* fix(view_users.tsx): enable global sorting

allows finding user with highest spend

* feat(view_users.tsx): support filtering by sso user id

* test(search_users.spec.ts): add tests to ensure filtering works

* test: add more unit testing
2025-04-22 19:59:53 -07:00
Ishaan Jaff 0dba2886f0 fix test 2025-04-22 18:37:56 -07:00
Ishaan Jaff 6e4fed59b6 docs agent ops logging 2025-04-22 18:32:28 -07:00
b96d2ea422 Bug Fix - Address deprecation of open_text (#10208)
* Update utils.py (#10201)

* fixes importlib

---------

Co-authored-by: Nathan Brake <33383515+njbrake@users.noreply.github.com>
2025-04-22 18:29:56 -07:00
Ishaan JaffandGitHub 868cdd0226 [Feat] Add Support for DELETE /v1/responses/{response_id} on OpenAI, Azure OpenAI (#10205)
* add transform_delete_response_api_request to base responses config

* add transform_delete_response_api_request

* add delete_response_api_handler

* fixes for deleting responses, response API

* add adelete_responses

* add async test_basic_openai_responses_delete_endpoint

* test_basic_openai_responses_delete_endpoint

* working delete for streaming on responses API

* fixes azure transformation

* TestAnthropicResponsesAPITest

* fix code check

* fix linting

* fixes for get_complete_url

* test_basic_openai_responses_streaming_delete_endpoint

* streaming fixes
2025-04-22 18:27:03 -07:00
Ishaan Jaff 2bb51866b1 fix azure/computer-use-preview native streaming 2025-04-22 18:21:06 -07:00
Ishaan Jaff 44264ab6d6 fix failing agent ops test 2025-04-22 14:39:50 -07:00
Krish DholakiaandGitHub 66680c421d Add global filtering to Users tab (#10195)
* style(internal_user_endpoints.py): add response model to `/user/list` endpoint

make sure we maintain consistent response spec

* fix(key_management_endpoints.py): return 'created_at' and 'updated_at' on `/key/generate`

Show 'created_at' on UI when key created

* test(test_keys.py): add e2e test to ensure created at is always returned

* fix(view_users.tsx): support global search by user email

allows easier search

* test(search_users.spec.ts): add e2e test ensure user search works on admin ui

* fix(view_users.tsx): support filtering user by role and user id

More powerful filtering on internal users table

* fix(view_users.tsx): allow filtering users by team

* style(view_users.tsx): cleanup ui to show filters in consistent style

* refactor(view_users.tsx): cleanup to just use 1 variable for the data

* fix(view_users.tsx): cleanup use effect hooks

* fix(internal_user_endpoints.py): fix check to pass testing

* test: update tests

* test: update tests

* Revert "test: update tests"

This reverts commit 6553eeb2325f77e302ff67d6c1fc736e67f854bb.

* fix(view_userts.tsx): add back in 'previous' and 'next' tabs for pagination
2025-04-22 13:59:43 -07:00
DwijandGitHub b2955a2bdd Add AgentOps Integration to LiteLLM (#9685)
* feat(sidebars): add new item for agentops integration in Logging & Observability category

* Update agentops_integration.md to enhance title formatting and remove redundant section

* Enhance AgentOps integration in documentation and codebase by removing LiteLLMCallbackHandler references, adding environment variable configurations, and updating logging initialization for AgentOps support.

* Update AgentOps integration documentation to include instructions for obtaining API keys and clarify environment variable setup.

* Add unit tests for AgentOps integration and improve error handling in token fetching

* Add unit tests for AgentOps configuration and token fetching functionality

* Corrected agentops test directory

* Linting fix

* chore: add OpenTelemetry dependencies to pyproject.toml

* chore: update OpenTelemetry dependencies and add new packages in pyproject.toml and poetry.lock
2025-04-22 10:29:01 -07:00