tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-05 10:24:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
21,673 Commits 2,072 Branches 1,425 Tags
72de453cc01e16d2e2cb5b6ab8e0e23f9c40d33d
Commit Graph
21673 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff 72de453cc0 fix gemini/gemini-2.5-pro-exp-03-25 2025-04-28 20:24:40 -07:00
Ishaan JaffandGitHub 34cdefbb77 [Feat] Add logging callback support for /moderations API (#10390) 
* add OpenAIModerationResponse as a type

* Add typing for litellm.moderation response obj

* Add typing for litellm.moderation response obj

* test_moderations_api_logging

* add assertions for logged slp object

* test_moderations_api_logging

* refactor moderations api usage

* Revert "test_moderations_api_logging"

This reverts commit 5a9001f04c592b063f016d2bb854416255ec6cdf.

* Revert "refactor moderations api usage"

This reverts commit b076d3174ca14251ee3fc28bd4744e25685c1e5f.

* test_moderations_api_logging
 2025-04-28 20:24:17 -07:00
Krrish Dholakia 25213f6087 docs: fix docs 2025-04-28 15:36:56 -07:00
Krrish Dholakia a38e2f052e docs: fix docs 2025-04-28 15:36:31 -07:00
Krish DholakiaandGitHub bf9382a182 Handle more gemini tool calling edge cases + support bedrock 'stable-image-core' (#10351) 
* test(test_amazing_vertex_completion.py): try to repro https://github.com/BerriAI/litellm/issues/10319

* fix(common_utils.py): handle edge case on tools

Fixes https://github.com/BerriAI/litellm/issues/10319

* test: add unit testing for infinite loops

* fix(amazon_stability3_transformation.py): support 'stable-image-core' transformation

Fixes https://github.com/BerriAI/litellm/issues/8488

* test: add unit testing for stable image core model

* test: update test
 2025-04-28 14:22:29 -07:00
Ishaan Jaff a5ef8a9556 update release note with imgs 2025-04-26 20:14:39 -07:00
Ishaan Jaff 52ceeaeb40 fix code quality check 2025-04-26 19:37:34 -07:00
Ishaan Jaff 2be334eeb1 fix build from pip test 2025-04-26 19:36:47 -07:00
Ishaan Jaff c2f7d7b185 fix linting errors 2025-04-26 19:34:37 -07:00
Ishaan Jaff 4153b8975c fix types/responses/main.py 2025-04-26 19:18:26 -07:00
Ishaan Jaff c8688ee85c fix linting _ENTERPRISE_ResponsesSessionHandler 2025-04-26 19:17:20 -07:00
Ishaan Jaff 15ab172cf5 fix def of ChatCompletionSession 2025-04-26 19:16:20 -07:00
Ishaan Jaff 1e0ee22445 fix build from pip tests 2025-04-26 19:05:28 -07:00
Krrish Dholakia ab4523c080 docs(index.md): cleanup 2025-04-26 19:00:56 -07:00
Krrish Dholakia 1390ae8e18 docs(index.md): cleanup doc 2025-04-26 18:54:08 -07:00
Ishaan JaffandGitHub 6f3c158266 [QA] Allow managing sessions with litellm_session_id (#10348) 
* allow dynamically setting litellm_session_id

* allow dynamically setting litellm_session_id
 2025-04-26 18:52:50 -07:00
Ishaan Jaff fcaac91724 ui new build 2025-04-26 18:25:50 -07:00
Krish DholakiaandGitHub 2ab00bd12c Litellm UI improvements 04 26 2025 p1 (#10346) 
* fix(provider_info_helpers.tsx): fix together ai provider name

* fix(user_edit_view.tsx): all admin to edit user's personal models

* fix(model_dashboard.tsx): fix model filtering by team id check

* fix(proxy_server.py): support returning available models for a user on `/model_group/info`

Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)

* test(test_models.py): add unit test for model group info check on personal key
 2025-04-26 18:24:49 -07:00
Ishaan Jaff 42928601b4 bump litellm-proxy-extras 2025-04-26 18:11:06 -07:00
Ishaan Jaff d6103c3962 ui fix linting 2025-04-26 17:44:09 -07:00
Ishaan JaffandGitHub c2480db73d [Bug Fix] UI QA - Fix wildcard model test connection not working (#10347) 
* fix setFieldsValue for wildcard

* fix async_completion_with_fallbacks

* fix ahealth_check_wildcard_models
 2025-04-26 17:42:06 -07:00
Krish DholakiaandGitHub 31313dd489 Fix - support azure dall e custom pricing (#10339) 
* fix(cost_calculator.py): support custom pricing for image gen

Allow user to set custom pricing on azure image gen models

* test(test_cost_calculator.py): add unit test

* test(test_litellm_logging.py): add more unit testing

* fix(litellm_logging.py): fix ruff check
 2025-04-26 17:16:03 -07:00
Ishaan Jaff f30479557e fix remove Column Selector, it seems to not be working 2025-04-26 16:36:14 -07:00
Ishaan JaffandGitHub f2c9406980 fix /sso/callback (#10345) 2025-04-26 16:27:40 -07:00
Ishaan JaffandGitHub 9ab9744fac ui - fix infinite scroll on test key page (#10343) 2025-04-26 16:18:54 -07:00
Ishaan JaffandGitHub f694878155 fix SSO (#10344) 2025-04-26 16:17:38 -07:00
Ishaan JaffandGitHub 58878aa0bb [UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key (#10342) 
* ui fix use same trace id on test key page

* _get_session_id_for_spend_log

* fix linting
 2025-04-26 16:02:58 -07:00
Ishaan Jaff faf54e3f29 fixes for EE image v1.67.3.dev6 2025-04-26 15:43:21 -07:00
Ishaan Jaff fd3603d4e8 deploy - add build-and-push-image-ee v1.67.3.dev4 2025-04-26 14:40:20 -07:00
Ishaan Jaff dcfa26c428 docs fix index stable release 2025-04-26 14:31:24 -07:00
Ishaan Jaff 9614d5ba69 docs fix stable release 2025-04-26 14:23:09 -07:00
Ishaan Jaff a0b6766321 docs release notes 2025-04-26 14:02:38 -07:00
Ishaan Jaff cd5f0e809e docs responses API session management 2025-04-26 14:01:24 -07:00
Krrish Dholakia 68c74bb342 build(model_prices_and_context_window.json): add gemini/gemini-2.5-pro-exp-03-25 
Addresses https://github.com/BerriAI/litellm/discussions/10058
 2025-04-26 12:48:08 -07:00
Ishaan Jaff 3d516fee1f docs responses API GET, DELETE examples 2025-04-26 12:40:21 -07:00
Ishaan Jaff 8c8b786267 doc fix stable release add images of UI improvements 2025-04-26 12:13:59 -07:00
mdonajandGitHub b99b0d5010 Fix: Prevent cache token overwrite by last chunk in streaming usage (#10284) 2025-04-26 12:06:12 -07:00
Krish DholakiaandGitHub 93b6df96e0 Prisma Migrate - support setting custom migration dir (#10336) 
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db

* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied

* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras

use the one in litellm-proxy-extras

* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs

Fixes https://github.com/BerriAI/litellm/issues/9885

* fix(utils.py): give helpful warning message when permission denied error raised in fs
 2025-04-26 12:05:06 -07:00
Ishaan JaffandGitHub f2899cb66e [Docs] v1.67.4-stable (#10338) 
* draft 1.67.4

* completed New Models / Updated Models

* docs clean up image gen

* docs azure granularities for whisper

* docs New Models / Updated Models

* docs cohere

* update cohere docs

* complete New Models / Updated Models updates

* docs responses API

* complete Logging / Guardrail Integrations

* completed Logging / Guardrail Integrations

* doc Spend Tracking Improvements

* Logging / Guardrail Integrations
 2025-04-26 11:54:18 -07:00
Ishaan Jaff dd8a7e15a8 bump: version 1.67.3 → 1.67.4 v1.67.4-nightly 2025-04-26 08:30:50 -07:00
Ishaan Jaff 93759b4cc7 ui new build 2025-04-26 08:28:49 -07:00
Ishaan JaffandGitHub f7e75fa276 [Docs] UI Session Logs (#10334) 
* add ui logs session doc

* docs add instructions on how to do session management

* docs session management

* docs session management

* docs responses api session management

* docs ui logs
 2025-04-26 08:26:23 -07:00
Krrish Dholakia 421011baec build(model_prices_and_context_window.json): update azure o1-mini pricing 2025-04-26 08:05:09 -07:00
Christian OwusuandGitHub 350bae9be0 Internal Users: Refresh user list on create (#10296) 
* Clean up

* Refactor

* Internal Users: Refresh user list on create
 2025-04-26 08:01:24 -07:00
Ishaan Jaff 8d73259561 ui session management - link to docs 2025-04-26 07:55:28 -07:00
Nandini BaggaGitHubKrish Dholakia
 		ab9705781f create key table render fix (#10224) 
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
 2025-04-26 07:51:56 -07:00
Ishaan Jaff c114da1c6d bump litellm proxy extras 2025-04-26 07:46:33 -07:00
Ishaan JaffandGitHub 331e784db4 [Feat] Responses API - Add session management support for non-openai models (#10321) 
* add session id in spendLogs

* fix log proxy server request as independant field

* use trace id for SpendLogs

* add _ENTERPRISE_ResponsesSessionHandler

* use _ENTERPRISE_ResponsesSessionHandler

* working session_ids

* working session management

* working session_ids

* test_async_gcs_pub_sub_v1

* test_spend_logs_payload_e2e

* working session_ids

* test_get_standard_logging_payload_trace_id

* test_get_standard_logging_payload_trace_id

* test_gcs_pub_sub.py

* fix all linting errors

* test_spend_logs_payload_with_prompts_enabled

* _ENTERPRISE_ResponsesSessionHandler

* _ENTERPRISE_ResponsesSessionHandler

* expose session id on ui

* get spend logs by session

* add sessionSpendLogsCall

* add session handling

* session logs

* ui session details

* fix on rowExpandDetails

* ui working sessions
 2025-04-25 23:24:24 -07:00
Krish DholakiaandGitHub c66c821f96 UI (Keys Page) - Support cross filtering, filter by user id, filter by key hash (#10322) 
* feat(filter.tsx): initial commit making filter component more generic - same style as user table filters

* refactor(all_keys_table.tsx): refactor to simplify update logic

* fix: partially revert changes - reduce scope of pr

* fix(filter_logic.tsx): fix filter update logic

* fix(all_keys_table.tsx): fix filtering + search logic

* refactor: cleanup unused params

* Revert "fix(all_keys_table.tsx): fix filtering + search logic"

This reverts commit 5fbc3319702080fa987bee7b0a89e1cb635dd6be.

* feat(filter_logic.tsx): allow filter by user id

* fix(key_management_endpoints.py): support filtering `/key/list` by  key hash

Enables lookup by key hash on ui

* fix(key_list.tsx): fix update

* fix(key_management.py): fix linting error

* test: update testing

* fix(prometheus.py): fix key hash

* style(all_keys_table.tsx): style improvements

* test: fix test
 2025-04-25 21:30:56 -07:00
Krish DholakiaandGitHub 339351c579 fix(ui_sso.py): support experimental jwt keys for UI auth w/ SSO (#10326) 2025-04-25 21:30:29 -07:00