Commit Graph

21676 Commits

Author SHA1 Message Date
Ishaan Jaff 1ef17c2f0e fix test_openai_moderation_error_raising 2025-04-29 07:26:41 -07:00
Krrish Dholakia ae7eecaa40 test: mark flaky test 2025-04-29 06:40:26 -07:00
Ishaan Jaff f984089b01 [Reliability fix] Redis transaction buffer - ensure all redis queues are periodically flushed (#10393)
* test_e2e_size_of_redis_buffer

* fix store_in_memory_spend_updates_in_redis

* _commit_spend_updates_to_db_with_redis

* daily_tag_spend_update_transactions

* pip install fakeredis==2.28.1
2025-04-28 21:36:54 -07:00
Ishaan Jaff 72de453cc0 fix gemini/gemini-2.5-pro-exp-03-25 2025-04-28 20:24:40 -07:00
Ishaan Jaff 34cdefbb77 [Feat] Add logging callback support for /moderations API (#10390)
* add OpenAIModerationResponse as a type

* Add typing for litellm.moderation response obj

* Add typing for litellm.moderation response obj

* test_moderations_api_logging

* add assertions for logged slp object

* test_moderations_api_logging

* refactor moderations api usage

* Revert "test_moderations_api_logging"

This reverts commit 5a9001f04c592b063f016d2bb854416255ec6cdf.

* Revert "refactor moderations api usage"

This reverts commit b076d3174ca14251ee3fc28bd4744e25685c1e5f.

* test_moderations_api_logging
2025-04-28 20:24:17 -07:00
Krrish Dholakia 25213f6087 docs: fix docs 2025-04-28 15:36:56 -07:00
Krrish Dholakia a38e2f052e docs: fix docs 2025-04-28 15:36:31 -07:00
Krish Dholakia bf9382a182 Handle more gemini tool calling edge cases + support bedrock 'stable-image-core' (#10351)
* test(test_amazing_vertex_completion.py): try to repro https://github.com/BerriAI/litellm/issues/10319

* fix(common_utils.py): handle edge case on tools

Fixes https://github.com/BerriAI/litellm/issues/10319

* test: add unit testing for infinite loops

* fix(amazon_stability3_transformation.py): support 'stable-image-core' transformation

Fixes https://github.com/BerriAI/litellm/issues/8488

* test: add unit testing for stable image core model

* test: update test
2025-04-28 14:22:29 -07:00
Ishaan Jaff a5ef8a9556 update release note with imgs 2025-04-26 20:14:39 -07:00
Ishaan Jaff 52ceeaeb40 fix code quality check 2025-04-26 19:37:34 -07:00
Ishaan Jaff 2be334eeb1 fix build from pip test 2025-04-26 19:36:47 -07:00
Ishaan Jaff c2f7d7b185 fix linting errors 2025-04-26 19:34:37 -07:00
Ishaan Jaff 4153b8975c fix types/responses/main.py 2025-04-26 19:18:26 -07:00
Ishaan Jaff c8688ee85c fix linting _ENTERPRISE_ResponsesSessionHandler 2025-04-26 19:17:20 -07:00
Ishaan Jaff 15ab172cf5 fix def of ChatCompletionSession 2025-04-26 19:16:20 -07:00
Ishaan Jaff 1e0ee22445 fix build from pip tests 2025-04-26 19:05:28 -07:00
Krrish Dholakia ab4523c080 docs(index.md): cleanup 2025-04-26 19:00:56 -07:00
Krrish Dholakia 1390ae8e18 docs(index.md): cleanup doc 2025-04-26 18:54:08 -07:00
Ishaan Jaff 6f3c158266 [QA] Allow managing sessions with litellm_session_id (#10348)
* allow dynamically setting litellm_session_id

* allow dynamically setting litellm_session_id
2025-04-26 18:52:50 -07:00
Ishaan Jaff fcaac91724 ui new build 2025-04-26 18:25:50 -07:00
Krish Dholakia 2ab00bd12c Litellm UI improvements 04 26 2025 p1 (#10346)
* fix(provider_info_helpers.tsx): fix together ai provider name

* fix(user_edit_view.tsx): all admin to edit user's personal models

* fix(model_dashboard.tsx): fix model filtering by team id check

* fix(proxy_server.py): support returning available models for a user on `/model_group/info`

Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)

* test(test_models.py): add unit test for model group info check on personal key
2025-04-26 18:24:49 -07:00
Ishaan Jaff 42928601b4 bump litellm-proxy-extras 2025-04-26 18:11:06 -07:00
Ishaan Jaff d6103c3962 ui fix linting 2025-04-26 17:44:09 -07:00
Ishaan Jaff c2480db73d [Bug Fix] UI QA - Fix wildcard model test connection not working (#10347)
* fix setFieldsValue for wildcard

* fix async_completion_with_fallbacks

* fix ahealth_check_wildcard_models
2025-04-26 17:42:06 -07:00
Krish Dholakia 31313dd489 Fix - support azure dall e custom pricing (#10339)
* fix(cost_calculator.py): support custom pricing for image gen

Allow user to set custom pricing on azure image gen models

* test(test_cost_calculator.py): add unit test

* test(test_litellm_logging.py): add more unit testing

* fix(litellm_logging.py): fix ruff check
2025-04-26 17:16:03 -07:00
Ishaan Jaff f30479557e fix remove Column Selector, it seems to not be working 2025-04-26 16:36:14 -07:00
Ishaan Jaff f2c9406980 fix /sso/callback (#10345) 2025-04-26 16:27:40 -07:00
Ishaan Jaff 9ab9744fac ui - fix infinite scroll on test key page (#10343) 2025-04-26 16:18:54 -07:00
Ishaan Jaff f694878155 fix SSO (#10344) 2025-04-26 16:17:38 -07:00
Ishaan Jaff 58878aa0bb [UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key (#10342)
* ui fix use same trace id on test key page

* _get_session_id_for_spend_log

* fix linting
2025-04-26 16:02:58 -07:00
Ishaan Jaff faf54e3f29 fixes for EE image v1.67.3.dev6 2025-04-26 15:43:21 -07:00
Ishaan Jaff fd3603d4e8 deploy - add build-and-push-image-ee v1.67.3.dev4 2025-04-26 14:40:20 -07:00
Ishaan Jaff dcfa26c428 docs fix index stable release 2025-04-26 14:31:24 -07:00
Ishaan Jaff 9614d5ba69 docs fix stable release 2025-04-26 14:23:09 -07:00
Ishaan Jaff a0b6766321 docs release notes 2025-04-26 14:02:38 -07:00
Ishaan Jaff cd5f0e809e docs responses API session management 2025-04-26 14:01:24 -07:00
Krrish Dholakia 68c74bb342 build(model_prices_and_context_window.json): add gemini/gemini-2.5-pro-exp-03-25
Addresses https://github.com/BerriAI/litellm/discussions/10058
2025-04-26 12:48:08 -07:00
Ishaan Jaff 3d516fee1f docs responses API GET, DELETE examples 2025-04-26 12:40:21 -07:00
Ishaan Jaff 8c8b786267 doc fix stable release add images of UI improvements 2025-04-26 12:13:59 -07:00
mdonaj b99b0d5010 Fix: Prevent cache token overwrite by last chunk in streaming usage (#10284) 2025-04-26 12:06:12 -07:00
Krish Dholakia 93b6df96e0 Prisma Migrate - support setting custom migration dir (#10336)
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db

* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied

* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras

use the one in litellm-proxy-extras

* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs

Fixes https://github.com/BerriAI/litellm/issues/9885

* fix(utils.py): give helpful warning message when permission denied error raised in fs
2025-04-26 12:05:06 -07:00
Ishaan Jaff f2899cb66e [Docs] v1.67.4-stable (#10338)
* draft 1.67.4

* completed New Models / Updated Models

* docs clean up image gen

* docs azure granularities for whisper

* docs New Models / Updated Models

* docs cohere

* update cohere docs

* complete New Models / Updated Models updates

* docs responses API

* complete Logging / Guardrail Integrations

* completed Logging / Guardrail Integrations

* doc Spend Tracking Improvements

* Logging / Guardrail Integrations
2025-04-26 11:54:18 -07:00
Ishaan Jaff dd8a7e15a8 bump: version 1.67.3 → 1.67.4 v1.67.4-nightly 2025-04-26 08:30:50 -07:00
Ishaan Jaff 93759b4cc7 ui new build 2025-04-26 08:28:49 -07:00
Ishaan Jaff f7e75fa276 [Docs] UI Session Logs (#10334)
* add ui logs session doc

* docs add instructions on how to do session management

* docs session management

* docs session management

* docs responses api session management

* docs ui logs
2025-04-26 08:26:23 -07:00
Krrish Dholakia 421011baec build(model_prices_and_context_window.json): update azure o1-mini pricing 2025-04-26 08:05:09 -07:00
Christian Owusu 350bae9be0 Internal Users: Refresh user list on create (#10296)
* Clean up

* Refactor

* Internal Users: Refresh user list on create
2025-04-26 08:01:24 -07:00
Ishaan Jaff 8d73259561 ui session management - link to docs 2025-04-26 07:55:28 -07:00
Nandini Bagga ab9705781f create key table render fix (#10224)
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-04-26 07:51:56 -07:00
Ishaan Jaff c114da1c6d bump litellm proxy extras 2025-04-26 07:46:33 -07:00