Ishaan Jaff
1ef17c2f0e
fix test_openai_moderation_error_raising
2025-04-29 07:26:41 -07:00
Krrish Dholakia
ae7eecaa40
test: mark flaky test
2025-04-29 06:40:26 -07:00
Ishaan Jaff
f984089b01
[Reliability fix] Redis transaction buffer - ensure all redis queues are periodically flushed ( #10393 )
...
* test_e2e_size_of_redis_buffer
* fix store_in_memory_spend_updates_in_redis
* _commit_spend_updates_to_db_with_redis
* daily_tag_spend_update_transactions
* pip install fakeredis==2.28.1
2025-04-28 21:36:54 -07:00
Ishaan Jaff
72de453cc0
fix gemini/gemini-2.5-pro-exp-03-25
2025-04-28 20:24:40 -07:00
Ishaan Jaff
34cdefbb77
[Feat] Add logging callback support for /moderations API ( #10390 )
...
* add OpenAIModerationResponse as a type
* Add typing for litellm.moderation response obj
* Add typing for litellm.moderation response obj
* test_moderations_api_logging
* add assertions for logged slp object
* test_moderations_api_logging
* refactor moderations api usage
* Revert "test_moderations_api_logging"
This reverts commit 5a9001f04c592b063f016d2bb854416255ec6cdf.
* Revert "refactor moderations api usage"
This reverts commit b076d3174ca14251ee3fc28bd4744e25685c1e5f.
* test_moderations_api_logging
2025-04-28 20:24:17 -07:00
Krrish Dholakia
25213f6087
docs: fix docs
2025-04-28 15:36:56 -07:00
Krrish Dholakia
a38e2f052e
docs: fix docs
2025-04-28 15:36:31 -07:00
Krish Dholakia
bf9382a182
Handle more gemini tool calling edge cases + support bedrock 'stable-image-core' ( #10351 )
...
* test(test_amazing_vertex_completion.py): try to repro https://github.com/BerriAI/litellm/issues/10319
* fix(common_utils.py): handle edge case on tools
Fixes https://github.com/BerriAI/litellm/issues/10319
* test: add unit testing for infinite loops
* fix(amazon_stability3_transformation.py): support 'stable-image-core' transformation
Fixes https://github.com/BerriAI/litellm/issues/8488
* test: add unit testing for stable image core model
* test: update test
2025-04-28 14:22:29 -07:00
Ishaan Jaff
a5ef8a9556
update release note with imgs
2025-04-26 20:14:39 -07:00
Ishaan Jaff
52ceeaeb40
fix code quality check
2025-04-26 19:37:34 -07:00
Ishaan Jaff
2be334eeb1
fix build from pip test
2025-04-26 19:36:47 -07:00
Ishaan Jaff
c2f7d7b185
fix linting errors
2025-04-26 19:34:37 -07:00
Ishaan Jaff
4153b8975c
fix types/responses/main.py
2025-04-26 19:18:26 -07:00
Ishaan Jaff
c8688ee85c
fix linting _ENTERPRISE_ResponsesSessionHandler
2025-04-26 19:17:20 -07:00
Ishaan Jaff
15ab172cf5
fix def of ChatCompletionSession
2025-04-26 19:16:20 -07:00
Ishaan Jaff
1e0ee22445
fix build from pip tests
2025-04-26 19:05:28 -07:00
Krrish Dholakia
ab4523c080
docs(index.md): cleanup
2025-04-26 19:00:56 -07:00
Krrish Dholakia
1390ae8e18
docs(index.md): cleanup doc
2025-04-26 18:54:08 -07:00
Ishaan Jaff
6f3c158266
[QA] Allow managing sessions with litellm_session_id ( #10348 )
...
* allow dynamically setting litellm_session_id
* allow dynamically setting litellm_session_id
2025-04-26 18:52:50 -07:00
Ishaan Jaff
fcaac91724
ui new build
2025-04-26 18:25:50 -07:00
Krish Dholakia
2ab00bd12c
Litellm UI improvements 04 26 2025 p1 ( #10346 )
...
* fix(provider_info_helpers.tsx): fix together ai provider name
* fix(user_edit_view.tsx): all admin to edit user's personal models
* fix(model_dashboard.tsx): fix model filtering by team id check
* fix(proxy_server.py): support returning available models for a user on `/model_group/info`
Fixes issue where personal key with 'all team models' would see all proxy models (not just the ones user can call)
* test(test_models.py): add unit test for model group info check on personal key
2025-04-26 18:24:49 -07:00
Ishaan Jaff
42928601b4
bump litellm-proxy-extras
2025-04-26 18:11:06 -07:00
Ishaan Jaff
d6103c3962
ui fix linting
2025-04-26 17:44:09 -07:00
Ishaan Jaff
c2480db73d
[Bug Fix] UI QA - Fix wildcard model test connection not working ( #10347 )
...
* fix setFieldsValue for wildcard
* fix async_completion_with_fallbacks
* fix ahealth_check_wildcard_models
2025-04-26 17:42:06 -07:00
Krish Dholakia
31313dd489
Fix - support azure dall e custom pricing ( #10339 )
...
* fix(cost_calculator.py): support custom pricing for image gen
Allow user to set custom pricing on azure image gen models
* test(test_cost_calculator.py): add unit test
* test(test_litellm_logging.py): add more unit testing
* fix(litellm_logging.py): fix ruff check
2025-04-26 17:16:03 -07:00
Ishaan Jaff
f30479557e
fix remove Column Selector, it seems to not be working
2025-04-26 16:36:14 -07:00
Ishaan Jaff
f2c9406980
fix /sso/callback ( #10345 )
2025-04-26 16:27:40 -07:00
Ishaan Jaff
9ab9744fac
ui - fix infinite scroll on test key page ( #10343 )
2025-04-26 16:18:54 -07:00
Ishaan Jaff
f694878155
fix SSO ( #10344 )
2025-04-26 16:17:38 -07:00
Ishaan Jaff
58878aa0bb
[UI] Fixes for sessions on UI - ensure errors have a session and use 1 session for test key ( #10342 )
...
* ui fix use same trace id on test key page
* _get_session_id_for_spend_log
* fix linting
2025-04-26 16:02:58 -07:00
Ishaan Jaff
faf54e3f29
fixes for EE image
v1.67.3.dev6
2025-04-26 15:43:21 -07:00
Ishaan Jaff
fd3603d4e8
deploy - add build-and-push-image-ee
v1.67.3.dev4
2025-04-26 14:40:20 -07:00
Ishaan Jaff
dcfa26c428
docs fix index stable release
2025-04-26 14:31:24 -07:00
Ishaan Jaff
9614d5ba69
docs fix stable release
2025-04-26 14:23:09 -07:00
Ishaan Jaff
a0b6766321
docs release notes
2025-04-26 14:02:38 -07:00
Ishaan Jaff
cd5f0e809e
docs responses API session management
2025-04-26 14:01:24 -07:00
Krrish Dholakia
68c74bb342
build(model_prices_and_context_window.json): add gemini/gemini-2.5-pro-exp-03-25
...
Addresses https://github.com/BerriAI/litellm/discussions/10058
2025-04-26 12:48:08 -07:00
Ishaan Jaff
3d516fee1f
docs responses API GET, DELETE examples
2025-04-26 12:40:21 -07:00
Ishaan Jaff
8c8b786267
doc fix stable release add images of UI improvements
2025-04-26 12:13:59 -07:00
mdonaj
b99b0d5010
Fix: Prevent cache token overwrite by last chunk in streaming usage ( #10284 )
2025-04-26 12:06:12 -07:00
Krish Dholakia
93b6df96e0
Prisma Migrate - support setting custom migration dir ( #10336 )
...
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db
* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied
* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras
use the one in litellm-proxy-extras
* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs
Fixes https://github.com/BerriAI/litellm/issues/9885
* fix(utils.py): give helpful warning message when permission denied error raised in fs
2025-04-26 12:05:06 -07:00
Ishaan Jaff
f2899cb66e
[Docs] v1.67.4-stable ( #10338 )
...
* draft 1.67.4
* completed New Models / Updated Models
* docs clean up image gen
* docs azure granularities for whisper
* docs New Models / Updated Models
* docs cohere
* update cohere docs
* complete New Models / Updated Models updates
* docs responses API
* complete Logging / Guardrail Integrations
* completed Logging / Guardrail Integrations
* doc Spend Tracking Improvements
* Logging / Guardrail Integrations
2025-04-26 11:54:18 -07:00
Ishaan Jaff
dd8a7e15a8
bump: version 1.67.3 → 1.67.4
v1.67.4-nightly
2025-04-26 08:30:50 -07:00
Ishaan Jaff
93759b4cc7
ui new build
2025-04-26 08:28:49 -07:00
Ishaan Jaff
f7e75fa276
[Docs] UI Session Logs ( #10334 )
...
* add ui logs session doc
* docs add instructions on how to do session management
* docs session management
* docs session management
* docs responses api session management
* docs ui logs
2025-04-26 08:26:23 -07:00
Krrish Dholakia
421011baec
build(model_prices_and_context_window.json): update azure o1-mini pricing
2025-04-26 08:05:09 -07:00
Christian Owusu
350bae9be0
Internal Users: Refresh user list on create ( #10296 )
...
* Clean up
* Refactor
* Internal Users: Refresh user list on create
2025-04-26 08:01:24 -07:00
Ishaan Jaff
8d73259561
ui session management - link to docs
2025-04-26 07:55:28 -07:00
Nandini Bagga
ab9705781f
create key table render fix ( #10224 )
...
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
2025-04-26 07:51:56 -07:00
Ishaan Jaff
c114da1c6d
bump litellm proxy extras
2025-04-26 07:46:33 -07:00