Commit Graph
24060 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub ba0881d728 [Bug Fix] image_edit() function returns APIConnectionError with litellm_proxy - Support for both image edits and image generations (#13735)
* add image edits litellm proxy on SDK

* add image gen provider

* add IMG Gen support for litellm_proxy provider
2025-08-18 18:26:32 -07:00
Ishaan JaffandGitHub 76f1064229 [Bug Fix] litellm incompatible with newest release of openAI v1.100.0 (#13728)
* fix imports OpenAI SDK

* ResponseText fixes

* fixes ResponseText

* fix imports

* catch AttributeError

* fix import

* use openai==1.100.1

* fix build from PIP

* fix lint test

* Print OpenAI version

* fix Install dependencies
2025-08-18 18:26:17 -07:00
Ishaan JaffandGitHub ba1d2e8749 [Feat] DD LLM Observability - Add time to first token, litellm overhead, guardrail overhead latency metrics (#13734)
* fixes for DDLLMObsLatencyMetrics

* use _get_latency_metrics

* DD LLM Obs - track latency metrics

* fixes for bedrock guardrails

* DD unit tests

* test DD
2025-08-18 17:38:04 -07:00
Ishaan JaffandGitHub ef08e18c66 [Feat] Datadog LLM Observability - Add support for Failure Logging (#13726)
* add async_log_failure_event for DD LLM Obs

* update types

* DataDogLLMObsLogger  add failure logging support

* test_async_log_failure_event

* dd test failure
2025-08-18 15:19:48 -07:00
Thiago SalvatoreandGitHub 169a17400f fix(vertexai-batch): fix vertexai batch file format (#13576)
* fix(access group): allow access group on mcp tool retrieval

* fix(test): fix broken tests and add test case for access group

* fix(mypy): fix typing issues

* fix(memory file): add content type to in memory file
2025-08-18 10:19:23 -07:00
Ishaan Jaff eee93e250a docs v1.75.5-stable 2025-08-18 09:23:18 -07:00
superpoussin22andGitHub b42df63d17 does not support function (#13612) 2025-08-18 08:45:25 -07:00
Krish DholakiaandGitHub c99277c517 Merge pull request #13694 from BerriAI/litellm_dev_08_16_2025_p3
Litellm dev 08 16 2025 p3
2025-08-17 13:02:17 -07:00
Ishaan Jaff 6c4ced275d ui new build v1.75.8-stable 2025-08-16 19:08:18 -07:00
Ishaan JaffandGitHub 5c4ba732a6 fix client side exception (#13684) 2025-08-16 19:04:06 -07:00
Krrish Dholakia 21549a3463 docs(index.md): write up on session management 2025-08-16 17:55:18 -07:00
Krrish Dholakia cb95f2d5d7 docs(index.md): clarify risk of upgrade 2025-08-16 17:38:50 -07:00
Krrish Dholakia 788a1d03a1 docs(index.md): cleanup 2025-08-16 17:33:07 -07:00
Krrish Dholakia 235b6b040f docs(index.md): add highlight note on redis latency improvements 2025-08-16 17:32:45 -07:00
Krrish Dholakia 8a75ab8388 docs(index.md): cleanup doc 2025-08-16 17:16:04 -07:00
Krish DholakiaandGitHub 50dec7cdee Merge pull request #13682 from BerriAI/litellm_stable_release_fixes
Litellm stable release fixes
2025-08-16 15:10:55 -07:00
Krrish Dholakia e035efeec7 fix(public_model_hub.tsx): fix ui 2025-08-16 14:30:26 -07:00
Krrish Dholakia 6322aef0e3 fix(streaming_handler.py): fix streaming chunk calculation 2025-08-16 14:25:29 -07:00
Krrish Dholakia eb66daeef7 test: update test
we now return correct token usage on clientside
v1.75.8-nightly
2025-08-16 14:14:35 -07:00
Ishaan Jaff d96df5e9be Revert "test_stream_token_counting_anthropic_with_include_usage"
This reverts commit c3aee1194b.
2025-08-16 13:07:00 -07:00
Ishaan Jaff c3aee1194b test_stream_token_counting_anthropic_with_include_usage 2025-08-16 13:06:31 -07:00
Krrish Dholakia 8bb5ee2ba5 test: update unit test 2025-08-16 12:39:03 -07:00
Krrish Dholakia 1ec0808713 test: update test - anthropic returns input tokens in final usage chunk now 2025-08-16 12:31:52 -07:00
Krish DholakiaandGitHub 73f89d51a1 Merge pull request #13629 from BerriAI/budget-duration
Edit Budget Duration + Other Improvements in User Settings
2025-08-16 11:19:07 -07:00
Ishaan JaffandGitHub 5889311b10 [Docs] v1.75.8-stable (#13676)
* v1-75-8

* fix responses API docs

* docs fix

* docs fix new models

* docs links

* docs fix links

* docs sambanova

* docs fix
2025-08-16 09:20:04 -07:00
Ishaan Jaff f522f40228 test_passing_tool_result_as_list 2025-08-16 08:08:25 -07:00
Ishaan Jaff 76939c5e73 ui new build 2025-08-16 07:59:18 -07:00
Ishaan Jaff cac27be56a bump: version 1.75.7 → 1.75.8 2025-08-16 07:58:17 -07:00
Krish DholakiaandGitHub 1b2ec16eee Merge pull request #13640 from yytdfc/fix_bedrock_epc
[Bug Fix] Add cachePoint support for assistant and tool messages in Bedrock
2025-08-16 01:20:28 -07:00
Ishaan JaffandGitHub 40395598da [Feat] UI - Allow editing team member rpm/tpm limits (#13669)
* show team member tpm/rpm limits

* ui - allow setting team settings

* fix better debugging

* fix types: TeamMemberUpdateRequest

* add _upsert_budget_and_membership

* allow updating team member RPM/TPM in teamMemberUpdateCall

* editing team member rpm/tpm

* UI - fixes for team member component

* fix info

* test_upsert_rpm_only_creates_new_budget
2025-08-15 17:29:44 -07:00
0x-fangandGitHub 9f17bedb48 bump up boto3 and aioboto3 versions (#13665) 2025-08-15 17:06:08 -07:00
Ishaan JaffandGitHub 38e5af3580 [Feat] UI QA for Team Member Rate Limits (#13664)
* show team member tpm/rpm limits

* ui - allow setting team settings

* fix better debugging
2025-08-15 16:21:11 -07:00
Ishaan JaffandGitHub 4a10eeb75e [Feat] Team Member Rate Limits - show team member tpm/rpm limits (#13662)
* show team member tpm/rpm limits

* ui - allow setting team settings
2025-08-15 12:18:13 -07:00
Ishaan Jaff f5a1c14929 Revert "update boto3 version to 1.37.38 (#13656)"
This reverts commit 6f2264a13d.
2025-08-15 11:24:59 -07:00
Ishaan Jaff c331473b75 Revert "fix aioboto3"
This reverts commit 82d1cb48b7.
2025-08-15 11:24:50 -07:00
Ishaan Jaff 49bef09a3a Revert "fix aioboto3"
This reverts commit 92c638ec59.
2025-08-15 11:24:41 -07:00
Ishaan Jaff 92c638ec59 fix aioboto3 2025-08-15 11:19:21 -07:00
Ishaan Jaff 82d1cb48b7 fix aioboto3 2025-08-15 11:19:14 -07:00
James PageandGitHub 46e8e50b47 trivy/secrets false positives (#13631)
* alert_to_webhook_url: avoid secret false positive

Trivy detects the example as a potential secret; tweak the hostname
a bit to make it obviously not hooks.slack.com to avoid this.

* Remove log file

Drop log file checked into the git tree; this contains strings that
trivy detects as potential secrets.
2025-08-15 11:10:54 -07:00
Daniel BarkerandGitHub 47edecd5bc Fixed incorrect key info endpoint (#13633) 2025-08-15 11:10:06 -07:00
William FinniganandGitHub 99f30fe5b7 Fix LangfuseOtelSpanAttributes constants to match expected values at https://python.reference.langfuse.com/langfuse#LangfuseOtelSpanAttributes (#13659)
- Update TRACE_USER_ID from 'langfuse.trace.user_id' to 'user.id'
- Update SESSION_ID from 'langfuse.trace.session_id' to 'session.id'
2025-08-15 11:08:32 -07:00
0x-fangandGitHub 6f2264a13d update boto3 version to 1.37.38 (#13656) 2025-08-15 11:06:54 -07:00
Ishaan JaffandGitHub c3608adb0f [Bug Fix] Using stream=True + background=True with Responses API (#13654)
* test_update_responses_api_response_id_with_model_id_handles_dict

* fix linting
2025-08-15 08:58:28 -07:00
d6fa6b60d7 [Feat] UI - Add Confirmation Modal Before Deleting Keys (#13655)
* Enhance key deletion with confirmation input and improved modal UI

Co-authored-by: ishaan <ishaan@berri.ai>

* remove file

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-08-15 08:51:32 -07:00
FuChen bb96d4e23c Add cachePoint support for assistant and tool messages in Bedrock 2025-08-15 12:17:59 +08:00
Ishaan Jaff d29bc4255b bump: version 1.75.6 → 1.75.7 v1.75.7-nightly 2025-08-14 21:13:21 -07:00
FuChen 511363d3a7 test: Add comprehensive test cases for cachePoint support
- test_assistant_message_cache_control: Tests assistant messages with string content and cache_control
- test_assistant_message_list_content_cache_control: Tests assistant messages with list content and cache_control
- test_tool_message_cache_control: Tests tool messages with list content and cache_control
- test_tool_message_string_content_cache_control: Tests tool messages with string content and cache_control
- test_assistant_tool_calls_cache_control: Tests assistant tool_calls with cache_control
- test_multiple_tool_calls_with_mixed_cache_control: Tests multiple tool calls with mixed cache_control
- test_no_cache_control_no_cache_point: Tests that messages without cache_control don't generate cachePoint blocks

These tests ensure that cachePoint blocks are correctly generated for all message types when cache_control is present.
2025-08-15 11:56:34 +08:00
FuChen 210fff585d feat: Add cachePoint support for assistant and tool messages in Bedrock
- Add cachePoint support for assistant messages (both string and list content)
- Add cachePoint support for tool messages (both message-level and content-level cache_control)
- Add cachePoint support for assistant tool_calls
- Move CachePointBlock import to file header for better code organization
- Ensure cachePoint blocks are created as separate content blocks alongside main content

This enables comprehensive cache control across all message types in Bedrock conversations.
2025-08-15 11:40:40 +08:00
Ishaan JaffandGitHub 48c89812c4 [Bug Fix] /messages endpoint - ensure tool use arguments are returned for non-anthropic models (#13638)
* bug fix _translate_streaming_openai_chunk_to_anthropic

* test  test_translate_streaming_openai_chunk_to_anthropic_with_partial_json
2025-08-14 17:29:42 -07:00
17db9edd85 UI - Fix image overflow in LiteLLM model (#13639)
* Improve LiteLLM model name display with better styling and overflow handling

Co-authored-by: ishaan <ishaan@berri.ai>

* Add Tooltip to LiteLLM model name for improved text display

Co-authored-by: ishaan <ishaan@berri.ai>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-08-14 17:29:23 -07:00