Commit Graph
27201 Commits
Author SHA1 Message Date
Ishaan Jaffer 1d2bdaebb6 test_openai_streaming_logging 2025-11-08 11:49:36 -08:00
Ishaan Jaffer 9b4e32c880 Revert "Added support for desabling thoughts by setting budget to 0 (#16347)"
This reverts commit b6f792f301.
2025-11-08 11:34:05 -08:00
Ishaan Jaffer c5f87d1d65 test responses api non streaming 2025-11-08 11:32:08 -08:00
Ishaan Jaffer 4fb521c251 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 11:12:35 -08:00
Ishaan Jaffer c60a13c919 fixes 2025-11-08 11:11:22 -08:00
Ishaan Jaffer da7ecb3ea9 test_gemini_reasoning_effort_zero_budget_disables_thoughts 2025-11-08 11:10:54 -08:00
Ishaan Jaffer 9e3a8c4b0d fix _success_handler_helper_fn 2025-11-08 11:06:12 -08:00
Ishaan Jaffer bbcdf6f996 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:47:48 -08:00
Ishaan Jaffer 0148b8d2f7 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:36:47 -08:00
Ishaan Jaffer 78741ebd56 fix linting 2025-11-08 10:35:23 -08:00
Krish DholakiaandGitHub c1b2dff595 fix(pass_through_endpoints.py): improve clearing logic - only remove unvisited endpoints (#16400)
simpler than clear all, and try to re-add
2025-11-08 10:33:47 -08:00
Ishaan Jaffer bae1857787 fix doc 2025-11-08 10:31:19 -08:00
Ishaan Jaffer 89157f4b5c test_basic_openai_responses_api_streaming_with_logging 2025-11-08 10:30:41 -08:00
Ishaan Jaffer 9b6a4c2650 bump pyproject 2025-11-08 10:24:23 -08:00
Ishaan Jaffer e64c889b1e bump proxy exras 2025-11-08 10:22:36 -08:00
Ishaan Jaffer ec2749199e bump: version 0.4.2 → 0.4.3 2025-11-08 10:21:47 -08:00
Ishaan Jaffer eec76cbe49 add safe_dumps 2025-11-08 10:19:38 -08:00
Ishaan Jaffer 6bb963dca2 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:13:27 -08:00
Ishaan Jaffer 68d24b40c6 test_gemini_25_implicit_caching_cost 2025-11-08 10:13:04 -08:00
yuneng-jiangandGitHub 8412950b94 [Feature] UI - Cache Settings Redis Add Semantic Cache Settings (#16398)
* Tests

* Merging Tests

* Redis Semantic Cache Settings

* Readd mock to test

* Fixing build issues
2025-11-08 10:09:49 -08:00
Ishaan Jaffer f9d95b71bb fix _get_assembled_streaming_response 2025-11-08 10:08:03 -08:00
yuneng-jiangandGitHub f9ee0cb79d Building UI for sanity testing (#16399) 2025-11-08 09:44:05 -08:00
Ishaan Jaffer 14c5665820 fix remove unused var 2025-11-08 09:29:50 -08:00
yuneng-jiangandGitHub e26875b8ed [Fix] UI - Test Key Page Revert Model To Single Select (#16390)
* Test Key Single Select

* fix build issues
2025-11-08 09:08:32 -08:00
Ishaan Jaffer 7bf9d69007 test_gemini_reasoning_effort_env_override 2025-11-07 22:09:59 -08:00
Ishaan Jaffer 45323dd537 test_patch_guardrail_endpoint 2025-11-07 22:09:52 -08:00
Alan PonnachanandGitHub 2408e09f6a feat: Add support for Anthropic Memory Tool (#16115)
* add memory tool in anthropic.py

* add memory tool test

* make format

* update transformation

* adding memory to hosted tools

* add test

* make format
2025-11-07 19:27:28 -08:00
YutaSaitoandGitHub 6eb74bd62a Feat/persist mcp credentials in db (#16308)
* feat: persist mcp credentials in db

* feat: remove Auth Value field from MCP Tool Testing Playground

* fix: test
2025-11-07 19:22:49 -08:00
Sameer KankuteandGitHub b6f792f301 Added support for desabling thoughts by setting budget to 0 (#16347) 2025-11-07 19:19:16 -08:00
Jack CherngandGitHub 2ab34f9a52 Fix HostedVLLMRerankConfig will not be used (#16352)
* Fix HostedVLLMRerankConfig will not be used

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

* Fix no usage statistics in rerank with hosted_vllm

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

* Revise typo in comment

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

---------

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>
2025-11-07 19:11:59 -08:00
Sumit TembeandGitHub 0a527bd1d8 Fix cache_read_input_token_cost for gemini-2.5-flash (#16354) 2025-11-07 19:11:10 -08:00
Sameer KankuteandGitHub fd95909d9f Add cohere embed v4 model support (#16358) 2025-11-07 19:10:42 -08:00
Will ChenandGitHub c495320b87 Propagate cache creation/read token costs for model info to fix Anthropic long context cost calculations (#16376)
* Fix

* fix

* fix

* fix
2025-11-07 19:06:43 -08:00
Cesar GarciaandGitHub d65a29b88d docs: fix image generation response format from 'image' to 'images' (#16378)
Update documentation to reflect actual API response format:
- Change singular 'image' field to plural 'images' array
- Add complete ImageURLListItem structure with index and type fields
- Update all code examples to use message.images instead of message.image
- Fix streaming examples to access images[0]["image_url"]["url"]

The documentation was incorrectly showing 'image' (singular object)
but the actual implementation returns 'images' (array of ImageURLListItem).

Related to issue #16227
2025-11-07 19:06:03 -08:00
Ishaan Jaffer a8533dc5c4 Revert "Added xai responses support (#16310)"
This reverts commit ee50f09e73.
2025-11-07 18:39:38 -08:00
Ishaan Jaffer 9a022b8277 fix _handle_logging_completed_response 2025-11-07 18:37:34 -08:00
Ishaan Jaffer 9856fb75d1 fix mistral stream test 2025-11-07 18:31:02 -08:00
Ishaan Jaffer 8b281c2f03 fix linting 2025-11-07 18:25:55 -08:00
Ishaan Jaffer 8cd43de931 fix qa check 2025-11-07 18:25:55 -08:00
Ishaan JaffandGitHub f1534c1650 Revert "[Fix] UI - Revert Changes for Test Key Multiple Model Select (#16372)" (#16386)
This reverts commit 99a8a304c1.
2025-11-07 18:24:01 -08:00
Ishaan Jaffer 4dcbfbbb89 ui fix linting 2025-11-07 18:20:31 -08:00
Ishaan Jaffer 736b6b3e1e TestVertexAIRerankTransform 2025-11-07 18:18:48 -08:00
Ishaan JaffandGitHub a978680714 [UI] Guardrails - allow updating guardrails through UI. Ensure litellm_params actually get updated in memory (#16384)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init

* add _has_guardrail_params_changed

* fix sync_guardrail_from_db

* fix _has_guardrail_params_changed

* fix patch_guardrail

* add unsaved change check

* fix ContentFilterManager
2025-11-07 18:15:59 -08:00
Ishaan JaffandGitHub 674d4b4cab [Feat] Guardrails - LiteLLM Content Filter, Allow Viewing/Editing Content Filter Settings (#16383)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init
2025-11-07 18:15:09 -08:00
Ishaan JaffandGitHub ca229fe030 [Feat] LiteLLM Guardrail - UI Fix, ensure you can see UI Friendly name for PII Patterns (#16382)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns
2025-11-07 18:14:58 -08:00
Krrish Dholakia 532ebf43d0 docs(moderation.md): fix moderation quick start docs 2025-11-07 16:25:08 -08:00
Ishaan Jaffer 514e3e01f9 ui new build 2025-11-07 15:39:07 -08:00
Ishaan Jaffer 5b5122125c guardrailLogoMap fix 2025-11-07 15:37:01 -08:00
Ishaan Jaffer 4621a23a89 add litellm logo jpg 2025-11-07 15:36:49 -08:00
Ishaan Jaffer bc2ff66f5a litellm_logo 2025-11-07 15:36:19 -08:00