Commit Graph
27196 Commits
Author SHA1 Message Date
Ishaan Jaffer da7ecb3ea9 test_gemini_reasoning_effort_zero_budget_disables_thoughts 2025-11-08 11:10:54 -08:00
Ishaan Jaffer 9e3a8c4b0d fix _success_handler_helper_fn 2025-11-08 11:06:12 -08:00
Ishaan Jaffer bbcdf6f996 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:47:48 -08:00
Ishaan Jaffer 0148b8d2f7 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:36:47 -08:00
Ishaan Jaffer 78741ebd56 fix linting 2025-11-08 10:35:23 -08:00
Krish DholakiaandGitHub c1b2dff595 fix(pass_through_endpoints.py): improve clearing logic - only remove unvisited endpoints (#16400)
simpler than clear all, and try to re-add
2025-11-08 10:33:47 -08:00
Ishaan Jaffer bae1857787 fix doc 2025-11-08 10:31:19 -08:00
Ishaan Jaffer 89157f4b5c test_basic_openai_responses_api_streaming_with_logging 2025-11-08 10:30:41 -08:00
Ishaan Jaffer 9b6a4c2650 bump pyproject 2025-11-08 10:24:23 -08:00
Ishaan Jaffer e64c889b1e bump proxy exras 2025-11-08 10:22:36 -08:00
Ishaan Jaffer ec2749199e bump: version 0.4.2 → 0.4.3 2025-11-08 10:21:47 -08:00
Ishaan Jaffer eec76cbe49 add safe_dumps 2025-11-08 10:19:38 -08:00
Ishaan Jaffer 6bb963dca2 test_basic_openai_responses_api_non_streaming_with_logging 2025-11-08 10:13:27 -08:00
Ishaan Jaffer 68d24b40c6 test_gemini_25_implicit_caching_cost 2025-11-08 10:13:04 -08:00
yuneng-jiangandGitHub 8412950b94 [Feature] UI - Cache Settings Redis Add Semantic Cache Settings (#16398)
* Tests

* Merging Tests

* Redis Semantic Cache Settings

* Readd mock to test

* Fixing build issues
2025-11-08 10:09:49 -08:00
Ishaan Jaffer f9d95b71bb fix _get_assembled_streaming_response 2025-11-08 10:08:03 -08:00
yuneng-jiangandGitHub f9ee0cb79d Building UI for sanity testing (#16399) 2025-11-08 09:44:05 -08:00
Ishaan Jaffer 14c5665820 fix remove unused var 2025-11-08 09:29:50 -08:00
yuneng-jiangandGitHub e26875b8ed [Fix] UI - Test Key Page Revert Model To Single Select (#16390)
* Test Key Single Select

* fix build issues
2025-11-08 09:08:32 -08:00
Ishaan Jaffer 7bf9d69007 test_gemini_reasoning_effort_env_override 2025-11-07 22:09:59 -08:00
Ishaan Jaffer 45323dd537 test_patch_guardrail_endpoint 2025-11-07 22:09:52 -08:00
Alan PonnachanandGitHub 2408e09f6a feat: Add support for Anthropic Memory Tool (#16115)
* add memory tool in anthropic.py

* add memory tool test

* make format

* update transformation

* adding memory to hosted tools

* add test

* make format
2025-11-07 19:27:28 -08:00
YutaSaitoandGitHub 6eb74bd62a Feat/persist mcp credentials in db (#16308)
* feat: persist mcp credentials in db

* feat: remove Auth Value field from MCP Tool Testing Playground

* fix: test
2025-11-07 19:22:49 -08:00
Sameer KankuteandGitHub b6f792f301 Added support for desabling thoughts by setting budget to 0 (#16347) 2025-11-07 19:19:16 -08:00
Jack CherngandGitHub 2ab34f9a52 Fix HostedVLLMRerankConfig will not be used (#16352)
* Fix HostedVLLMRerankConfig will not be used

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

* Fix no usage statistics in rerank with hosted_vllm

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

* Revise typo in comment

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>

---------

Signed-off-by: Jun-Fei Cherng <jfcherng@realtek.com>
2025-11-07 19:11:59 -08:00
Sumit TembeandGitHub 0a527bd1d8 Fix cache_read_input_token_cost for gemini-2.5-flash (#16354) 2025-11-07 19:11:10 -08:00
Sameer KankuteandGitHub fd95909d9f Add cohere embed v4 model support (#16358) 2025-11-07 19:10:42 -08:00
Will ChenandGitHub c495320b87 Propagate cache creation/read token costs for model info to fix Anthropic long context cost calculations (#16376)
* Fix

* fix

* fix

* fix
2025-11-07 19:06:43 -08:00
Cesar GarciaandGitHub d65a29b88d docs: fix image generation response format from 'image' to 'images' (#16378)
Update documentation to reflect actual API response format:
- Change singular 'image' field to plural 'images' array
- Add complete ImageURLListItem structure with index and type fields
- Update all code examples to use message.images instead of message.image
- Fix streaming examples to access images[0]["image_url"]["url"]

The documentation was incorrectly showing 'image' (singular object)
but the actual implementation returns 'images' (array of ImageURLListItem).

Related to issue #16227
2025-11-07 19:06:03 -08:00
Ishaan Jaffer a8533dc5c4 Revert "Added xai responses support (#16310)"
This reverts commit ee50f09e73.
2025-11-07 18:39:38 -08:00
Ishaan Jaffer 9a022b8277 fix _handle_logging_completed_response 2025-11-07 18:37:34 -08:00
Ishaan Jaffer 9856fb75d1 fix mistral stream test 2025-11-07 18:31:02 -08:00
Ishaan Jaffer 8b281c2f03 fix linting 2025-11-07 18:25:55 -08:00
Ishaan Jaffer 8cd43de931 fix qa check 2025-11-07 18:25:55 -08:00
Ishaan JaffandGitHub f1534c1650 Revert "[Fix] UI - Revert Changes for Test Key Multiple Model Select (#16372)" (#16386)
This reverts commit 99a8a304c1.
2025-11-07 18:24:01 -08:00
Ishaan Jaffer 4dcbfbbb89 ui fix linting 2025-11-07 18:20:31 -08:00
Ishaan Jaffer 736b6b3e1e TestVertexAIRerankTransform 2025-11-07 18:18:48 -08:00
Ishaan JaffandGitHub a978680714 [UI] Guardrails - allow updating guardrails through UI. Ensure litellm_params actually get updated in memory (#16384)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init

* add _has_guardrail_params_changed

* fix sync_guardrail_from_db

* fix _has_guardrail_params_changed

* fix patch_guardrail

* add unsaved change check

* fix ContentFilterManager
2025-11-07 18:15:59 -08:00
Ishaan JaffandGitHub 674d4b4cab [Feat] Guardrails - LiteLLM Content Filter, Allow Viewing/Editing Content Filter Settings (#16383)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns

* fix edit and view

* fix backend handling

* fix CF ui edit

* fix init
2025-11-07 18:15:09 -08:00
Ishaan JaffandGitHub ca229fe030 [Feat] LiteLLM Guardrail - UI Fix, ensure you can see UI Friendly name for PII Patterns (#16382)
* fix safe dumps

* add patterns.json

* add PrebuiltPattern

* add test patterns
2025-11-07 18:14:58 -08:00
Krrish Dholakia 532ebf43d0 docs(moderation.md): fix moderation quick start docs 2025-11-07 16:25:08 -08:00
Ishaan Jaffer 514e3e01f9 ui new build 2025-11-07 15:39:07 -08:00
Ishaan Jaffer 5b5122125c guardrailLogoMap fix 2025-11-07 15:37:01 -08:00
Ishaan Jaffer 4621a23a89 add litellm logo jpg 2025-11-07 15:36:49 -08:00
Ishaan Jaffer bc2ff66f5a litellm_logo 2025-11-07 15:36:19 -08:00
Sameer KankuteandGitHub faae0ff0dc Fix Azure DALL-E-3 health check content policy violation by using safe default prompt (#16329)
* Add custom health check prompt support

* Add constant for health check prompt

* Add constant for health check prompt
2025-11-07 15:30:56 -08:00
Krrish Dholakia 9059905d25 docs(openai/videos.md): document proxy usage on openai docs for video gen 2025-11-07 15:27:18 -08:00
Ishaan JaffandGitHub 2bd85dc455 [Feat] Add DD Agent Host support for datadog callback (#16379)
* add DD_AGENT_HOST

* docs DD Agent

* test_datadog_agent_configuration

* DD_AGENT_HOST
2025-11-07 15:18:23 -08:00
yuneng-jiangandGitHub 5fb0940b9b [Feature] UI - Surface SSO Create errors on create flow (#16369)
* Surface backend SSO issues on create SSO flow

* Remove unused import

* Fix flaky test
2025-11-07 14:44:50 -08:00
Ishaan JaffandGitHub a6b0993405 [Feat] Secret Manager - Hashicorp, add auth via approle (#16374)
* add _verify_required_credentials_exist and _auth_via_approle

* test_hashicorp_secret_manager_approle_auth

* docs hcorp auth
2025-11-07 14:39:33 -08:00