tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-13 02:22:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,931 Commits 2,072 Branches 1,425 Tags
fb5429bfe7a14c0eb4ae9657e4eb7e00a4ca4250
Commit Graph
554 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 38ddd50628 [Bug fix] Vector Store List Endpoint Returns 404 (#17229) 
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
 2025-11-27 12:51:51 -08:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		d612d71ef4 [Feat] Add guardrails for pass through endpoints (#17221) 
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2025-11-27 12:06:53 -08:00
Sameer KankuteandGitHub b97ea585b2 Add method for extracting vector store ids from path params (#16566) 
* Add method for extracting vector store ids from path params

* Add vector id handling from path

* Move method to utils
 2025-11-26 14:19:30 -08:00
yuneng-jiang 046b5fc27b Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-26 12:23:43 -08:00
Ishaan Jaffer 4bf5830106 test fix 2025-11-26 12:07:58 -08:00
Ishaan Jaffer 983ada20c3 mock test fixes 2025-11-26 12:02:35 -08:00
Igal BoxermanandGitHub e6e1e8fca4 feat(pillar): add automatic LiteLLM context headers (#17076) 
- Automatically pass LiteLLM virtual key context as X-LiteLLM-* headers
- Includes key_alias, user_id, team_id, org_id, and user_email
- No configuration required - always enabled for application/user tracking
- Excludes sensitive data (metadata, API tokens) for security
- Add comprehensive tests (30 tests, all passing)
- Update documentation with header details
 2025-11-25 19:35:39 -08:00
Krish DholakiaGitHubCursor Agent
 		00e17c81a1 Add enforce user param functionality (#17088) 
* feat: Add reject_metadata_tags to proxy config

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor: Rename reject_metadata_tags to reject_clientside_metadata_tags

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-11-25 09:36:24 -08:00
yuneng-jiang e629a6b703 Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-24 21:14:05 -08:00
Saar wintrovandGitHub cfd35d3b14 Metadata: fix 401 when audio/transcriptions (#17023) 
* Metadata: fix 401 when audio/transcriptions

* check if str, CR fixes
 2025-11-24 20:56:27 -08:00
yuneng-jiangandGitHub 3f5a34d72c Deleting a user from team deletes key user created for team (#17057) 2025-11-24 20:47:43 -08:00
Raghav JhavarandGitHub bd8196f982 (fix) propagate x-litellm-model-id in responses (#16986) 
* propagate model id on errors too

* make it work for messages and streaming

* fix

* cleanup

* cleanup

* final

* cleanup

* clean up method name and fix responses api streaming

* remove comment
 2025-11-24 20:40:43 -08:00
Sameer KankuteandGitHub c6fbdc7dc5 fix bedrock passthrough auth issue (#16879) 2025-11-24 18:44:59 -08:00
Sameer KankuteandGitHub 629404a100 Add cost tracking for cohere embed passthrough endpoint (#17029) 
* Add cost tracking for cohere embed passthrough endpoint

* update passthrough code

* update passthrough code

* fixed lint and mypy errors
 2025-11-24 17:39:26 -08:00
Lior DrihemGitHubOri TabacVitaly Neyman
 		62b84d6aad Prompt security litellm (#16365) 
* add prompt security guardrails provider

* cosmetic

* small

* add file sanitization and update context window

* add pdf and OOXML files support

* add system prompt support

* add tests and documentation

* remove print

* fix PLR0915 Too many statements (96 > 50)

* cosmetic

* fix mypy error

* Fix failed tests due to naming conflict of responses directory with same-named pip package

* Fix mypy error: use 'aembedding' instead of 'embeddings' for async embedding call type

* Fix: Install enterprise package into Poetry virtualenv for tests

The GitHub Actions workflow was installing litellm-enterprise to system Python
using 'python -m pip install -e .', but tests run in Poetry's virtualenv using
'poetry run pytest'. This caused ImportError for enterprise package types.

Changed to 'poetry run pip install -e .' so the package is available in the
same virtualenv where pytest executes.

Fixes enterprise test collection errors in GitHub Actions CI.

* Move Prompt Security guardrail tests to tests/test_litellm/

Per reviewer feedback, move test_prompt_security_guardrails.py from
tests/guardrails_tests/ to tests/test_litellm/proxy/guardrails/ so
it will be executed by GitHub Actions workflow test-litellm.yml.

This ensures the Prompt Security integration tests run in CI.

---------

Co-authored-by: Ori Tabac <oritabac@prompt.security>
Co-authored-by: Vitaly Neyman <vitaly@prompt.security>
 2025-11-24 11:44:20 -08:00
yuneng-jiangGitHubKrish Dholakia
 		adfdcf1d61 [Fix] UI - Hide Default Team Settings From Proxy Admin Viewers (#16900) 
* Add fallback in sort to prevent NoneType and str comparison

* Hide Default Team Settings from Proxy Admin Viewers

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
 2025-11-23 22:01:38 -08:00
yuneng-jiangandGitHub 013dcd837f Change provider create fields to JSON (#16985) 2025-11-23 21:57:22 -08:00
YutaSaitoandGitHub b72b49757e feat: add backend support for OAuth2 auth_type registration via UI (#17006) 2025-11-23 21:52:18 -08:00
YutaSaitoandGitHub 06f2ecef42 feat: tool permission argument check (#16982) 2025-11-22 19:21:25 -08:00
yuneng-jiangandGitHub 825f61b452 Remove expired proxy admin keys from cache (#16894) 2025-11-22 14:23:28 -08:00
yuneng-jiangandGitHub 22fd323d6b Calling team/permissions_list and team/permissions_update now returns 404 with non-existent team (#16835) 2025-11-22 14:21:58 -08:00
yuneng-jiang 7be3a0bd5d Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-22 10:19:28 -08:00
Ishaan Jaffer b2812af0a0 fix MCP tests 2025-11-22 10:02:15 -08:00
Derek DuenasGitHubXiaohan Fu
 		bbaf0af907 Grayswan guardrail passthrough on flagged (#16891) 
* attempt to implement the passthrough feature

* Formatting and small change

* Fix formatting

* Format test file

---------

Co-authored-by: Xiaohan Fu <xiaohan@grayswan.ai>
 2025-11-21 20:01:35 -08:00
yuneng-jiangandGitHub b074c79734 Allow partial matches for user id in user table (#16952) 2025-11-21 19:12:16 -08:00
yuneng-jiangandGitHub 6881594632 [Fix] Exclude litellm_credential_name from Sensitive Data Masker (Updated) (#16958) 
* Exclude litellm_credential_name from sensitive masker

* Adding missing file
 2025-11-21 19:09:48 -08:00
yuneng-jiangandGitHub eb48d5cc42 Revert "Exclude litellm_credential_name from sensitive masker (#16950)" (#16956) 
This reverts commit 5cfacb96e6.
 2025-11-21 18:09:54 -08:00
yuneng-jiangandGitHub 5cfacb96e6 Exclude litellm_credential_name from sensitive masker (#16950) 2025-11-21 16:40:17 -08:00
yuneng-jiang d785205a70 Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-21 16:25:55 -08:00
Ishaan Jaffer 4a9f163db1 TestPromptVersionsEndpoint 2025-11-21 16:21:13 -08:00
yuneng-jiangandGitHub 0abfb07ab8 Remove UI Session Token from user/info return (#16851) 2025-11-21 16:11:58 -08:00
Ishaan JaffandGitHub 6ae22908b7 [Feat] Prompt Versioning - Allow specifying prompt version in code (#16929) 
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id
 2025-11-21 13:58:49 -08:00
Ishaan JaffandGitHub 97d9da93e0 [Feat] Prompt Management - Allow viewing version history (#16901) 
* TestPromptRequest

* add prompts/test endpoint for testing prompt

* TestPromptTestEndpoint

* feat: working v1 of this ui

* workig prompt endpoints

* add chat ui for prompts

* add conversation panel

* add init chat ui

* allow clicking edit prompt

* fix use get_base_prompt_id

* add endpoints for viewing prompt versions

* TestPromptVersioning

* add getPromptVersions

* add VersionHistorySidePanel

* allow viewing version history

* add version history
 2025-11-21 08:54:52 -08:00
YutaSaitoandGitHub 041ac054b6 feat: allow custom violation message for tool-permission guardrail (#16916) 2025-11-21 08:52:01 -08:00
yuneng-jiang 6029a24baa Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-20 20:19:16 -08:00
yuneng-jiangandGitHub 7225fc066f Fix key model alias (#16896) 2025-11-20 16:05:49 -08:00
YutaSaitoandGitHub 93affcb732 [Feat] mcp resources support (#16800) 
* feat: mcp prompts support

* feat: mcp resources support
 2025-11-20 14:53:44 -08:00
idola9andGitHub e1005cb9d3 Use LiteLLM key alias as fallback Noma applicationId in NomaGuardrail (#16832) 
* Use auth key name if there are no app id in in headers or in extra_data

* use key alias instead of key name

* Fix

* last priority key alias

* Fix

* Add tests
 2025-11-19 17:44:23 -08:00
Ishaan JaffandGitHub c7cf18cf67 [Feat] Prompt Management - Allow storing prompt version in DB (#16848) 
* test_dotprompt_auto_detection_with_model_only

* fix _auto_detect_prompt_management_logger

* test_dotprompt_with_prompt_version

* add v1, v2 tests

* add _compile_prompt_helper

* fix _compile_prompt_helper

* test_dotprompt_with_prompt_version

* test_dotprompt_with_prompt_version, test_get_prompt_with_version

* add version in schema

* feat add _get_prompt_spec_for_db_prompt

* add _get_prompt_spec_for_db_prompt

* feat add _get_prompt_spec_for_db_prompt

* update prompt table

* add version in prompt DB

* test_get_prompt_spec_for_db_prompt_with_versions
 2025-11-19 13:19:56 -08:00
Alexsander HamirandGitHub 2e007505da fix(spend-logs): trim logged response strings (#16654) 
* fix(spend-logs): trim logged response strings

- route spend-log responses through the existing string sanitizer so oversized base64/text fields are truncated before persistence
- add unit tests covering the truncation path and the feature flag

Note: embeddings-specific truncation (numeric vectors) is still pending and will be handled separately.

* remove unnecessary comment

* add: sanitization unit test for embeddings

* fix: simplify sanatization logic

I overcomplicated a simple change for lack of understanding, fixed.
 2025-11-18 20:12:49 -08:00
Ishaan JaffandGitHub c3c6cef6d8 [Fix] Fixes Swagger UI resolver errors for chat completion endpoints caused by Pydantic v2 $defs not being properly exposed in the OpenAPI schema. (#16784) 
* fix add_request_body_to_paths

* test_move_defs_to_components
 2025-11-18 17:39:28 -08:00
Ishaan JaffandGitHub 2880cb45a2 [Fix] AI Gateway Auth - Ensure Team Tags works when using JWT Auth (#16797) 
* fix setting team_metadata

* test_team_metadata_with_tags_flows_through_jwt_auth
 2025-11-18 17:36:38 -08:00
Ishaan JaffandGitHub e2fc225201 [Feat] SSO - Ensure role from SSO provider is used when a user is inserted onto LiteLLM (#16794) 
* test_apply_user_info_values_sso_role_takes_precedence

* fix SSO
 2025-11-18 15:35:38 -08:00
yuneng-jiangandGitHub f9ec353b80 [Feature] UI - Allow setting base_url in API reference docs (#16674) 
* Allow setting base_url in API reference docs

* Add logic to change base url for test key page
 2025-11-18 11:27:28 -08:00
YutaSaitoandGitHub 86ada061ec fix: prompt injection not working (#16701) 2025-11-17 20:04:57 -08:00
Ishaan JaffandGitHub bdb1e16dcf [Feat] AI Gateway Auth - Allow using JWTs for signing in with Proxy CLI (#16756) 
* fix auth

* get_cli_jwt_auth_token

* fix linting

* test fixes

* docs

* test fixes

* fix refactor
 2025-11-17 19:47:29 -08:00
YutaSaitoandGitHub 0b586d26fc refactor: drop MCPClient.connect and use run_with_session lifecycle (#16696) 
Surface detailed connection errors by handling HTTP failures
 2025-11-15 17:54:27 -08:00
Ishaan JaffandGitHub 25cb873467 [UI] expose backend endpoint for callbacks settings (#16698) 
* init json for

* add SQS fields

* fix params

* return callbacks configs

* test_get_callback_configs

* test_get_callback_configs

* vercel build fix
 2025-11-15 16:44:17 -08:00
yuneng-jiang 3d2552be9f Fixed failing tests 2025-11-15 16:31:37 -08:00
yuneng-jiang f36cbccd56 Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-15 16:28:12 -08:00