tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-06 12:22:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,657 Commits 2,072 Branches 1,425 Tags
bdb8c169befc2e6f856d64aae9bfe56ccd91c17d
Commit Graph
692 Commits
Author SHA1 Message Date
Jason RobertsandGitHub 6fc39d31b4 feat(guardrails): add configurable fail-open, timeout, and app_user to PANW Prisma AIRS guardrail (#17785) 
Add configurable fail-open/fail-closed behavior, timeout settings, and app_user
metadata tracking. Includes security hardening, enhanced
observability (:unscanned header), and comprehensive test coverage (44/44 passing).

No breaking changes.
 2025-12-11 15:23:59 -08:00
yuneng-jiangandGitHub cb9bae1aba Merge pull request #16764 from BerriAI/litellm_tag_spend_dedupe 
[Fix] Deduplicate /tag/daily/activity metadata
 2025-12-11 15:20:16 -08:00
Dominic FallowsandGitHub 756c60540e feat: add support for configurable confidence score thresholds and scope in Presidio PII masking (#17817) 
* feat: add support for configurable confidence score thresholds in Presidio PII masking

* feat: enhance Presidio PII masking with configurable score thresholds and behavior documentation

* feat: add configurable output masking and filter scope for Presidio PII guardrail
 2025-12-11 15:19:11 -08:00
yuneng-jiangandGitHub 2a864e25f8 Merge pull request #17668 from BerriAI/litellm_sso_config_2 
[Fix] Remove SSO Config Values from Config Table on SSO Update
 2025-12-11 15:17:33 -08:00
yuneng-jiangandGitHub de9a195d8c Merge pull request #17781 from BerriAI/litellm_daily_agent_table 
[Feature] Daily Agent Usage Backend
 2025-12-11 15:01:50 -08:00
mubashir1osmaniandGitHub 1b2ea270b4 fix: attach team to org table (#17832) 
* fix: attach team to org table

* add test
 2025-12-11 14:54:50 -08:00
Alexsander HamirandGitHub e9baa83a0f [Fix] CI/CD – Clean Up Performance PR Changes & others (#17838) 2025-12-11 12:50:03 -08:00
yuneng-jiangandGitHub 26926d5fea Merge pull request #17804 from BerriAI/litellm_add_model_settings_fix 
[Fix] Ensure Model Page Honors UI Settings
 2025-12-11 09:20:28 -08:00
YutaSaitoandGitHub e9571ddbc4 fix: MCP OAuth callback routing and URL handling (#17789) 
* fix: MCP OAuth callback routing and URL handling

* test: add test for proxy_server
 2025-12-11 08:22:59 -08:00
Ashton SidhuandGitHub a514313540 Add Hiddenlayer Guardrail Hooks (#17728) 
* Core logic working, need to add tests

* Re add removed files

* Remove mistaken files

* one more file

* Add deployment params

* Add tests

* Remove unused imports

* Update docs from feedback

* Update guardrails
 2025-12-11 07:43:26 -08:00
yuneng-jiang 7ca2c2abfc Adding tests 2025-12-10 21:37:38 -08:00
Sameer KankuteandGitHub 8942053c8b Merge pull request #17700 from BerriAI/litellm_batches_passthrough_cost_tracking 
Add anthropic retrieve batches and retreive file content support
 2025-12-11 10:31:54 +05:30
yuneng-jiang 91056c1d7e Merge remote-tracking branch 'origin' into litellm_daily_agent_table 2025-12-10 20:47:58 -08:00
Sameer Kankute 9344d29a15 fix: Preserve systemInstructions for vertex ai generate content request 2025-12-11 09:52:32 +05:30
Sameer KankuteandGitHub 2ea855d225 Merge pull request #17707 from raghav-stripe/raghav-fix-responsesapi-rl 
fix: responses api not applying tpm rate limits on api keys
 2025-12-11 08:57:16 +05:30
Ishaan JaffandGitHub 059fedbed5 [Feat] Agent Gateway - Track agent_id in SpendLogs (#17795) 
* add agent_id in metadata in spend logs

* add agent_id in SpendLogsPayload

* add agent_id in SpendLogsPayload

* add _set_agent_id_on_logging_obj

* add agent id tracking in SpendLogs

* add agent id in spend logs

* fix create_a2a_client

* test_asend_message_passes_agent_id_to_callback

* test_get_logging_payload_includes_agent_id_from_kwargs

* test_asend_message_streaming_triggers_callbacks

* fix asend_message_streaming

* asend_message_streaming

* A2AStreamingIterator

* _handle_stream_message

* test_asend_message_streaming_propagates_metadata
 2025-12-10 16:09:56 -08:00
Ishaan JaffandGitHub 5d456bcdc3 [Feat] UI SSO - allow fetching role from generic SSO provider (Keycloak) (#17787) 
* fix ui SSO

* TestGenericResponseConvertorUserRole

* Assigning User Roles via SSO
 2025-12-10 13:09:28 -08:00
yuneng-jiang 1cad479297 Daily Agent Usage Table WIP 2025-12-10 11:50:52 -08:00
saisurya237andGitHub f3ead2c153 add a new feature fix to expose the team alias when authenticating th… (#17725) 
* CLI SSO: show team aliases in team selection

* temp poetry lock fix

* add poetry.lock to gitignore

* Revert proxy_server background job refactor

* Revert proxy_server background job refactor

* rever gitignore and poetry lock file
 2025-12-10 10:10:28 -08:00
yuneng-jiangandGitHub ba554a86b9 Merge pull request #16843 from BerriAI/litellm_allow_custom_mount_paths 
[Feature] Allow Root Path to Redirect when Docs not on Root Path
 2025-12-10 09:52:30 -08:00
Sameer Kankute 9e3a04a725 Add batch passthrough endpoint cost tracking for anthropic 2025-12-10 18:24:31 +05:30
Lucas SugiandGitHub c7fd8fabdb fix: Avoid error when we have just the tool_calls in input (#17753) 
* fix: Avoid error when we have just the tool_calls in input

* fix: Remove the tool call validation

* feat: Add unit test
 2025-12-09 22:59:59 -08:00
Ishaan JaffandGitHub e546f0e021 [Fix] UI SSO - allow up-serting user role when SSO provider role changes (#17754) 
* use _build_sso_user_update_data

* test_build_sso_user_update_data_with_valid_role
 2025-12-09 19:16:10 -08:00
Peter ChanthamynavongandGitHub 539ce89d4e fix(guardrails): mask all regex pattern matches, not just first (#17727) 
Before: search() + replace() only replaced first match
After: sub() replaces all matches of each pattern

Closes #17687
 2025-12-09 18:51:28 -08:00
yuneng-jiang d99cf81386 Fixing test 2025-12-09 16:11:17 -08:00
ephrimstanleyandGitHub a91dda1194 Return 403 instead of 503 for unauthorized routes (#17723) 2025-12-09 15:16:11 -08:00
yuneng-jiang 879ae45421 Change credential encryption to only affect db credentials 2025-12-09 13:36:40 -08:00
yuneng-jiang 68419cfe4e Merge remote-tracking branch 'origin' into litellm_tag_spend_dedupe 2025-12-09 11:59:47 -08:00
yuneng-jiang 39bf7a9f7c Merge remote-tracking branch 'origin' into litellm_allow_custom_mount_paths 2025-12-09 11:58:05 -08:00
yuneng-jiang 4bffbe0bff Merge remote-tracking branch 'origin' into litellm_sso_config_2 2025-12-09 11:56:30 -08:00
yuneng-jiangandGitHub 9253a9c365 Merge pull request #17689 from BerriAI/litellm_ui_settings_backend 
[Feature] Get and Update Backend Routes for UI Settings
 2025-12-09 11:55:28 -08:00
yuneng-jiang e4442c2946 Change UI Settings to a dedicated table 2025-12-09 11:19:53 -08:00
Derek DuenasGitHubXiaohan Fu
 		3322523e07 Passthrough in response (#17102) 
* attempt to implement the passthrough feature

* Formatting and small change

* Fix formatting

* feat: grayswan guardrail overwrite ModelResponse in passthrough mode

* fix missing exception error catching on certain
endpoints

* fix wrong call site

* fix: patch anthropic endpoint internal error on streaming obj

* fix grayswan testcase

* feat: update the violation response to more natural

* Formatting

* move passthrough exception definition to custom_guardrail.

* Enhancement: show whether the blocked at input or output

* update exception name

* fix a typo in testing unit.

---------

Co-authored-by: Xiaohan Fu <xiaohan@grayswan.ai>
 2025-12-09 10:45:45 -08:00
yuneng-jiang 305a7c6bd5 Merge remote-tracking branch 'origin' into litellm_ui_settings_backend 2025-12-09 10:21:52 -08:00
Raghav Jhavar face8173b0 fix failing test 2025-12-09 19:42:26 +07:00
Raghav Jhavar 9e85dcbd60 read responses api usage 2025-12-09 18:14:00 +07:00
yuneng-jiang dab4c9d8ab Merge remote-tracking branch 'origin' into litellm_sso_config_2 2025-12-08 21:19:50 -08:00
yuneng-jiangandGitHub 8039c5052f Merge pull request #17681 from BerriAI/litellm_ui_fallback_login_alert 
[Fix] Change deprecation banner to only show on /sso/key/generate
 2025-12-08 21:18:38 -08:00
YutaSaitoandGitHub 5b926ae2c6 fix: resolve UI session MCP permissions across real teams (#17620) 
* fix: resolve UI session MCP permissions across real teams

* fix: remove user from logs
 2025-12-08 19:03:01 -08:00
Cesar GarciaandGitHub a7ad8a36a4 chore: cleanup unused scripts and fix misplaced test file (#17611) 
Remove scripts/ directory containing unused development/debug scripts:
- mock_ibm_guardrails_server.py
- test_groq_streaming_issue.py (debug for #12660)
- test_mock_ibm_guardrails.py
- update_readme_providers_table.py

Move misplaced test file to correct location:
- test_litellm/ -> tests/test_litellm/ (from PR #17221)
 2025-12-08 19:00:55 -08:00
Emil SvenssonGitHubErdem Halil
 		61e737e361 fix Azure AI Anthropic api-key header and passthrough cost calculation (#17656) 
* refactor: remove api-key conversion logic for Azure Anthropic

Co-authored-by: Erdem Halil <erdemhalil@users.noreply.github.com>

* fix(passthrough): pass custom_llm_provider to completion_cost for Azure AI Anthropic

The passthrough logging for Anthropic was failing when using Azure AI Anthropic
because the completion_cost function was not receiving the custom_llm_provider
parameter, causing it to fail with "LLM Provider NOT provided" error.

This fix:
- Retrieves custom_llm_provider from logging_obj.model_call_details
- Prepends provider prefix to model name for cost calculation
- Passes both formatted model and custom_llm_provider to completion_cost
- Centralizes provider prefix logic in _create_anthropic_response_logging_payload

This ensures cost calculation works correctly for Azure AI Anthropic requests
with models like azure_ai/claude-sonnet-4-5_gb_20250929.

Co-authored-by: Erdem Halil <erdemhalil@users.noreply.github.com>

* test: add unit tests for Azure AI Anthropic fixes

- Add tests for custom_llm_provider cost calculation in passthrough logging
- Add tests for ProviderConfigManager returning AzureAnthropicMessagesConfig
- Update existing tests to reflect removal of api-key to x-api-key conversion

Co-authored-by: Erdem Halil <erdemhalil@users.noreply.github.com>

---------

Co-authored-by: Erdem Halil <erdemhalil@users.noreply.github.com>
 2025-12-08 18:50:26 -08:00
yuneng-jiang 3683614a6b Get and Update route for UI Settings 2025-12-08 18:07:00 -08:00
Ishaan JaffandGitHub 074445edb1 [Fix] AI Gateway Auth - allow using wildcard patterns for public routes (#17686) 
* edit auth utils to allow wildcard patterns

* docs fix private / public routes

* test_route_in_additional_public_routes_wildcard_match
 2025-12-08 17:39:53 -08:00
Ishaan JaffandGitHub 2f335ac5a6 [Feat] Dynamic Rate Limiter - allow specifying ttl for in memory cache (#17679) 
* fix _get_saturation_value_from_cache

* fix _get_saturation_check_cache_ttl

* fix test_saturation_check_cache_ttl_configuration

* docs saturation_check_cache_ttl
 2025-12-08 17:20:52 -08:00
yuneng-jiang 8338bd9c53 Change deprecation banner to only show on /sso/key/generate 2025-12-08 16:30:37 -08:00
yuneng-jiang 3394dbb363 Remove SSO config values from old config table on update 2025-12-08 13:06:39 -08:00
Tamir KivitiandGitHub 0f5694c8eb add onyx guardrail hooks integration (#16591) 
* add onyx guardrail hooks integration

* fix lint issue

* fix lint issue

* update PR to use the new custom guardrail interface

* lint fix
 2025-12-07 23:33:28 -08:00
Raney CainandGitHub eb689a1f07 fix(proxy): async_post_call_streaming_iterator_hook now properly iterates async generators (#17626) 
The async_post_call_streaming_iterator_hook function was broken:
1. Was a sync function (def) not async generator
2. Returned AsyncGenerator without iterating it
3. Callback generators were chained but never consumed

This fix:
1. Makes the function an async generator (async def + yield)
2. Actually iterates through the chained callbacks with 'async for'
3. Properly yields chunks to the caller

Fixes #9639
 2025-12-07 23:29:42 -08:00
yuneng-jiang 6777a23a53 Merge remote-tracking branch 'origin' into litellm_allow_custom_mount_paths 2025-12-06 22:22:59 -08:00
yuneng-jiangandGitHub 321ffd7258 Merge pull request #17180 from BerriAI/litellm_non_root_docker_logo_fix 
[Fix] Add User Writable Directory to Non Root Docker for Logo
 2025-12-06 22:22:27 -08:00