tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-17 10:26:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,901 Commits 2,072 Branches 1,425 Tags
v1.77.1.dev.2
Commit Graph
24901 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan JaffandGitHub a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392) 
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
v1.77.1.dev.2 		2025-09-10 19:12:11 -07:00
Ishaan JaffGitHubCursor Agentishaan
 		c09d9e5e8e feat: Validate LiteLLM Virtual Key format (#14428) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-09-10 18:58:48 -07:00
Ishaan JaffandGitHub 1f42e41c8d [Bug]: Fix Authorization header not being sent to configured MCP servers (#14422) 
* test: test_mcp_server_config_auth_value_header_used

* fix: authentication_token

* docs: fix instructions on using responses api with MCPs

* mcp fixes
 2025-09-10 16:41:08 -07:00
Ishaan Jaff d78ed53cbb fix mypy linting 2025-09-10 16:17:22 -07:00
Ishaan Jaff 199c262e33 EXPERIMENTAL_MULTI_INSTANCE_RATE_LIMITING 2025-09-10 15:55:27 -07:00
Ishaan Jaff d544c6e595 fix DatabricksFunction 2025-09-10 15:52:29 -07:00
Ishaan JaffandGitHub dc5650eeda Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421) 2025-09-10 15:47:18 -07:00
Arseny BoykovandGitHub f3c5a59e57 Revert "Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)" (#14420) 
This reverts commit 5b680bb4a3.
 2025-09-10 15:46:27 -07:00
Krish DholakiaandGitHub 037d2380b4 Merge pull request #14410 from BerriAI/krrishdholakia-patch-1 
Update README.md
 2025-09-10 08:48:48 -07:00
Krish DholakiaandGitHub 2668112a18 Update README.md 2025-09-10 08:48:37 -07:00
Krish DholakiaandGitHub 6a47ac15ab Merge pull request #13886 from frankzye/feature/databricks-function-call-missing-pass-description 
pass function tool description for databricks provider
 2025-09-09 22:42:42 -07:00
Krish DholakiaandGitHub a80cfe5fb5 Merge branch 'main' into feature/databricks-function-call-missing-pass-description 2025-09-09 22:42:32 -07:00
Krish DholakiaandGitHub 53bf023876 Merge pull request #14092 from gotsysdba/main 
OCI Provder: Update OCIPromptTokensDetails
 2025-09-09 22:39:16 -07:00
Krish DholakiaandGitHub d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection 
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
 2025-09-09 22:35:30 -07:00
Krish DholakiaandGitHub 03a457842d Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai 
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
 2025-09-09 22:32:40 -07:00
Krish DholakiaandGitHub e57a05b2dc Merge pull request #14324 from Toy-97/patch-1 
update: DeepInfra model data refresh [2025-09-08]
 2025-09-09 22:31:44 -07:00
Krish DholakiaandGitHub b45ce6e4f2 Merge pull request #14374 from dworthen/fix-embedding-with-azure-ad-token-provider 
Fix embeddings using azure_ad_token_provider.
 2025-09-09 22:21:09 -07:00
Krish DholakiaandGitHub dde2712ade Merge pull request #14379 from teremterem/main 
[Fix] Restore forgotten `raise` keyword in front of an `exception_type()` call
 2025-09-09 22:19:58 -07:00
Krish DholakiaandGitHub 34c5bc7bb0 Merge pull request #14391 from mubashir1osmani/fix_all_docs 
added tags to langchain
 2025-09-09 22:15:16 -07:00
mubashir1osmani c20a5b0bbd more info for turn_off_logging 2025-09-10 00:51:37 -04:00
Krrish Dholakia a504c7dae3 test: update tests v1.77.1.dev.1 2025-09-09 21:43:37 -07:00
Krrish Dholakia bdd7255bab test: remove redundant tests - moved to parallel_request_limiter_v3.py 2025-09-09 21:35:50 -07:00
mubashir1osmani f51036e092 added tags to langchain 2025-09-10 00:32:26 -04:00
Krrish Dholakia c45ede7187 test: update test 2025-09-09 21:31:34 -07:00
Krrish Dholakia f0de7d1dfd fix: remove EOL model name 2025-09-09 21:15:12 -07:00
Krrish Dholakia d05f58721e test: remove end of life model from tests 2025-09-09 21:01:45 -07:00
Krrish Dholakia e443d01925 test: remove redundant test 2025-09-09 20:37:09 -07:00
Krrish Dholakia bff76715a5 test: skip test with invalid arn 2025-09-09 20:35:44 -07:00
Krrish Dholakia 07a83056a6 test: update test 2025-09-09 20:30:50 -07:00
Krrish Dholakia 44566977f1 test: update test 2025-09-09 20:18:03 -07:00
Krrish Dholakia ba6819dc18 bump: version 1.77.0 → 1.77.1 2025-09-09 19:58:21 -07:00
Krish DholakiaandGitHub 22aef4e7b2 Merge pull request #14387 from BerriAI/litellm_dev_09_09_2025_p1 
fix(internal_user_endpoints.py): ensure only proxy admin can update v…
 2025-09-09 19:54:13 -07:00
Krrish Dholakia 076b46c806 build: remove end of life bedrock model 2025-09-09 19:49:22 -07:00
Krrish Dholakia 0854c35d3e test: remove eol bedrock model from tests 2025-09-09 19:48:35 -07:00
Krrish Dholakia 7cbf91cf36 fix(proxy_server.py): fix api call 2025-09-09 19:44:25 -07:00
Krrish Dholakia 62fcc52eb6 fix(internal_user_endpoints.py): ensure only proxy admin can update values for other users 
prevents proxy_admin_viewer from updating other user passwords
 2025-09-09 19:28:16 -07:00
Krrish Dholakia 98444a900b fix(config_settings.md): document new env var 2025-09-09 19:25:38 -07:00
Krrish Dholakia 944176f5e8 fix: check if metadata is not none 2025-09-09 19:23:07 -07:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		555efd60b5 [Security] Fix: Ensure .info() logs are not used for request/responses + Add code QA check for possible violations (#14386) 
* test: info log

* fixes for debug

* add info_log_check

* fix: debug level

* fix: debug level

* fix: use .debug

* fix info statements

* fix info log check

* fix: fix emit_standard_logging_payload

* fix RequestBody

* Potential fix for code scanning alert no. 3339: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix check

* fix code qa check

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2025-09-09 13:55:56 -07:00
Duc TranandGitHub fd70ccfd5b Update proxy_cli.py help message (#14369) 2025-09-09 13:52:59 -07:00
Arseny BoykovandGitHub 5b680bb4a3 Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352) 
(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
 2025-09-09 13:51:00 -07:00
Pedro AzevedoandGitHub 44dc6d3aef Fix: Add supports_function_calling for GPT OSS in Bedrock provider (#14375) 
* Refactor JSON formatting and remove unnecessary whitespace in model prices and context window

* Fix formatting inconsistencies and remove unnecessary whitespace in model prices JSON
 2025-09-09 13:49:32 -07:00
Ishaan JaffandGitHub af7d3cd334 [Fix] Remove INFO level log from /messages endpoint (#14377) 
* fix: verbose_proxy_logger.debug

* fix: chat_completion_pass_through_endpoint
 2025-09-09 12:51:03 -07:00
Arseny BoykovandGitHub 29309f767c Use fastuuid for litellm_call_id (#14346) 
(cherry picked from commit 201806401ff12564fb6065b69cd8af347ed7c8e6)
 2025-09-09 11:21:31 -07:00
pinkguandGitHub 285b14bd69 Fix/gcp model armor (#14381) 
* chore: fix model armor always success

Signed-off-by: bjorn <bjornjee95@gmail.com>

* chore: fix sanitisation field extraction

Signed-off-by: bjorn <bjornjee95@gmail.com>

---------

Signed-off-by: bjorn <bjornjee95@gmail.com>
 2025-09-09 09:18:37 -07:00
Oleksandr Tereshchenko 4d7e918b63 restore forgotten raise keyword in front of an exception_type() call 2025-09-09 17:55:03 +03:00
Derek Worthen 59360e64f9 Fix embeddings using azure_ad_token_provider. 2025-09-09 07:01:05 -07:00
swarnabhasinha f8ddd123d1 fix: add missing patch import in vertex_ai test 2025-09-09 16:16:59 +05:30
swarnabhasinha 4076e20b35 fix: lint 2025-09-09 16:05:04 +05:30
swarnabhasinha 7c5ec380c1 fix: remove anthropic-beta header for Vertex AI requests with prompt caching 2025-09-09 15:57:53 +05:30