tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-18 06:26:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
25,012 Commits 2,072 Branches 1,425 Tags
cb573f61c8a4929f1b77cff27f8ddab747147e3d
Commit Graph
4252 Commits
Author SHA1 Message Date
Tim Elfrink cb573f61c8 Document model_id parameter for Bedrock inference profiles with image generation 
Add documentation for using AWS Bedrock Application Inference Profiles
with image generation APIs, specifically for Nova Canvas models.

The documentation includes:
- SDK examples showing model_id parameter usage
- Proxy configuration examples
- Follows the same pattern as chat completions inference profiles
 2025-09-18 10:57:12 +02:00
Krish DholakiaandGitHub 56fd60b140 Merge pull request #14494 from eliasto/feat/ovhcloud-ai-edpoints-provider 
feat: Add OVHCloud AI Endpoints as a provider
 2025-09-14 00:45:08 -07:00
Krrish Dholakia 7ef8c808cf docs: update doc 2025-09-14 00:28:11 -07:00
Krish DholakiaandGitHub 11822e63f1 Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail 
feat: add tool-permission guardrail
 2025-09-13 23:22:31 -07:00
Ishaan JaffandGitHub f37dd6bb95 Litellm 1.77.2 stable notes (#14544) 
* fix release notes instructions

* docs v1

* fix doc

* fix highlights

* docs fix

* docs fix
 2025-09-13 18:41:34 -07:00
Boopesh ShanmugamandGitHub 95da14cb96 Docs update on user header mapping (#14527) 2025-09-13 16:58:10 -07:00
Krish DholakiaandGitHub 269515e525 Merge branch 'main' into litellm_dev_09_12_2025_p1 2025-09-13 10:10:30 -07:00
Krrish Dholakia 9ee9745781 docs(vllm.md): document new endpoint 2025-09-13 09:46:39 -07:00
Krish DholakiaandGitHub 38efd358eb Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode 
Noma non blocking monitor mode & anonymize input support
 2025-09-13 09:41:41 -07:00
Krish DholakiaandGitHub ad9515a81e Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1 2025-09-13 09:38:43 -07:00
Krish DholakiaandGitHub de8cf40ffa Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3 
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
 2025-09-12 19:56:53 -07:00
Ishaan Jaff 8b3b943557 docs fix 2025-09-12 19:51:14 -07:00
Krrish Dholakia 05e3e3685b docs(forward_client_headers.md): document new forwarding client headers to llm api feature 2025-09-12 19:38:07 -07:00
Ishaan JaffandGitHub 93af8fd6ba [QA] E2E - Testing for bedrock batches api (#14525) 
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0

* test_bedrock_batches_api

* fix

* fix import

* test_bedrock_batches_api
 2025-09-12 19:31:19 -07:00
Ishaan JaffandGitHub 20c390dc71 [Docs] - Bedrock Batches API (#14526) 
* docs bedrock batch

* docs fix

* docs bedrock batches

* fix Create Batch Request

* docs fix
 2025-09-12 19:08:13 -07:00
Krrish Dholakia bdd960c451 docs(admin_ui_sso.md): clarify sso usage on docs 2025-09-12 18:03:03 -07:00
Yuta Saito 1de7f076ac feat: add tool-permission guardrail 2025-09-13 07:34:29 +09:00
Elias TOURNEUX 54f49b430d fix: edit readme to add OVHCloud 2025-09-12 14:29:33 +02:00
Elias TOURNEUX ef9d1ddc40 feat: Add OVHCloud AI Endpoints as a provider 2025-09-12 13:37:03 +02:00
Krrish Dholakia c802c472b5 docs(debugging.md): document new feature 
Closes https://github.com/BerriAI/litellm/issues/13814
 2025-09-11 20:17:39 -07:00
Ishaan JaffandGitHub dda115cc6d [Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471) 
* add dashscope logo

* docs fix

* docs fix

* fix supports_batch_calling

* fix naming

* fix input_cost_per_audio_token

* use output_cost_per_reasoning_token

* add tiered_pricing in get_model_info

* test fixes

* fix cost calc

* ruff fix
 2025-09-11 18:14:39 -07:00
Tom Alon b473344f70 Implement anonymization logic 2025-09-11 11:47:19 +03:00
Ishaan JaffandGitHub a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392) 
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
 2025-09-10 19:12:11 -07:00
Ishaan JaffandGitHub 1f42e41c8d [Bug]: Fix Authorization header not being sent to configured MCP servers (#14422) 
* test: test_mcp_server_config_auth_value_header_used

* fix: authentication_token

* docs: fix instructions on using responses api with MCPs

* mcp fixes
 2025-09-10 16:41:08 -07:00
Ishaan Jaff 199c262e33 EXPERIMENTAL_MULTI_INSTANCE_RATE_LIMITING 2025-09-10 15:55:27 -07:00
Krish DholakiaandGitHub d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection 
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
 2025-09-09 22:35:30 -07:00
Krish DholakiaandGitHub 34c5bc7bb0 Merge pull request #14391 from mubashir1osmani/fix_all_docs 
added tags to langchain
 2025-09-09 22:15:16 -07:00
mubashir1osmani c20a5b0bbd more info for turn_off_logging 2025-09-10 00:51:37 -04:00
mubashir1osmani f51036e092 added tags to langchain 2025-09-10 00:32:26 -04:00
Krrish Dholakia 98444a900b fix(config_settings.md): document new env var 2025-09-09 19:25:38 -07:00
Krish DholakiaandGitHub b9ce3a1587 Merge pull request #12416 from dotmobo/feature/fix-alloy 
feat: add a health_check_voice parameter in model_info
 2025-09-08 23:12:48 -07:00
Krish DholakiaandGitHub 5ab091f1a4 Merge pull request #14335 from TeddyAmkie/custom-sso-doc-update 
Scim docs updated with user removal behavior
 2025-09-08 19:04:45 -07:00
Ishaan Jaff ddfbf7c36c docs v1.76.3 2025-09-08 18:37:28 -07:00
Ishaan JaffandGitHub 68d250973c [Feature]: Support "Token" MCPAuth (#14359) 
* add MCPAuth.authorization type

* test: Token Auth MCP

* fix: _get_auth_headers to handle auth_type == MCPAuth.authorization

* docs auth types with MCP on config.yaml

* test_mcp_server_works_without_config_auth_value
 2025-09-08 18:25:41 -07:00
Ishaan Jaff af751a61dd docs fix 2025-09-08 18:07:33 -07:00
Boopesh ShanmugamandGitHub f8cb06db60 Changed the model field in the response format to open AI matching the default request (#14354) 2025-09-08 13:45:30 -07:00
Zhengyi LaiandGitHub 8a77fb4da1 Update docker_quick_start.md (#14322) 2025-09-08 12:58:13 -07:00
berri-teddy a09613edfd Scim docs updated with user removal behavior 2025-09-08 09:20:00 -07:00
Dharamendra Kumar 92596e48fe Merge branch 'main' into feature/aiohttp-dependency-injection 2025-09-07 17:54:55 -07:00
Dharamendra Kumar 009106def0 docs for custom aiohttp session 2025-09-07 17:42:26 -07:00
Krish DholakiaandGitHub ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish DholakiaandGitHub d2f02a55b9 Merge pull request #14308 from mubashir1osmani/main 
docs: moved custom spend tags
 2025-09-06 21:58:20 -07:00
mubashir1osmani b9be68cc45 spend tracking details 2025-09-06 22:24:49 -04:00
mubashir1osmani 2095fe3c98 moved custom spend tags 2025-09-06 22:14:52 -04:00
mubashir1osmani 976967f1e0 Revert "docs: moved custom spend tags metadata to spend tracking" 
This reverts commit d1eb87a1e6.
 2025-09-06 22:12:16 -04:00
mubashir1osmani d1eb87a1e6 docs: moved custom spend tags metadata to spend tracking 2025-09-06 22:09:03 -04:00
mubashir1osmani 2674c49283 added spend tags 2025-09-06 21:59:45 -04:00
Krish DholakiaandGitHub a3ffc3060e Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Krish DholakiaandGitHub b8fdbd479b Merge pull request #13931 from BerriAI/litellm_release_notes_08_23_2025 
docs(index.md): initial commit with release notes
 2025-09-06 18:48:44 -07:00
Krish DholakiaandGitHub f7810eec79 Merge pull request #14299 from TeddyAmkie/docs-update-clean 
Doc Updates 9-5-25
 2025-09-06 18:47:18 -07:00