tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-24 02:25:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph
5648 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub 2ea855d225 Merge pull request #17707 from raghav-stripe/raghav-fix-responsesapi-rl 
fix: responses api not applying tpm rate limits on api keys
 2025-12-11 08:57:16 +05:30
Ishaan JaffandGitHub 4a7437ba5f [Feat] Agent Gateway - allow adding langgraph, bedrock agent core agents (#17802) 
* fix: langgraph bridge streaming

* add public/agents/fields

* test_a2a_completion_bridge_non_streaming

* TestA2AStreamingTransformation

* AgentCredentialFieldMetadata

* add new logo

* refactor add agent

* fix add dynamic fields

* feat allow adding langgraph agent

* add langgraph provider

* stash

* add AgentCreateInfo

* agent_create_fields

* fix fields

* test_a2a_completion_bridge_bedrock_agentcore

* test_a2a_completion_bridge_bedrock_agentcore

* add public endpoints

* fix a2a endpoints

* fix dynamic fields
 2025-12-10 19:13:50 -08:00
Sameer KankuteandGitHub ad5d94a82f Merge pull request #17771 from BerriAI/litellm_db_videos_issue 
fix: respect videos content db creds
 2025-12-11 08:27:43 +05:30
Yuta Saito 6393277bf4 fix: separate MCP handling out of main.py 2025-12-11 10:39:14 +09:00
Ishaan JaffandGitHub 059fedbed5 [Feat] Agent Gateway - Track agent_id in SpendLogs (#17795) 
* add agent_id in metadata in spend logs

* add agent_id in SpendLogsPayload

* add agent_id in SpendLogsPayload

* add _set_agent_id_on_logging_obj

* add agent id tracking in SpendLogs

* add agent id in spend logs

* fix create_a2a_client

* test_asend_message_passes_agent_id_to_callback

* test_get_logging_payload_includes_agent_id_from_kwargs

* test_asend_message_streaming_triggers_callbacks

* fix asend_message_streaming

* asend_message_streaming

* A2AStreamingIterator

* _handle_stream_message

* test_asend_message_streaming_propagates_metadata
 2025-12-10 16:09:56 -08:00
Ishaan JaffandGitHub 5d456bcdc3 [Feat] UI SSO - allow fetching role from generic SSO provider (Keycloak) (#17787) 
* fix ui SSO

* TestGenericResponseConvertorUserRole

* Assigning User Roles via SSO
 2025-12-10 13:09:28 -08:00
Ishaan JaffandGitHub 7ad2a58dcd [Feat] A2a Gateway - allow using bedrock agentcore, langgraph agents with A2a Gateway (#17786) 
* init LANGGRAPH

* init LangGraphConfig

* init LangGraphConfig types

* init langgraph

* init getting api base and key

* init transform langgraph

* fix SSE issues

* test_langgraph_acompletion_non_streaming

* add LangGraph to docs

* docs: Setting Up a Local LangGraph Server

* fix langgraph SSE

* fix import uuid

* init A2A to LiteLLM Completion Bridge

* add send message for bridge

* test_a2a_completion_bridge_non_streaming

* add A2ACompletionBridgeTransformation

* add a2a send message support

* init a2a bridge
 2025-12-10 13:08:43 -08:00
Ishaan JaffandGitHub 49b91c4a35 [Feat] A2a gateway - Add cost per token pricing (#17780) 
* fix calculate_a2a_cost

* add cost_per_query

* add test_asend_message_uses_cost_per_query

* fix: _initialize_slack_alerting_jobs

* feat: add token tracking for agents invoke

* add A2ARequestUtils

* add _set_usage_on_logging_obj

* test_asend_message_token_tracking

* add _handle_a2a_response_logging

* test_asend_message_streaming_token_tracking

* add A2AStreamingIterator

* add cost calculator for agents

* test_asend_message_uses_input_output_cost_per_token

* docs gix
 2025-12-10 13:08:15 -08:00
Ishaan JaffandGitHub 5ee32167c0 [Feat] New Provider - add langgraph (#17783) 
* init LANGGRAPH

* init LangGraphConfig

* init LangGraphConfig types

* init langgraph

* init getting api base and key

* init transform langgraph

* fix SSE issues

* test_langgraph_acompletion_non_streaming

* add LangGraph to docs

* docs: Setting Up a Local LangGraph Server

* fix langgraph SSE

* fix import uuid
 2025-12-10 12:30:35 -08:00
yuneng-jiang 1cad479297 Daily Agent Usage Table WIP 2025-12-10 11:50:52 -08:00
Ishaan JaffandGitHub 7a33579af6 [Feat] Agent Gateway - Add cost per query for agent invocations (#17774) 
* fix calculate_a2a_cost

* add cost_per_query

* add test_asend_message_uses_cost_per_query

* fix: _initialize_slack_alerting_jobs
 2025-12-10 10:43:52 -08:00
yuneng-jiang 3d7c6cb690 Merge remote-tracking branch 'origin' into litellm_sendgrid 2025-12-10 10:42:47 -08:00
saisurya237andGitHub f3ead2c153 add a new feature fix to expose the team alias when authenticating th… (#17725) 
* CLI SSO: show team aliases in team selection

* temp poetry lock fix

* add poetry.lock to gitignore

* Revert proxy_server background job refactor

* Revert proxy_server background job refactor

* rever gitignore and poetry lock file
 2025-12-10 10:10:28 -08:00
yuneng-jiangandGitHub ba554a86b9 Merge pull request #16843 from BerriAI/litellm_allow_custom_mount_paths 
[Feature] Allow Root Path to Redirect when Docs not on Root Path
 2025-12-10 09:52:30 -08:00
Sameer Kankute 15e5a8251e fix: respect videos content db creds 2025-12-10 23:00:01 +05:30
Sameer KankuteandGitHub dea62e3f60 Merge pull request #17769 from BerriAI/litellm_test_fix 
Fix nvdia and geminin tests
 2025-12-10 22:29:04 +05:30
Sameer KankuteandGitHub 4c78c1afc8 Merge pull request #17756 from BerriAI/litellm_add_gemini_computer_use 
Add support for computer use for gemini
 2025-12-10 22:28:37 +05:30
Sameer Kankute ec30032bc3 Fix nvdia and geminin tests 2025-12-10 22:05:11 +05:30
Sameer Kankute 9e3a04a725 Add batch passthrough endpoint cost tracking for anthropic 2025-12-10 18:24:31 +05:30
Sameer Kankute b9d3d7c059 Add tests for file and batch feat for anthropic 2025-12-10 17:14:47 +05:30
Sameer KankuteandGitHub 0d2f8ce931 Merge pull request #17711 from BerriAI/litellm_add_additional_drop_params_support 
feat: Add nested field removal support to additional_drop_params
 2025-12-10 15:37:39 +05:30
Lucas SugiandGitHub c7fd8fabdb fix: Avoid error when we have just the tool_calls in input (#17753) 
* fix: Avoid error when we have just the tool_calls in input

* fix: Remove the tool call validation

* feat: Add unit test
 2025-12-09 22:59:59 -08:00
Krish DholakiaandGitHub b0a5a4b81d Arize Phoenix OSS - Prompt Management Integration (#17750) 
* docs(prompt_management.md): document how to onboard prompts to litellm

* feat(arize_phoenix_prompt_manager.py): support new prompt management integration

allows users to connect arize phoenix prompt manager to litellm

* fix(proxy/utils.py): remove prompt variables to avoid re-processing prompt

* docs(arize_phoenix_prompts.md): document new prompt management integration
 2025-12-09 22:53:42 -08:00
Sameer Kankute bcac9e41f6 Add support for computer use for gemini 2025-12-10 10:34:08 +05:30
yuneng-jiang 0769a290da Sendgrid integration + bump enterprise package 2025-12-09 19:34:09 -08:00
Ishaan JaffandGitHub e546f0e021 [Fix] UI SSO - allow up-serting user role when SSO provider role changes (#17754) 
* use _build_sso_user_update_data

* test_build_sso_user_update_data_with_valid_role
 2025-12-09 19:16:10 -08:00
Peter ChanthamynavongandGitHub 539ce89d4e fix(guardrails): mask all regex pattern matches, not just first (#17727) 
Before: search() + replace() only replaced first match
After: sub() replaces all matches of each pattern

Closes #17687
 2025-12-09 18:51:28 -08:00
Hunter WittenbornGitHubCopilot
 		82f0c3c887 Support model names with slashes on Gemini endpoints (#17743) 
* Support model names with slashes on Gemini endpoints

* Fix test

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/proxy_unit_tests/test_google_endpoint_routing.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
 2025-12-09 18:40:51 -08:00
Krrish Dholakia 8b125ff74e test: remove test_helicone - integration test made live calls to api and broke ci/cd 2025-12-09 18:36:51 -08:00
Cesar GarciaandGitHub 01dec55c2f fix(anthropic): preserve server_tool_use and web_search_tool_result in multi-turn conversations (#17746) 
- Extract web_search_tool_result blocks in extract_response_content()
- Store web_search_results in provider_specific_fields for round-trip
- Detect srvtoolu_ prefix to reconstruct as server_tool_use (not tool_use)
- Add corresponding web_search_tool_result after server_tool_use blocks

This ensures multi-turn conversations with Anthropic web search + custom
tools work correctly without Anthropic expecting tool_result for server-
side tool executions.
 2025-12-09 18:25:23 -08:00
Krish DholakiaGitHubCursor Agent
 		9fa6c51678 Fix: Add Gemini context window exception mapping (#17751) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-12-09 18:24:13 -08:00
Krrish Dholakia f23a78fddc test: remove expensive test 2025-12-09 18:23:03 -08:00
Krrish Dholakia c276a87ab0 fix(anthropic/chat/transformation.py): pass output_config + thinking to claude opus 4.5 2025-12-09 18:21:41 -08:00
Sameer KankuteandGitHub 8fafd81f9d Merge pull request #17732 from BerriAI/litellm_videos_bugs_2 
Fix : use litellm params for all videos apis
 2025-12-10 07:49:55 +05:30
yuneng-jiang 0e2fcde145 Change health check to read env varlike chat completions 2025-12-09 18:17:07 -08:00
Shivam RawatandGitHub 4ada6bee49 fixed flex tier pricing (#17748) 2025-12-09 18:10:51 -08:00
Yuta Saito ed5cbdac2f feat: add support for using MCPs on /chat/completions 2025-12-10 10:55:33 +09:00
Cesar GarciaandGitHub 63a97db663 feat(voyage): add rerank API support (#17744) 
* feat(voyage): add rerank API support

Add support for Voyage AI rerank models (rerank-2.5, rerank-2.5-lite,
rerank-2, rerank-2-lite) to the LiteLLM rerank API.

Changes:
- Add VoyageRerankConfig transformation class
- Register voyage provider in rerank_api/main.py
- Add voyage case in utils.py get_provider_rerank_config
- Add rerank-2.5 and rerank-2.5-lite models to pricing JSON
- Add unit tests for transformation logic
- Update documentation for voyage.md and rerank.md

Usage:
```python
from litellm import rerank

response = rerank(
    model="voyage/rerank-2.5",
    query="What is the capital of France?",
    documents=["Paris is...", "London is..."],
    top_n=3,
)
```

* refactor(voyage): simplify rerank transformation code

Remove verbose docstrings to align with other providers (jina_ai pattern).
No functional changes - 168 lines vs 169 for jina_ai.

* fix(voyage): remove incorrect input_cost_per_query from rerank models

Voyage AI charges per token, not per query. The input_cost_per_query
field was incorrectly set to the same value as input_cost_per_token
in the existing rerank-2 and rerank-2-lite models.

Removes input_cost_per_query from all Voyage rerank models:
- voyage/rerank-2
- voyage/rerank-2-lite
- voyage/rerank-2.5
- voyage/rerank-2.5-lite

Pricing source: https://docs.voyageai.com/docs/pricing
 2025-12-09 17:34:09 -08:00
Ishaan JaffandGitHub 3631e8fa1d [Feat] Containers API - add new container API file management + UI Interface (#17745) 
* test_router_acreate_container_without_model

* _init_containers_api_endpoints

* test_init_containers_api_endpoints

* init container files endpoints

* init files api

* init container files API

* add containers api file content

* add code interpreter output UI

* add code interpreter input ui

* refactor code interpreter ui

* fix: require model selection

* cleaner container provision

* fix ContainerFileObject

* def container_file_content_handler(
add

* add retrieve_container_file_content

* aretrieve_container_file_content

* UI fix model

* fix linting errors
 2025-12-09 17:33:26 -08:00
Ishaan JaffandGitHub 142567e143 [Fix] Containers API - Allow using LIST, Create Containers using custom-llm-provider (#17740) 
* test_router_acreate_container_without_model

* _init_containers_api_endpoints

* test_init_containers_api_endpoints
 2025-12-09 17:00:35 -08:00
yuneng-jiang d99cf81386 Fixing test 2025-12-09 16:11:17 -08:00
ephrimstanleyandGitHub a91dda1194 Return 403 instead of 503 for unauthorized routes (#17723) 2025-12-09 15:16:11 -08:00
yuneng-jiangandGitHub bdfc3308b1 Merge pull request #17741 from BerriAI/litellm_ui_cred_fix_2 
[Fix] Change credential encryption to only affect db credentials
 2025-12-09 14:04:20 -08:00
yuneng-jiang 879ae45421 Change credential encryption to only affect db credentials 2025-12-09 13:36:40 -08:00
YutaSaitoandGitHub 80a18f989a feat: propagate Langfuse trace_id (#17669) 2025-12-09 12:25:52 -08:00
yuneng-jiang 68419cfe4e Merge remote-tracking branch 'origin' into litellm_tag_spend_dedupe 2025-12-09 11:59:47 -08:00
yuneng-jiang 39bf7a9f7c Merge remote-tracking branch 'origin' into litellm_allow_custom_mount_paths 2025-12-09 11:58:05 -08:00
yuneng-jiang 4bffbe0bff Merge remote-tracking branch 'origin' into litellm_sso_config_2 2025-12-09 11:56:30 -08:00
yuneng-jiangandGitHub 9253a9c365 Merge pull request #17689 from BerriAI/litellm_ui_settings_backend 
[Feature] Get and Update Backend Routes for UI Settings
 2025-12-09 11:55:28 -08:00
yuneng-jiang e4442c2946 Change UI Settings to a dedicated table 2025-12-09 11:19:53 -08:00