tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 16:24:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,135 Commits 2,072 Branches 1,425 Tags
be0530a6b331dc32f2ca58c46fccea5f60f598c4
Commit Graph
28135 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub be0530a6b3 fix(unified_guardrail.py): correctly map a v1/messages call to the anthropic unified guardrail (#17424) 
* fix(unified_guardrail.py): correctly map a v1/messages call to the anthropic unified guardrail

* fix: add more rigorous call type checks

* fix(anthropic_endpoints/endpoints.py): initialize logging object at the beginning of endpoint

ensures call id + trace id are emitted to guardrail api

* feat(anthropic/chat/guardrail_translation): support streaming guardrails

sample on every 5 chunks

* fix(openai/chat/guardrail_translation): support openai streaming guardrails

* fix: initial commit fixing output guardrails for responses api

* feat(openai/responses/guardrail_translation): handler.py - fix output checks on responses api

* fix(openai/responses/guardrail_translation/handler.py): ensure responses api guardrails work on streaming

* test: update tests

* test: update tests

* test: update tests

* fix(bedrock_guardrails.py): fix post call streaming iterator logic

* fix: fix return

* fix(bedrock_guardrails.py): fix
v1.80.7.dev.3 		2025-12-03 20:54:56 -08:00
Xander SongandGitHub a711b63b06 fix: clean arize-phoenix traces (#16611) 
* fix

* clean

* clean

* clean

* clean

* clean

* lint
 2025-12-03 19:50:20 -08:00
Ishaan JaffandGitHub 607d517c01 Revert "Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363)" (#17457) 
This reverts commit 462d423d86.
 2025-12-03 19:44:24 -08:00
Ishaan Jaffer 8a824b7c17 fix mypy linting 2025-12-03 19:43:29 -08:00
Ishaan Jaffer 92cca5d515 test_cyberark_write_and_read_secret 2025-12-03 19:43:29 -08:00
Ishaan Jaffer e7f066ea7d test_hosted_vllm_full_workflow 2025-12-03 19:43:29 -08:00
Sameer KankuteandGitHub 50fc30644e Merge pull request #17311 from Chesars/fix/azure-gpt5.1-reasoning-effort-none 
Fix: Allow reasoning_effort='none' for Azure gpt-5.1 models
 2025-12-04 09:08:32 +05:30
Ishaan JaffandGitHub b96657a083 [Feat] UI - Agent Gateway - allow testing agents on UI (#17455) 
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent

* fix endpoints on A2a

* UI allow testing a2a endpoints
 2025-12-03 18:57:57 -08:00
Ishaan JaffandGitHub e4f954b354 [Docs] Agent Gateway (#17454) 
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent

* fix endpoints on A2a

* UI allow testing a2a endpoints

* add agent imgs

* add a2a as an endpoint

* add a2a

* docs a2a invoke

* docs a2a

* docs A2a invoke
 2025-12-03 18:57:41 -08:00
Ishaan JaffandGitHub 585aee2ae4 [Feat] Agent Gateway - Allow tracking request / response in "Logs" Page (#17449) 
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation

* add a2a invocation i cost calc

* test_a2a_logging_payload

* update invoke_agent_a2a

* test_invoke_agent_a2a_adds_litellm_data

* add A2a agent
 2025-12-03 18:57:18 -08:00
Ishaan JaffandGitHub 4370f6fb74 [Feat] Agent Gateway - Allow invoking agents through AI Gateway (#17440) 
* init litellm A2a client

* simpler a2a client interface

* test a2a

* move a2a invoking tests

* test fix

* ensure a2a send message is tracked n logs

* rename tags

* add streaming handlng

* add a2a invocation
 2025-12-03 18:54:55 -08:00
Ishaan JaffandGitHub f035984dd7 fix: cyberark allow setting ssl verfiy to false (#17433) 2025-12-03 18:54:31 -08:00
yuneng-jiangandGitHub e29acb2f64 Merge pull request #16850 from BerriAI/litellm_user_info_404 
[Fix] Return 404 when a user is not found on /user/info
 2025-12-03 17:15:55 -08:00
yuneng-jiangandGitHub 224c012e14 Merge pull request #17383 from BerriAI/litellm_vertex_api_base 
[Fix] Change labeling around Vertex Fields
 2025-12-03 17:14:14 -08:00
yuneng-jiangandGitHub 73824c278a Merge pull request #17443 from BerriAI/litellm_v2_login 
[Feature] New Login Page
 2025-12-03 16:23:47 -08:00
yuneng-jiangandGitHub c5670839b6 Merge pull request #17399 from BerriAI/litellm_ui_config_add_sso 
[Feature] Add auto_redirect_to_sso to UI Config
 2025-12-03 15:59:06 -08:00
yuneng-jiang 37c598441f Change is_sso_configured to auto_redirect_to_sso 2025-12-03 15:48:50 -08:00
yuneng-jiang 8a1cf104e0 Merge remote-tracking branch 'origin' into litellm_ui_config_add_sso 2025-12-03 15:36:33 -08:00
yuneng-jiangandGitHub ee63105e16 Merge pull request #17446 from BerriAI/litellm_ui_e2e_cicd_fix 
[Fix] Change e2e test to look for Virtual Keys instead of API Keys
 2025-12-03 15:35:22 -08:00
yuneng-jiang de4b79851f Change e2e test to look for Virtual Keys instead of API Keys 2025-12-03 15:26:25 -08:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		462d423d86 Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363) 
Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.10.1 to 1.23.0.
- [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases)
- [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md)
- [Commits](https://github.com/modelcontextprotocol/python-sdk/compare/v1.10.1...v1.23.0)

---
updated-dependencies:
- dependency-name: mcp
  dependency-version: 1.23.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-12-03 15:19:34 -08:00
yuneng-jiang 43da0793d3 Fixed typo 2025-12-03 15:13:19 -08:00
yuneng-jiang b14b4a7112 New login screen using v2/login 2025-12-03 15:05:29 -08:00
Ishaan JaffandGitHub 100cfc11ac [Bug Fix] Parallel Request Limiter with /messages (#17426) 
* fix: use standard_logging_object for parallel request limiter

* fix test parallel request limtier
 2025-12-03 14:13:28 -08:00
Ishaan Jaffer 9b3d8302cf docs fix stable 2025-12-03 14:12:50 -08:00
yuneng-jiang 5f43e7a2d2 New login page WIP 2025-12-03 13:18:33 -08:00
yuneng-jiang 9bb292f478 V2 login route 2025-12-03 12:41:45 -08:00
yuneng-jiangandGitHub 8aa939dd67 Merge pull request #17317 from BerriAI/litellm_ui_cred_refresh 
[Feature] Delete Credential Enhancements
 2025-12-03 12:20:55 -08:00
yuneng-jiangandGitHub 857614d586 Merge pull request #17436 from BerriAI/litellm_ui_model_page_scrollbars 
[Fix] Remove second scrollbar when sidebar is expanded + tooltip z index
 2025-12-03 12:20:00 -08:00
yuneng-jiang 9783f0ff6c Remove second scrollbar when sidebar is expanded + tooltip z index 2025-12-03 12:14:48 -08:00
Alexsander HamirandGitHub 56328e6535 [Refactor#2] litellm/init – Lazy-load utils to reduce memory + import time (#17171) 
* fix: lazy load utils.py imports

Lazy-load most functions and response types from utils.py to avoid loading
tiktoken and other heavy dependencies at import time. This significantly
reduces memory usage when importing completion from litellm.
 2025-12-03 11:40:16 -08:00
yuneng-jiangandGitHub dcb7552b79 Merge pull request #17379 from BerriAI/litellm_login_route_refactor 
[Refactor] /login route
 2025-12-03 11:32:16 -08:00
Felipe GaréandGitHub 82a8134d7a fixing optional parameter default value (#17434) 2025-12-03 11:24:32 -08:00
yuneng-jiang 8df8a7ef95 Merge remote-tracking branch 'origin' into litellm_ui_cred_refresh 2025-12-03 11:04:09 -08:00
yuneng-jiang 457840afed Merge remote-tracking branch 'origin' into litellm_user_info_404 2025-12-03 11:02:23 -08:00
yuneng-jiang e6620fcdad Ruff checks 2025-12-03 11:01:10 -08:00
Felipe GaréandGitHub 5ecebe2a57 adding status parameter as optinal for FileObject (#17431) 2025-12-03 11:00:18 -08:00
Alexsander HamirandGitHub 0a7602bb7c fix: prevent memory leak in aiohttp connection pooling (#17388) 
* fix: prevent memory leak in aiohttp connection pooling

Add connection limits to aiohttp TCPConnector to prevent unbounded
connection growth that causes memory leaks. Without these limits,
aiohttp's _wrap_create_connection can accumulate connections
indefinitely in long-running processes.

Changes:
- Set default limit of 300 total connections and 50 per host
- Apply limits to shared proxy session initialization
- Apply limits to HTTP handler transport creation
- Configurable via AIOHTTP_CONNECTOR_LIMIT and
  AIOHTTP_CONNECTOR_LIMIT_PER_HOST environment variables
- Set to 0 for unlimited (not recommended for production)

This fix covers:
- All standard LLM provider API calls (OpenAI, Anthropic, etc.)
- Proxy server shared session
- Most guardrail HTTP calls

Impact: Prevents memory exhaustion in high-traffic deployments and
long-running proxy servers that make thousands of API calls.

Testing: Verified connection limits are applied correctly and
existing functionality remains unchanged.
 2025-12-03 10:43:27 -08:00
yuneng-jiang b3c0ea5414 Merge remote-tracking branch 'origin' into litellm_login_route_refactor 2025-12-03 10:40:11 -08:00
Cesar GarciaandGitHub 5e791464af docs: add Microsoft Agent Lightning to projects (#17422) 
Add Agent Lightning, Microsoft's open-source framework for training
AI agents with RL, APO, and SFT. Uses LiteLLM Proxy for LLM routing
and trace collection.
 2025-12-03 09:07:02 -08:00
Krrish Dholakia be5dd234bf docs: fix list 2025-12-03 08:01:26 -08:00
Sameer KankuteandGitHub ece1e49fda Merge pull request #17414 from BerriAI/litellm_ragflow_vector_store 
Add vector store support for ragflow
 2025-12-03 20:48:52 +05:30
Sameer KankuteandGitHub fcc2855baa Merge pull request #17403 from BerriAI/litellm_streaming_gemini_3_fix 
Fix gemini 3 last chunk thinking block
 2025-12-03 20:48:13 +05:30
Sameer KankuteandGitHub 7967da77c0 Merge pull request #17419 from BerriAI/litellm_fix_bedrock_models_model_map 
Fix bedrock models in model map
 2025-12-03 20:45:45 +05:30
Sameer KankuteandGitHub 7e9c1ffb33 Merge pull request #17407 from BerriAI/litellm_enforce_enforce_user_param 
Enforce support of enforce_user_param to openai post endpoints
 2025-12-03 20:45:21 +05:30
Sameer KankuteandGitHub 1fbe310444 Merge pull request #17405 from BerriAI/litellm_gemini_thought_sig_tool_beta 
Make thought sign in tool call id as a beta feat
 2025-12-03 20:43:53 +05:30
Sameer Kankute c9c7823f43 Fix bedrock models in model map 2025-12-03 17:31:20 +05:30
Sameer Kankute dad0b2c111 Fix unused imports 2025-12-03 15:32:42 +05:30
Sameer Kankute 8eaabb4ad7 Add vector store support for ragflow 2025-12-03 15:29:47 +05:30
Sameer KankuteandGitHub 52090c3f3e Merge pull request #17350 from BerriAI/litellm_rag_chat_completion_api 
Add ragflow support for chat completions API
 2025-12-03 13:29:32 +05:30