Commit Graph
26286 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 9c3e29b9f0 Merge pull request #15330 from jlan-nl/litellm-fix-erroneous-gpt5-cooldown-trigger
Minimal fix: gpt5 models should not go on cooldown when called with temperature!=1
2025-10-09 22:34:30 -07:00
Krish DholakiaandGitHub ab2f866510 Merge pull request #15363 from vkolehmainen/fix-20250918083359_drop_spec_version_column_from_mcp_table
Remove hardcoded "public" schema in 20250918083359_drop_spec_version_column_from_mcp_table/migration.sql
2025-10-09 22:27:02 -07:00
Krish DholakiaandGitHub 611a876889 Merge pull request #15380 from BerriAI/litellm_shared_heatlh_status
Implement Shared Health Check State Across Pods
2025-10-09 22:25:45 -07:00
Krish DholakiaandGitHub e1e1ea31dc Merge pull request #15379 from PostHog/feat/posthog-per-request-api-key
feat: posthog per request api key
2025-10-09 22:24:51 -07:00
Krish DholakiaandGitHub 9c50d0f057 Merge pull request #15383 from zainhas/patch-1
Add new together models
2025-10-09 22:20:45 -07:00
Krish DholakiaandGitHub 039c7e0f11 Merge pull request #15384 from BerriAI/litellm_ui_teams_team_role_column
Teams page: new column "Your Role" on the teams table
2025-10-09 22:19:51 -07:00
Krish DholakiaandGitHub 667339410f Merge pull request #15391 from uc4w6c/fix/mcp-call-tool-context
fix: Ensure MCP client stays open during tool call
2025-10-09 22:18:23 -07:00
Krish DholakiaandGitHub f97b0e182a Merge branch 'main' into fix/mcp-call-tool-context 2025-10-09 22:17:34 -07:00
Alexsander HamirandGitHub 1c7463f42f [Perf]: optimize SSL/TLS handshake performance with prioritized cipher (#15398)
* perf: optimize SSL/TLS handshake performance with prioritized cipher suites

Add configurable SSL cipher suite list that strongly prefers fast modern
ciphers (TLS 1.3, ECDHE+GCM) while maintaining backward compatibility with
widely-supported fallback ciphers. Set minimum TLS version to 1.2 for
better performance.

Changes:
- Add DEFAULT_SSL_CIPHERS constant with prioritized cipher list
  (configurable via LITELLM_SSL_CIPHERS env var)
- Update get_ssl_configuration() to apply optimized ciphers by default
- Set TLS minimum version to 1.2
- Preserve existing ssl_security_level parameter for custom configs

This balances handshake performance (~50-100ms with modern ciphers) with
broad provider compatibility.

* fix: missing documented constants
2025-10-09 19:21:37 -07:00
Ishaan JaffandGitHub 52bbabd788 [Feat] Support for Vertex AI Gemma Models on Custom Endpoints (#15397)
* TestVertexGemmaiCompletion

* test vertex Gemma

* fix file name

* fix file naming

* add VertexAIGemmaModels

* add cost_router for vertexai

* fix main.py

* fix VertexGemmaConfig

* fix Vertex AI Gemma-AI Models Handler

* docs gemma

* fix ids

* test fix

* ruff check fixes

* docs fix

* docs fix
2025-10-09 19:20:02 -07:00
Alexsander HamirandGitHub 76a614bc76 fix: remove panic from hot path (#15396) 2025-10-09 18:43:44 -07:00
Ishaan JaffandGitHub 4827e62a21 Fix - OpenRouter cache_control to only apply to last content block (#15395)
* fix: _move_cache_control_to_content

* test_openrouter_transform_request_with_cache_control_list_content

* fix code QA check

* fix: mypy lint

* fix handlers

* fix mypy

* fix - refactor code, fixes for QA checks
2025-10-09 18:01:33 -07:00
ashengstdandGitHub 2686156c37 temporarily relax ResponsesAPIResponse parsing to support custom backends (#15362)
- Replace `ResponsesAPIResponse(**raw_response_json)` with
  `ResponsesAPIResponse.model_construct(**raw_response_json)`
  to bypass strict Pydantic validation.
- Allows Response API to work with self-hosted or non-strict models
  (e.g., vLLM) without raising literal/type errors.
- This is a temporary, low-risk relaxation to improve compatibility
  with more backend implementations.
2025-10-09 17:46:10 -07:00
Krish DholakiaandGitHub eb0b263532 Merge pull request #15340 from BerriAI/litellm_db_config_accidental_override_fix
fix: Prevents DB from accidentally overriding config file values if they are empty in DB
2025-10-09 17:31:59 -07:00
Alexsander HamirandGitHub c7234ba053 [Fix] - Sessions not being shared (#15388)
* fix: share sessions

* fix: remove limit

* clean up

* fix: add missing consts

* add: E2E test

* fix: remove redefinition of unused verbose_logger

* fix: missing const import
2025-10-09 16:57:40 -07:00
Ishaan JaffandGitHub ec234abb52 fix - param (#15394) 2025-10-09 16:50:11 -07:00
Achintya Rajan 679cf54c6e adds vitests surrounding new components 2025-10-09 16:30:32 -07:00
Ishaan Jaffer be587363f3 docs fix 2025-10-09 16:28:38 -07:00
Ishaan JaffandGitHub 6cf57d85c3 [Feat] Add EnkryptAI Guardrails on LiteLLM (#15390)
* feat: add EnkryptAIGuardrail

* fix types

* fix EnkryptAIGuardrails

* __all__ = ["EnkryptAIGuardrail"]
fix

* fix EnkryptAIGuardrail

* TestEnkryptAIExtraction

* fix mypy linting

* docs enkrypt ai

* add EnkryptAIGuardrailConfigModel

* fix EnkryptAIGuardrailConfigModel

* fix import struct

* fix EnkryptAIGuardrails
2025-10-09 16:27:04 -07:00
Achintya Rajan dce17a8d16 added column "Your Role" with admin and member badges 2025-10-09 16:26:11 -07:00
Emerson GomesandGitHub 22df8de01f Add new Azure AI models with pricing details (#15387)
Adding missing Azure AI models:

* Phi-4-reasoning
* Phi-4-mini-reasoning
* MAI-DS-R1
2025-10-09 15:25:22 -07:00
Yuta Saito 2b1c061d35 fix: lint error 2025-10-10 07:24:33 +09:00
Yuta Saito 3035305c76 fix: Ensure MCP client stays open during tool call 2025-10-10 07:15:32 +09:00
Achintya Rajan 87b0ff6ab0 Update CreateKeyPage.expiredToken.test.tsx 2025-10-09 13:58:34 -07:00
Achintya Rajan 091196a1fd added back Ishaan's MCP changes 2025-10-09 12:36:10 -07:00
Achintya Rajan 7d0088952e renamed teams component to TeamsView 2025-10-09 12:32:45 -07:00
Achintya Rajan 9d1147a5e8 teams refactor: extracted CreateTeamModal 2025-10-09 12:32:41 -07:00
Achintya Rajan 7c6e48c780 useAuthorized fix, teams refactor progress 2025-10-09 11:57:36 -07:00
Achintya Rajan d94e27e3c2 refactored teams -> teams header and teams filter 2025-10-09 11:57:33 -07:00
Zain HasanandGitHub 553c0ffb1e Add new together models 2025-10-09 10:59:51 -07:00
Sameer Kankute dce6cd1051 Add shared healthcheck 2025-10-09 22:18:05 +05:30
Carlos Marchal dd560f792e feat: posthog per request api key 2025-10-09 18:32:11 +02:00
Krish DholakiaandGitHub 7b9897e88f Merge pull request #15321 from timelfrink/fix/redact-aws-credentials
fix: redact AWS credentials when redact_user_api_key_info enabled
2025-10-09 07:26:40 -07:00
Krrish Dholakia f88e3ebdfa docs: refactor to have function call / computer use / etc. on top level 2025-10-09 07:25:25 -07:00
VEQK (Ville Kolehmainen) 2e01fa4f51 Remove hardcoded schema 2025-10-09 10:03:19 +03:00
Tim Elfrink 56b2c914ed Apply isort formatting to router.py imports 2025-10-09 08:13:16 +02:00
Tim Elfrink 02f0b1e83a Merge latest changes from origin/main into fix/redact-aws-credentials
Resolved import conflict for CustomPricingLiteLLMParams which was moved
from litellm.types.router to litellm.types.utils in main branch.
2025-10-09 08:12:22 +02:00
Krish DholakiaandGitHub e2e0cdde31 Merge pull request #15315 from lcfyi/lcfyi/add-support-for-parallel-tool-calls
Fix parallel tool calls in the Anthropic passthrough adapter
2025-10-08 23:01:55 -07:00
Krish DholakiaandGitHub 4615298ba1 Merge pull request #15336 from BerriAI/litellm_fix_litellm_Param_costing
Fix litellm_param based costing
2025-10-08 22:55:41 -07:00
Sameer Kankute e4b89813a5 Add remaining cost fields 2025-10-09 08:40:06 +05:30
Ishaan Jaffer 763d2f8ccd UI new build v1.77.7.dev9 2025-10-08 19:57:33 -07:00
Krish DholakiaandGitHub 753ce49cdd Merge pull request #15346 from BerriAI/litellm_dev_10_08_2025_p2
MCP - specify allowed params per tool
2025-10-08 19:27:55 -07:00
Krish DholakiaandGitHub a02b3caef3 Merge branch 'main' into litellm_dev_10_08_2025_p2 2025-10-08 19:27:24 -07:00
Achintya Rajan 95e71b31a8 Update test_proxy_utils.py 2025-10-08 19:25:54 -07:00
Achintya Rajan 169c1f0f21 moved test to test_proxy_server 2025-10-08 19:24:16 -07:00
Krish DholakiaandGitHub 94e623fb14 Merge pull request #15236 from BerriAI/litellm_ui_refactor_genesis
LiteLLM UI Refactor Infrastructure
2025-10-08 19:19:02 -07:00
Krrish Dholakia e2b7b05774 docs(mcp.md): document new openapi to mcp tool support 2025-10-08 19:16:22 -07:00
Krish DholakiaandGitHub d921df1baf Merge pull request #15343 from BerriAI/litellm_dev_10_08_2025_p1
MCP - support converting OpenAPI specs to MCP servers
2025-10-08 19:10:04 -07:00
Krrish Dholakia 5be198248b fix: fix linting error 2025-10-08 19:07:11 -07:00
Krrish Dholakia 37fdb486d4 refactor: comment out oauth error raising logic for now 2025-10-08 19:06:19 -07:00