tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 14:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,574 Commits 2,072 Branches 1,425 Tags
eb48d5cc42ec31e04ce26ef12cebd201b2f43269
Commit Graph
27574 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
yuneng-jiangandGitHub eb48d5cc42 Revert "Exclude litellm_credential_name from sensitive masker (#16950)" (#16956) 
This reverts commit 5cfacb96e6.
 2025-11-21 18:09:54 -08:00
Ishaan Jaffer 58a56babd9 test fixes for masker 2025-11-21 17:41:35 -08:00
Ishaan Jaffer 1f36fad94b TestDockerModelRunnerIntegration 2025-11-21 17:39:33 -08:00
Ishaan Jaffer 3296ffd3ca test fixes 2025-11-21 17:38:20 -08:00
Ishaan JaffGitHubCursor Agentishaan
 		34f0c3c4dc Remove cost tracking disabled tooltip in chat ui (#16953) 
* Fix: Simplify cost tooltip in ResponseMetrics

Co-authored-by: ishaan <ishaan@berri.ai>

* Fix: Display cost metric correctly in ResponseMetrics

Co-authored-by: ishaan <ishaan@berri.ai>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-11-21 17:25:37 -08:00
Ishaan Jaffer 8b8b31ecd8 fix img gen 2025-11-21 17:18:48 -08:00
Ishaan Jaffer 6439aed3ac snowflake test fix 2025-11-21 17:12:55 -08:00
Ishaan Jaffer e7a32c1e8f docker test fixes 2025-11-21 16:52:58 -08:00
Ishaan Jaffer 473fec8a60 fix _get_allowed_mcp_servers 2025-11-21 16:48:43 -08:00
yuneng-jiangandGitHub 1ebe1fea37 Docs for Model Compare UI and Org Usage (#16928) 
* Docs for Model Compare UI and Org Usage

* Fix typo in img path and add Model Compare to sidebars.js

* Updated to remove from 1.80 writeup
 2025-11-21 16:45:55 -08:00
yuneng-jiangandGitHub 49e331329b Remove console logs and errors from model tab (#16455) 2025-11-21 16:45:11 -08:00
yuneng-jiangandGitHub 5cfacb96e6 Exclude litellm_credential_name from sensitive masker (#16950) 2025-11-21 16:40:17 -08:00
Ishaan Jaffer 9b5a655b7c fix _encode_tool_call_id_with_signature 2025-11-21 16:27:35 -08:00
Ishaan Jaffer 69da15e65e test_fal_ai_image_generation_basic 2025-11-21 16:23:41 -08:00
Ishaan Jaffer 4a9f163db1 TestPromptVersionsEndpoint 2025-11-21 16:21:13 -08:00
Ishaan Jaffer 4e8f1d0143 fix prompt manager 2025-11-21 16:17:44 -08:00
Ishaan Jaffer 2226450437 test_ensure_initialize_azure_sdk_client_always_used 2025-11-21 16:15:35 -08:00
Ishaan Jaffer 4205b7caeb fix install litellm 2025-11-21 16:15:09 -08:00
yuneng-jiangandGitHub 0abfb07ab8 Remove UI Session Token from user/info return (#16851) 2025-11-21 16:11:58 -08:00
Ishaan JaffandGitHub 8e318dd06c [Feat] New LLM Provider - Docker Model Runner (#16948) 
* add DOCKER_MODEL_RUNNER

* add DockerModelRunnerChatConfig Transorm

* add docker_model_runner

* add docker_model_runner

* docs docker model runner

* add DockerModelRunnerChatConfig

* add docker_model_runner to providers

* test_completion_hits_correct_url_and_body

* fix sidebar

* TestDockerModelRunnerIntegration

* test_completion_with_custom_engine_and_host

* docs docker model runner

* docs fix
 2025-11-21 16:09:32 -08:00
EiliyaandGitHub d88580fa28 fix(gemini-video): inherit BaseVideoConfig to enable async content response (#16875) 
This fix addresses the same issue that was resolved for OpenAI video in PR #16708.

The GeminiVideoConfig class was importing BaseVideoConfig only within TYPE_CHECKING,
causing it to be 'Any' at runtime. This prevented the async_transform_video_content_response
method from being available during video content downloads.

Changes:
- Moved BaseVideoConfig import from TYPE_CHECKING to top-level imports
- Added test_gemini_video_config_has_async_transform() to verify the fix
- Ensures GeminiVideoConfig properly inherits BaseVideoConfig at runtime

Fixes video generation errors for Gemini Veo models:
'GeminiVideoConfig' object has no attribute 'async_transform_video_content_response'
 2025-11-21 16:01:21 -08:00
Suresh KumarandGitHub 5b4a848391 fix anthropic pass-through endpoint (#16883) 2025-11-21 16:00:05 -08:00
yuneng-jiangandGitHub b6b8f46b36 Change Public Model Hub to use proxyBaseUrl (#16892) 2025-11-21 15:59:03 -08:00
Cesar GarciaandGitHub 1c65800f4a Feat: add support for Grok 4.1 Fast models (#16936) 
* feat: Add support for Grok 4.1 Fast models

Add new xAI Grok 4.1 Fast models optimized for high-performance agentic tool calling:

- xai/grok-4-1-fast (alias for grok-4-1-fast-reasoning)
- xai/grok-4-1-fast-reasoning (with reasoning capabilities)
- xai/grok-4-1-fast-reasoning-latest
- xai/grok-4-1-fast-non-reasoning (without reasoning for faster responses)
- xai/grok-4-1-fast-non-reasoning-latest

Features:
- Context window: 2,000,000 tokens
- Pricing: $0.20/1M input, $0.50/1M output tokens
- Cached tokens: $0.05/1M tokens
- Supports: Function calling, Structured outputs, Vision, Audio input, Web search, Reasoning

Fixes #16927

* docs: Add comprehensive Grok models documentation

- Add 'Supported Models' section highlighting new Grok 4.1 Fast models
- Include comparison guide for reasoning vs non-reasoning models
- Add complete model family table (Grok 4.1, 4, 3, Code, 2)
- Add features legend explaining capabilities
- Remove pricing details (link to xAI docs instead for current rates)
- Improve documentation clarity and consistency

Related to #16927

* docs: Minor corrections to xai.md
 2025-11-21 15:57:55 -08:00
Cesar GarciaandGitHub 22ef7ab070 feat: Add support for Gemini 3 Pro Image model (#16938) 
Add gemini-3-pro-image-preview model configuration for Google's new
image generation model (aka "Nano Banana Pro 🍌").

Model details:
- Input: $2.00/1M tokens (text), $0.0011/image
- Output: $12.00/1M tokens (text), $0.134/image (1K/2K)
- Context: 65k input / 32k output tokens
- Capabilities: structured outputs, web search, caching, thinking
- No function calling support
- Available on both Gemini API and Vertex AI

Added variants:
- gemini-3-pro-image-preview (base, uses Vertex AI)
- gemini/gemini-3-pro-image-preview (Gemini API)
- vertex_ai/gemini-3-pro-image-preview (Vertex AI)

Source: https://ai.google.dev/gemini-api/docs/pricing
Fixes: #16925
 2025-11-21 15:55:25 -08:00
YutaSaitoandGitHub 7c4ef090c1 docs: fix mcp url format (#16940) 
* docs: fix mcp url format

* fix: update Cursor MCP example to use url instead of server_url
 2025-11-21 15:43:26 -08:00
Ishaan JaffandGitHub ed6c3b4c86 [Bug Fix]: Search APIs - error in firecrawl-search "Invalid request body" (#16943) 
* add search_tool_name in litellm params

* test_search_tool_name_in_all_litellm_params

* bump config
 2025-11-21 14:56:19 -08:00
Ishaan JaffandGitHub 01ea6c8948 [New model] Add GLM 4.6 from together.ai (#16942) 
* new model - add together_ai/zai-org/GLM-4.6

* together_ai/zai-org/GLM-4.6
 2025-11-21 14:39:52 -08:00
Cesar GarciaandGitHub 1812ebae70 fix: Correct Cerebras GPT-OSS-120B model name (#16939) 
Change model identifier from cerebras/openai/gpt-oss-120b to
cerebras/gpt-oss-120b to match Cerebras API requirements.

The Cerebras API only accepts 'gpt-oss-120b' as the model ID, not
'openai/gpt-oss-120b'. The previous name was causing "Model does not
exist" errors when users tried to use it.

Tested with real API calls to confirm:
- cerebras/gpt-oss-120b → sends 'gpt-oss-120b' → ✅ works
- cerebras/openai/gpt-oss-120b → sends 'openai/gpt-oss-120b' → ❌ fails

Fixes #16924
 2025-11-21 14:20:31 -08:00
Ishaan JaffandGitHub fb38763eb4 [Feat] UI - Show "get code" section for prompt management + minor polish of showing version history (#16941) 
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id

* fx info and delete lookup for prompts

* refactor prompt table

* - rename to prompt studio

* fix get_prompt_info

* fix endpoints

* add PromptCodeSnippets

* prompt info view

* add prompt info view

* show correct version for prompts

* fix version selector

* fix endpoints and version

* fix get_prompt_info

* fix version display
 2025-11-21 14:00:33 -08:00
Ishaan JaffandGitHub c9ac1949ee [Fix] Prompt Management - UI, allow seeing model, prompt id for Prompt (#16932) 
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id

* fx info and delete lookup for prompts

* refactor prompt table
 2025-11-21 13:59:54 -08:00
yuneng-jiangandGitHub 5dd2ee0bff Change /public fields to honor server root path (#16930) 2025-11-21 13:59:16 -08:00
Ishaan JaffandGitHub 6ae22908b7 [Feat] Prompt Versioning - Allow specifying prompt version in code (#16929) 
* add _get_prompt_data_from_dotprompt_content

* fix pre call hook for prompt template

* fix: get_latest_version_prompt_id

* fix get_latest_version_prompt_id

* test_get_latest_version_prompt_id
 2025-11-21 13:58:49 -08:00
yuneng-jiangandGitHub 4b25398afe [Infra] CI/CD Fixes (#16937) 
* Attempt CI/CD Fix

* Adding test for coverage

* Adding max depth to copilot and vertex

* Fixing mypy lint and docker database

* Fixing UI build issues

* Update playwright test
 2025-11-21 13:58:19 -08:00
colinlin-stripeandGitHub f9d8eeaf8e [stripe] gemini 3 thought signatures in tool call id (#16895) 
* though signature tool call id

* [stripe] refactor and tests

* [stripe] remove md and move to factory

* [stripe] remove redudant test

* [stripe] ran black formatting

* [stripe] add thought signature docs

* [stripe] remove unused import
 2025-11-21 13:44:53 -08:00
Clint BanzhafandGitHub caddc6dd0f fix images being dropped from tool results for bedrock (#16492) 
* fix images being dropped from tool results for bedrock

* type fixes
 2025-11-21 10:52:48 -08:00
Ishaan JaffandGitHub 97d9da93e0 [Feat] Prompt Management - Allow viewing version history (#16901) 
* TestPromptRequest

* add prompts/test endpoint for testing prompt

* TestPromptTestEndpoint

* feat: working v1 of this ui

* workig prompt endpoints

* add chat ui for prompts

* add conversation panel

* add init chat ui

* allow clicking edit prompt

* fix use get_base_prompt_id

* add endpoints for viewing prompt versions

* TestPromptVersioning

* add getPromptVersions

* add VersionHistorySidePanel

* allow viewing version history

* add version history
 2025-11-21 08:54:52 -08:00
Ishaan JaffGitHubCursor Agentishaan
 		3c789ac287 feat: Add vector store create and search call types (#16859) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
 2025-11-21 08:54:41 -08:00
Ishaan JaffandGitHub 41566722af [Feat] UI - Prompt Management - Allow testing prompts with Chat UI (#16898) 
* TestPromptRequest

* add prompts/test endpoint for testing prompt

* TestPromptTestEndpoint

* feat: working v1 of this ui

* workig prompt endpoints

* add chat ui for prompts

* add conversation panel

* add init chat ui
 2025-11-21 08:53:18 -08:00
superpoussin22andGitHub b96179a07a Upgrade pydantic to version 2.11.0 (#16909) 
Updated pydantic version to 2.11.0 for compatibility.
 2025-11-21 08:52:44 -08:00
ツルマルツヨシandGitHub be9f2e026c feat(pricing): Add Gemini 3 Pro Preview for OpenRouter (#16905) 2025-11-21 08:52:25 -08:00
YutaSaitoandGitHub 041ac054b6 feat: allow custom violation message for tool-permission guardrail (#16916) 2025-11-21 08:52:01 -08:00
yuneng-jiangandGitHub 7225fc066f Fix key model alias (#16896) 2025-11-20 16:05:49 -08:00
Krrish Dholakia e7751f0c12 docs: fix docs bug 2025-11-20 16:05:39 -08:00
YutaSaitoandGitHub 93affcb732 [Feat] mcp resources support (#16800) 
* feat: mcp prompts support

* feat: mcp resources support
 2025-11-20 14:53:44 -08:00
Ishaan Jaffer 0d812f98bc new u build 2025-11-20 14:05:27 -08:00
Ishaan JaffandGitHub 57544f1662 [Feat] Adds IAM role assumption support for AWS Secret Manager (#16887) 
* add AWS fields for KeyManagementSettings

* docs IAM roles

* use aws iam auth on secret manager v2

* fix: load_aws_secret_manager

* test_secret_manager_with_iam_role_settings
 2025-11-20 12:38:48 -08:00
yuneng-jiangandGitHub 9120a02474 Change favicon (#16837) 2025-11-19 20:38:22 -08:00
Sameer KankuteandGitHub e5948770dd Fix audio transcription cost tracking (#16478) 2025-11-19 20:29:39 -08:00
Krrish Dholakia 28cadaa123 docs: fix tags 2025-11-19 20:26:48 -08:00