tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-11 00:25:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,119 Commits 2,072 Branches 1,425 Tags
a4341ccf833c19f716e00a8fedc66fb257d5bcd6
Commit Graph
28119 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
mossbanayandGitHub ae633184f7 Add model price & details for Bedrock model global.anthropic.claude-opus-4-5-20251101-v1:0 (#17380) 2025-12-02 22:02:57 -08:00
Matt GreathouseandGitHub f22bc0aab2 Support Deepseek 3.2 with Reasoning (#17384) 
* Add openrouter/deepseek/deepseek-v3.2

* Added deepseek-provided v3.2

* Allow reasoning effort param for openrouter models that support it

* Added tests
 2025-12-02 22:00:19 -08:00
Richard SongandGitHub 099ccf56a7 Refactor add_schema_to_components to move definitions to components/schemas and add corresponding unit test (#17389) 2025-12-02 21:57:07 -08:00
Sameer Kankute 40c203e32b Make thought sign in tool call id as a beta feat 2025-12-03 11:04:53 +05:30
Sameer Kankute 209e9e05aa Fix gemini 3 last chunk thinking block 2025-12-03 10:13:59 +05:30
yuneng-jiang 7fea97a0c0 Add is_sso_configured to UI Config 2025-12-02 17:53:16 -08:00
yuneng-jiang afedc9aac3 Fixing test 2025-12-02 17:34:53 -08:00
yuneng-jiang 8f565a811c Merge with main 2025-12-02 17:31:03 -08:00
yuneng-jiang 4006987f0e Merge remote-tracking branch 'origin' into litellm_ui_cred_refresh 2025-12-02 17:29:22 -08:00
Ishaan JaffandGitHub 427074ac6e Fix: Datadog callback regression when ddtrace is installed (#17393) 
* fix DD agent host logging

* docs fix

* test_datadog_agent_configuration

* test_datadog_ignores_ddtrace_agent_host
 2025-12-02 17:27:50 -08:00
yuneng-jiang b000851be8 Merge remote-tracking branch 'origin' into litellm_ui_cred_refresh 2025-12-02 17:27:10 -08:00
yuneng-jiangandGitHub 451690bf11 Merge pull request #17321 from BerriAI/litellm_ui_user_alias_table 
[Feature] Add User Alias Column to Internal User Table
 2025-12-02 17:26:49 -08:00
yuneng-jiangandGitHub cfedc371d6 Merge pull request #17325 from BerriAI/litellm_ui_key_terminology 
[Refactor] Standardize API Key vs Virtual Key in UI
 2025-12-02 17:26:31 -08:00
yuneng-jiangandGitHub 6e3a44b82c Merge pull request #17397 from BerriAI/litellm_ui_cred_fix 
[Fix] Show all credential values on Edit Credential Modal
 2025-12-02 17:12:36 -08:00
yuneng-jiang 4063501d69 Show all credential values on Edit Credential Modal 2025-12-02 17:08:17 -08:00
flozonnandGitHub 31cad8e6e6 feat: Add Nova lite 2 reasoning support with reasoningConfig (#17371) 2025-12-02 16:33:07 -08:00
Ishaan JaffandGitHub 10d56e7c46 add new deepseek-v3p2 (#17395) 2025-12-02 16:19:34 -08:00
yuneng-jiangandGitHub 12d3c4a1d4 Merge pull request #17394 from BerriAI/litellm_ui_org_models_fix 
[Fix] UI - Change Edit Team Models Shown to Match Create Team
 2025-12-02 16:06:36 -08:00
Krrish Dholakia 8ee298f9c9 fix: remove python3 headers 2025-12-02 16:06:06 -08:00
yuneng-jiang 9867cc6cf9 Change edit team models to match create team models 2025-12-02 15:58:27 -08:00
Krrish Dholakia 7fb2f4730b build: remove duplicate packages 2025-12-02 15:53:10 -08:00
Ishaan JaffandGitHub 6c188c5ae2 [Feat] New model/provider - Adds support for Google Cloud Chirp3 HD on /speech (#17391) 
* docs vertex tts

* place vertex ai types in file

* use VertexAITextToSpeechConfig

* use vertex_voice_dict

* refactor docs

* docs vertex ai chirp

* TestVertexAITextToSpeechConfig

* new provider vertex ai chirp3

* test_litellm_speech_vertex_ai_chirp

* add vertex_ai/chirp cost trackign
 2025-12-02 15:36:23 -08:00
Leslie ChengandGitHub de4ff120eb 🐛 Fix proxy caching between requests in aiohttp transport (#17122) 
* write a regression test

* impl fix

* add test for host case

* use the host as cache key
 2025-12-02 14:37:45 -08:00
Ishaan JaffandGitHub db6c6eea89 [Docs] Add guide on how to debug gateway error vs provider error (#17387) 
* add error diagnosis

* docs error diagnosis
 2025-12-02 14:10:00 -08:00
yuneng-jiangandGitHub 7d4f3f9290 Merge pull request #17382 from BerriAI/litellm_vertex_api_base 
[Infra] Add Google Private API Endpoint to Vertex AI fields
 2025-12-02 12:26:28 -08:00
yuneng-jiang 8b8f93d508 Add Google Private API Endpoint to Vertex AI fields 2025-12-02 12:24:00 -08:00
yuneng-jiangandGitHub 61b0dbd726 Merge pull request #17378 from BerriAI/litellm_indent_import_fix 
[Fix] Bedrock Guardrail Indent and Import fix
 2025-12-02 11:28:12 -08:00
yuneng-jiang 8c1290dcd2 Indent and import fix 2025-12-02 11:26:29 -08:00
yuneng-jiang 6ee9d9c344 /login route refactor 2025-12-02 11:19:27 -08:00
kothamahandGitHub 12530b375f Litellm bedrock OpenAI model support (#17368) 
* Update constants.py

added constants

* Update base_aws_llm.py

added steps

* Update invoke_handler.py

added openai support

* Update base_invoke_transformation.py

added

* Update test_bedrock_completion.py

added
 2025-12-02 09:19:53 -08:00
Cesar GarciaandGitHub 81f4d863ca docs: add Azure AI Foundry documentation for Claude models (#17104) 
* docs: add Azure AI Foundry documentation for Claude models

Add documentation explaining how to use Claude models (Sonnet 4.5,
Haiku 4.5, Opus 4.1) deployed on Azure AI Foundry with LiteLLM.

Azure exposes Claude using Anthropic's native API, so users can use
the existing anthropic/ provider with their Azure endpoint.

Closes #17066

* docs: Add alternative method for Azure AI Foundry using anthropic/ provider

Document that users can use anthropic/ provider with Azure endpoint
as an alternative to the dedicated azure_ai/ provider.
 2025-12-02 09:08:10 -08:00
Sameer KankuteandGitHub 4ac9e4c81c Merge pull request #17345 from BerriAI/litellm_fix_jwt_auth_route_issue 
Add other routes in jwt auth
 2025-12-02 22:21:04 +05:30
Sameer KankuteandGitHub 397aceced8 Merge pull request #17342 from BerriAI/litellm_fix_mcp_auth_header_forwarding 
Fix: litellm user auth not passing issue
 2025-12-02 22:20:33 +05:30
Sameer KankuteandGitHub 18a9af3488 Merge pull request #17291 from BerriAI/litellm_fix_correct_attribute_error_code_raise 
Fix 500 error for malformed request
 2025-12-02 22:17:48 +05:30
Ishaan JaffandGitHub 1bb9e1bde8 [Feat] Add vllm batch+files API support (#15823) 
* add OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS

* fix use OPENAI_COMPATIBLE_BATCH_AND_FILES_PROVIDERS

* add _get_batch_job_total_usage_from_file_content

* fixes for vLLM + 12 labs async invoke

* fix: vLLM Batch APIs

* afile_retrieve

* test_hosted_vllm_full_workflow

* fix SERVER_URL for test
 2025-12-02 08:41:50 -08:00
Alexsander HamirandGitHub 9ff2ecc16d Fix: update default proxy_batch_write_at number (#17355) 
The default is 10 seconds, not 30.
 2025-12-02 05:52:00 -08:00
Alexsander HamirandGitHub 0acb7f418d Fix (Docs) - Update default database connection limit #17353 
We recommend using 10–20 connections. Our actual default is 10, but the documentation incorrectly listed the default as 100.
 2025-12-02 05:35:58 -08:00
AlexsanderHamir 7324905c95 fix: update default database connection number 2025-12-02 05:29:03 -08:00
Sameer Kankute 831ad45c4d Add ragflow support 2025-12-02 18:18:08 +05:30
Sameer Kankute 6d296b1d25 Add other routes in jwt auth 2025-12-02 14:00:34 +05:30
Sameer Kankute 082c8af37f Fix: litellm user auth not passing issue 2025-12-02 11:25:32 +05:30
Krish DholakiaandGitHub 4c7a988454 Guardrail API V2 - user api key metadata, session id, specify input type (request/response), image support (#17338) 
* refactor(generic_guardrail_api.py): refactor to update to new guardrail api logic

* refactor: refactor llm api integrations to support passing in text as a list[str] instead of one at a time

* refactor: fix linting errors

* refactor: pass request type to guardrail api

allows request vs. response processing to occur

* feat: pass user api key dict information to the guardrail api

* fix: pass user api key dict information to the guardrail api

* feat: pass litellm call id + trace id, if present

* docs: update docs
 2025-12-01 20:11:58 -08:00
YutaSaitoandGitHub fe41e14951 fix: remove URL format validation for MCP server endpoints (#17270) 2025-12-01 20:08:54 -08:00
Korbinian KochandGitHub 6e8e3b30f9 Update Databricks model pricing and add new models (including databricks pricing test). (#17277) 
* update databricks pricing and add DBU<>USD test

* Refactor test_databricks_pricing.py

Removed unnecessary sys.path modification and cleaned up comments.
 2025-12-01 20:06:47 -08:00
codgicianandGitHub e09e309371 feat(github-copilot): Add Embedding API support (#17278) 2025-12-01 20:05:28 -08:00
Boxuan LiandGitHub 89458573a2 Add context window exception mapping for Together AI (#17284) 2025-12-01 20:02:59 -08:00
YutaSaitoandGitHub da5b81c1ff feat: add experimental latest-user filtering for Bedrock (#17282) 
* feat: add experimental latest-user filtering for Bedrock

* doc: add experimental bedrock latest-message flag
 2025-12-01 20:02:28 -08:00
Saar wintrovandGitHub 860270a792 SSO: Clear sso integration for all users (#17287) 2025-12-01 20:01:36 -08:00
Cesar GarciaandGitHub 01dfc3561a Fix AttributeError when metadata is null in request body (#17263) (#17306) 
Handle the case where metadata is explicitly set to null/None in the
request body. This was causing a 401 error with "'NoneType' object
has no attribute 'get'" when calling /v1/batches with metadata: null.

The fix uses `or {}` instead of a default dict value since the key
exists but has a None value.
 2025-12-01 19:58:27 -08:00
Cesar GarciaandGitHub 965406c643 feat(provider): add Z.AI (Zhipu AI) as built-in provider (#17307) 
* feat(provider): add Z.AI (Zhipu AI) as built-in provider

Add support for Z.AI GLM models as a native OpenAI-compatible provider.

- Add "zai" to openai_compatible_providers list
- Add ZAI enum to LlmProviders
- Add provider URL resolution for https://api.z.ai/api/paas/v4
- Add 8 GLM models with pricing to model cost maps:
  - glm-4.6 (200K context, $0.6/$2.2 per 1M tokens)
  - glm-4.5, glm-4.5v, glm-4.5-x, glm-4.5-air, glm-4.5-airx
  - glm-4-32b-0414-128k
  - glm-4.5-flash (free tier)
- Add unit tests for provider integration

Closes #17289

* docs: add Z.AI provider documentation

- Add zai.md with usage examples, model list, and pricing
- Add to sidebars.js navigation
 2025-12-01 19:56:47 -08:00