tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-07 14:25:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,119 Commits 2,072 Branches 1,425 Tags
a4341ccf833c19f716e00a8fedc66fb257d5bcd6
Commit Graph
506 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub 1fbe310444 Merge pull request #17405 from BerriAI/litellm_gemini_thought_sig_tool_beta 
Make thought sign in tool call id as a beta feat
 2025-12-03 20:43:53 +05:30
Sameer KankuteandGitHub 52090c3f3e Merge pull request #17350 from BerriAI/litellm_rag_chat_completion_api 
Add ragflow support for chat completions API
 2025-12-03 13:29:32 +05:30
Krish DholakiaandGitHub 8edcc4ecc3 Guardrails API - add streaming support (#17400) 
* fix(initial-commit): adding a way to get the right response type based on the api route

* feat(unified_guardrail.py): support streaming guardrails

* test: update tests

* fix: fix linting errors

* test: update tests
 2025-12-02 22:52:09 -08:00
Matt GreathouseandGitHub f22bc0aab2 Support Deepseek 3.2 with Reasoning (#17384) 
* Add openrouter/deepseek/deepseek-v3.2

* Added deepseek-provided v3.2

* Allow reasoning effort param for openrouter models that support it

* Added tests
 2025-12-02 22:00:19 -08:00
Sameer Kankute 40c203e32b Make thought sign in tool call id as a beta feat 2025-12-03 11:04:53 +05:30
flozonnandGitHub 31cad8e6e6 feat: Add Nova lite 2 reasoning support with reasoningConfig (#17371) 2025-12-02 16:33:07 -08:00
Leslie ChengandGitHub de4ff120eb 🐛 Fix proxy caching between requests in aiohttp transport (#17122) 
* write a regression test

* impl fix

* add test for host case

* use the host as cache key
 2025-12-02 14:37:45 -08:00
Sameer Kankute 831ad45c4d Add ragflow support 2025-12-02 18:18:08 +05:30
Korbinian KochandGitHub 6e8e3b30f9 Update Databricks model pricing and add new models (including databricks pricing test). (#17277) 
* update databricks pricing and add DBU<>USD test

* Refactor test_databricks_pricing.py

Removed unnecessary sys.path modification and cleaned up comments.
 2025-12-01 20:06:47 -08:00
codgicianandGitHub e09e309371 feat(github-copilot): Add Embedding API support (#17278) 2025-12-01 20:05:28 -08:00
Cesar GarciaandGitHub 965406c643 feat(provider): add Z.AI (Zhipu AI) as built-in provider (#17307) 
* feat(provider): add Z.AI (Zhipu AI) as built-in provider

Add support for Z.AI GLM models as a native OpenAI-compatible provider.

- Add "zai" to openai_compatible_providers list
- Add ZAI enum to LlmProviders
- Add provider URL resolution for https://api.z.ai/api/paas/v4
- Add 8 GLM models with pricing to model cost maps:
  - glm-4.6 (200K context, $0.6/$2.2 per 1M tokens)
  - glm-4.5, glm-4.5v, glm-4.5-x, glm-4.5-air, glm-4.5-airx
  - glm-4-32b-0414-128k
  - glm-4.5-flash (free tier)
- Add unit tests for provider integration

Closes #17289

* docs: add Z.AI provider documentation

- Add zai.md with usage examples, model list, and pricing
- Add to sidebars.js navigation
 2025-12-01 19:56:47 -08:00
Sameer KankuteandGitHub 289c13ca5d Merge pull request #17260 from abi-jey/main 
fix: GA path for azure openai realtime models
 2025-12-02 08:34:10 +05:30
Sameer KankuteandGitHub dbf1cd591d Merge pull request #17271 from colinlin-stripe/cherry-pick-invoke-headers 
[fix] extra_headers in messages api bedrock invoke
 2025-12-02 08:26:54 +05:30
Ishaan JaffandGitHub 860cdc81d3 [Fix] Fix Watsonx Audio Transcription API (#17326) 
* """
add

* fix transform_audio_transcription_request

* fix tests

* test_watsonx_transcription_request_body
 2025-12-01 18:26:56 -08:00
EliasandGitHub 37ecb03d4f Add support of audio transcription for OVHcloud (#17305) 2025-12-01 18:26:39 -08:00
Ishaan JaffandGitHub ce0dc0c8b9 [Feat] WatsonX - allow passing zen_api_key dynamically (#16655) 
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
 2025-12-01 12:55:47 -08:00
Colin Lin 661bccbc39 fixed flaky test by sorting list 2025-12-01 14:26:14 -05:00
Colin Lin e420b633a1 add tests 2025-12-01 14:25:37 -05:00
Sameer Kankute 983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer KankuteandGitHub 7f42b9b987 Merge pull request #17193 from BerriAI/litellm_twelvelabs_int 
Added support for twelvelabs pegasus
 2025-11-28 22:09:00 +05:30
Sameer Kankute 9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
abbas jafariandGitHub 23b737d2a4 Merge branch 'BerriAI:main' into main 2025-11-28 15:28:52 +01:00
abi_jey 4cf7a74e60 fix: Azure OpenAI GA path relies soley on model paramter as deployment 2025-11-28 14:27:57 +00:00
Andy ForestandGitHub 8aa4f3d476 fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Wei-Chiet KuGitHubKu Wei Chiet
 		d43c077653 Fix/issue 16759 streaming error validation (#17242) 
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
 2025-11-27 21:24:04 -08:00
Sameer KankuteandGitHub 71f41352fa Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support 
(Bug)Migrate Anthropic provider to azure ai
 2025-11-28 08:14:14 +05:30
Ishaan JaffandGitHub edfc35ddac [Feature]: Add Provider publicai.co (#17230) 
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
 2025-11-27 13:08:03 -08:00
Sameer Kankute 9669f33b39 fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py 2025-11-27 22:59:29 +05:30
Sameer Kankute 5fc950ec05 migrate anthropic provider to azure ai provider 2025-11-27 19:47:54 +05:30
abbas jafariandGitHub af5f31eb9f Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer Kankute 247160277e Added support for twelvelabs pegasus 2025-11-27 15:46:04 +05:30
Ishaan Jaffer ce60453855 test_gemini_get_complete_url 2025-11-26 14:35:03 -08:00
Ishaan JaffandGitHub d987593855 [Feat] Add audio transcriptions for WatsonX (#17160) 
* feat: add IBMWatsonXAudioTranscriptionConfig

* init IBMWatsonXAudioTranscriptionConfig

* add inits

* test_watsonx_transcription_url_and_headers

* docs watsox audio

* docs watsonx audi

* docs
 2025-11-26 14:15:49 -08:00
Ishaan Jaffer 44e3133827 test_imagen_get_complete_url 2025-11-26 12:26:49 -08:00
abi_jey 98344417ab fix: tested e2e implementation and added sample config. 2025-11-26 12:37:13 +00:00
abbas jafariandGitHub fdee1e2946 Merge branch 'BerriAI:main' into main 2025-11-26 10:22:13 +01:00
Sameer Kankute 86a9b74fc8 Fix Thinking may not be enabled when tool_choice forces tool use 2025-11-26 13:32:13 +05:30
Sameer KankuteandGitHub 67622fb040 Add day 0 support for anthropic new feat (#17091) 
* Added tool search support for anthropic

* Add programtic tool calling support

* Add tool use input examples support

* Add anthropic effort param support

* Add anthropic effort param support

* Add blog for new features

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* Add better handling

* Add better handling
 2025-11-25 11:28:47 -08:00
abi_jey aec0ab777b feat: add GA protocol as litellm_params for realtime api on azure provider 2025-11-25 19:18:41 +00:00
Sameer KankuteandGitHub 3249f6dd2d Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support 
Add vertex ai image gen support for both gemini and imagen models
 2025-11-26 00:04:03 +05:30
Sameer KankuteandGitHub 83a9dcd2d2 Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support 
Added support for azure anthopic models via chat completion
 2025-11-26 00:03:52 +05:30
Sameer KankuteandGitHub e0396e5fa7 Merge pull request #17082 from BerriAI/main 
merge main
 2025-11-25 18:49:52 +05:30
Sameer Kankute e2f2ccd913 Add tests related messages api 2025-11-25 18:45:51 +05:30
Sameer Kankute c149ade6a8 Add tests related to reasoning param none 2025-11-25 13:57:15 +05:30
Sameer Kankute a50083a87b Remove none support from reasoning param 2025-11-25 13:56:30 +05:30
Sameer Kankute 883cfaeeaf Add tests 2025-11-25 13:32:13 +05:30
wcyatandGitHub 6dcb5425a5 fix(vertex): fix CreateCachedContentRequest enum error (#16965) 
* feat: add _fix_enum_types function to remove enums from non-string fields in schema

* test: add test for _fix_enum_types function to validate enum removal from non-string fields
 2025-11-24 21:24:29 -08:00
Cesar GarciaandGitHub 650b18974f fix(gemini): skip thinking config for image models (#17027) 
* fix(gemini): exclude image models from automatic thinking_level parameter (#17013)

- gemini-3-pro-image-preview does not support thinking_level parameter
- Added check to skip adding thinkingConfig for models containing "image"
- Fixes BadRequestError: "Thinking level is not supported for this model"
- Only affects automatic default behavior, user can still pass reasoning_effort explicitly

Fixes #17013

* test: add tests for gemini-3 image models thinking_level exclusion

* update docs
 2025-11-24 20:54:12 -08:00
Sameer KankuteandGitHub 282ac87617 Add temperature support for 5.1 models (#17011) 2025-11-24 18:54:22 -08:00
Sameer KankuteandGitHub 35bfcac3bc Add header forwarding in embedding (#16869) 2025-11-24 18:48:10 -08:00