tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-16 10:23:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,169 Commits 2,072 Branches 1,425 Tags
5135efb60ec8c2c2c77f30982cdaefd32cbbdd0f
Commit Graph
5798 Commits
Author SHA1 Message Date
Ishaan Jaffer 5135efb60e fix pypdf: >=6.6.2 2026-01-28 14:54:58 -08:00
Alexsander HamirandGitHub 4c1b24eed9 Fix thread leak in OpenTelemetry dynamic header path (#19946) 2026-01-28 10:35:37 -08:00
michelligabrieleandGitHub ea3853e977 fix(vertex_ai): support model names with slashes in passthrough URLs (#19944) 
The regex in get_vertex_model_id_from_url() was using [^/:]+
which stopped at the first slash, truncating model names like
'gcp/google/gemini-2.5-flash' to just 'gcp'. This caused
access_groups checks to fail for custom model names.

Changed the pattern to [^:]+ to allow slashes in model names,
only stopping at the colon before the action (e.g., :generateContent).
 2026-01-28 09:33:53 -08:00
boarder7395andGitHub 8e4f06583a Fix team cli auth flow (#19666) 
* Cleanup code for user cli auth, and make sure not to prompt user for team multiple times while polling

* Adding tests

* Cleanup normalize teams some more
 2026-01-28 08:52:52 -08:00
Sameer KankuteandGitHub 169c9dae79 Merge pull request #19914 from BerriAI/litellm_responses_api_bridge_usage 
Fix: output_tokens_details.reasoning_tokens None
 2026-01-28 18:35:30 +05:30
Sameer KankuteandGitHub 9fe8b12f44 Merge pull request #19924 from BerriAI/litellm_minimax_reasoning_caching_1 
Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi
 2026-01-28 18:04:13 +05:30
Sameer KankuteandGitHub b6c769880e Merge pull request #19842 from BerriAI/litellm_fix_timeout_test_fix 
Fixes Timeouts during chat completion calls no longer reported as timeout in failure callback
 2026-01-28 18:03:21 +05:30
Sameer KankuteandGitHub f5e5569e40 Merge pull request #19636 from BerriAI/litellm_langfuse_callback 
Add litellm_callback_logging_failures_metric for Langfuse, Langfuse Otel and other Otel providers
 2026-01-28 18:02:17 +05:30
Sameer Kankute c5c1fbc5a2 Fix test_calculate_usage_completion_tokens_details_always_populated and logging object test 2026-01-28 18:00:42 +05:30
Sameer KankuteandGitHub 0fadcbb21f Merge pull request #19915 from BerriAI/litellm_x_ai_responses_web 
Add xai websearch params support fo Responses API
 2026-01-28 17:34:28 +05:30
Sameer KankuteandGitHub 7386621d04 Merge pull request #19839 from BerriAI/litellm_oss_staging_01_27_2026 
Litellm oss staging 01 27 2026
 2026-01-28 17:33:27 +05:30
Sameer Kankute f6ead49afe Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi 2026-01-28 17:25:26 +05:30
Sameer KankuteandGitHub 4f7425df0c Merge pull request #19661 from Chesars/fix/oci-image-url-format 
fix(oci): serialize imageUrl as object for OCI GenAI API
 2026-01-28 15:26:50 +05:30
Sameer KankuteandGitHub 9b44984510 Merge pull request #19899 from xianzongxie-stripe/add_native_background_mode_override 
Add native_background_mode to override polling_via_cache for specific models
 2026-01-28 12:27:19 +05:30
Sameer Kankute bd15ebba84 fix: Pydantic will fail to parse it because cached_tokens is required but not provided 2026-01-28 11:51:26 +05:30
Sameer Kankute 6fb2a0d11f Fix: output_tokens_details.reasoning_tokens None 2026-01-28 11:35:18 +05:30
yuneng-jiang 28ca991296 Allow dynamic setting of store_prompts_in_spend_logs 2026-01-27 20:52:07 -08:00
Sameer Kankute d76fb5932a Add xai websearch params support 2026-01-28 09:54:43 +05:30
Sameer KankuteandGitHub 5276085f3c Merge branch 'litellm_fix_timeout_test_fix' into litellm_merge_timeout_issue 2026-01-28 08:56:29 +05:30
mubashir1osmaniandGitHub 9a245031bd feat(hosted_vllm): support thinking parameter in anthropic_messages() and .completion() 
feat(hosted_vllm): support `thinking` parameter in `anthropic_messages()` and `.completion()`
 2026-01-27 22:13:53 -05:00
Sameer KankuteandGitHub 42a0d576f3 Merge pull request #19910 from BerriAI/main 
merge 01 27
 2026-01-28 08:30:47 +05:30
yuneng-jiangandGitHub 7109aafe4c Merge pull request #19903 from BerriAI/litellm_ui_model_table_adjustable_col 
[Feature] Add sortBy and sortOrder params for /v2/model/info
 2026-01-27 17:16:22 -08:00
yuneng-jiang 1581bcf985 add sortBy and sortOrder params for /v2/model/info 2026-01-27 16:54:52 -08:00
Xianzong Xie f9eea06a37 Add tests for native_background_mode feature 
Added 8 new unit tests for the native_background_mode feature:
- test_polling_disabled_when_model_in_native_background_mode
- test_polling_disabled_for_native_background_mode_with_provider_list
- test_polling_enabled_when_model_not_in_native_background_mode
- test_polling_enabled_when_native_background_mode_is_none
- test_polling_enabled_when_native_background_mode_is_empty_list
- test_native_background_mode_exact_match_required
- test_native_background_mode_with_provider_prefix_in_request
- test_native_background_mode_with_router_lookup

Committed-By-Agent: cursor
 2026-01-27 16:48:22 -08:00
Ishaan JaffandGitHub 51339f5ef1 [Feat] RAG API - Add s3_vectors as provider on /vector_store/search API + UI for creating + PDF support for /rag/ingest (#19895) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION

* init ui for bedrock s3 vectors

* fix add /search support for s3_vectors

* init atransform_search_vector_store_request

* feat: S3VectorsVectorStoreConfig

* TestS3VectorsVectorStoreConfig

* atransform_search_vector_store_request

* fix: S3VectorsVectorStoreConfig

* add validation for bucket name etd

* fix UI validation for s3 vector store

* init extract_text_from_pdf

* add pypdf

* fix code QA checks

* fix navbar

* init s3_vector.png

* fix QA code
 2026-01-27 16:30:59 -08:00
Ishaan JaffandGitHub fe444f3ed5 [Feat] RAG API - Add support for using s3 Vectors as Vector Store Provider for /rag/ingest (#19888) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION
 2026-01-27 14:45:26 -08:00
michelligabrieleandGitHub 7d5439adda fix(bedrock): support tool search header translation for Sonnet 4.5 (#19871) 
Extend advanced-tool-use header translation to include Claude Sonnet 4.5
in addition to Opus 4.5 on Bedrock Invoke API.

When Claude Code sends the advanced-tool-use-2025-11-20 header, it now
gets correctly translated to Bedrock-specific headers for both:
- Claude Opus 4.5
- Claude Sonnet 4.5

Headers translated:
- tool-search-tool-2025-10-19
- tool-examples-2025-10-29

Fixes defer_loading validation error on Bedrock with Sonnet 4.5.

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool
 2026-01-27 12:17:09 -08:00
yuneng-jiangandGitHub 45954155d7 Merge pull request #19799 from BerriAI/litellm_sso_email_casing 
[Fix] SSO Email Case Sensitivity
 2026-01-27 09:52:03 -08:00
yuneng-jiangandGitHub 50612715a5 Merge pull request #19814 from BerriAI/litellm_team_member_add_fix 
[Fix] /team/member_add User Email and ID Verifications
 2026-01-27 09:49:01 -08:00
michelligabrieleandGitHub 388b4c90b6 fix(proxy): handle agent parameter in /interactions endpoint (#19866) 2026-01-27 09:34:58 -08:00
michelligabrieleandGitHub fc7a9b4cb0 fix(enterprise): correct error message for DISABLE_ADMIN_ENDPOINTS (#19861) 
The error message for DISABLE_ADMIN_ENDPOINTS incorrectly said
"DISABLING LLM API ENDPOINTS is an Enterprise feature" instead of
"DISABLING ADMIN ENDPOINTS is an Enterprise feature".

This was a copy-paste bug from the is_llm_api_route_disabled() function.

Added regression tests to verify both error messages are correct.
 2026-01-27 09:34:30 -08:00
Harshit JainandGitHub 0f0b71e6d9 feat: add feature to make silent calls (#19544) 
* feat: add feature to make silent calls

* add test or silent feat

* add docs for silent feat

* fix lint issues and  UI logs

* add docs of ab testing and deep copy
 2026-01-27 09:16:53 -08:00
Sameer KankuteandGitHub 5c1588e3b7 Merge pull request #19841 from BerriAI/litellm_bedrock_tool_search_header 
Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5
 2026-01-27 17:48:51 +05:30
Sameer KankuteandGitHub 8565a9f5a2 Merge pull request #19847 from BerriAI/litellm_image_streaming_download 
Fix: Stream the download in chunks for image handling
 2026-01-27 17:47:35 +05:30
Sameer KankuteandGitHub 29fc4f8f61 Merge pull request #19850 from BerriAI/litellm_grok_reasonnig_support 
Add grok reasoning content
 2026-01-27 17:46:07 +05:30
Sameer KankuteandGitHub c834d7d1fe Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer KankuteandGitHub 0214cb04cd Merge branch 'main' into litellm_oss_staging_01_26_2026 2026-01-27 17:00:58 +05:30
Sameer KankuteandGitHub adf6d7e1db Merge pull request #19692 from BerriAI/litellm_oss_staging_01_24_2026 
Litellm oss staging 01 24 2026
 2026-01-27 16:59:28 +05:30
Sameer KankuteandGitHub 9a2750f8ec Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026 
Litellm oss staging 01 23 2026
 2026-01-27 16:55:32 +05:30
Sameer Kankute e695cb5367 Add grok reasoning content 2026-01-27 16:34:57 +05:30
Sameer Kankute 988dd2a911 Fix: Stream the download in chunks 2026-01-27 14:35:54 +05:30
Sameer KankuteandGitHub 13313ac2be Merge pull request #19232 from natimofeev/fix-gigachat-function-output-format 
Fix: ensure function content is valid JSON for GigaChat
 2026-01-27 13:02:38 +05:30
Sameer KankuteandGitHub f98eba24d4 Merge pull request #19040 from Point72/ephrimstanley/batch-list 
Fix /batches to return encoded ids (from managed objects table)
 2026-01-27 13:02:05 +05:30
Sameer Kankute 9883c2fd64 Fix: timeout exception raised eror 2026-01-27 12:32:37 +05:30
Harshit JainandGitHub fd2f148161 fix: resolve 'does not exist' migration errors as applied in setup_database (#19281) 2026-01-26 22:11:36 -08:00
Harshit JainandGitHub 885a02e6c8 fix: token calculations and refactor (#19696) 2026-01-26 22:08:17 -08:00
Sameer Kankute 3f32562587 Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5 2026-01-27 11:20:16 +05:30
Cesar GarciaandGitHub 16f456ad82 fix(azure): use generic cost calculator for audio token pricing (#19771) 
Azure audio models were charging audio output tokens at the text token
rate instead of the correct audio token rate. This resulted in costs
being ~6.65x lower than expected.

The fix replaces Azure's custom cost calculation logic with the generic
cost calculator that properly handles text, audio, cached, reasoning,
and image tokens.

Fixes #19764
 2026-01-26 21:00:03 -08:00
Cesar GarciaandGitHub b1968a8e33 fix(responses): update local_vars with detected provider (#19782) (#19798) 
When using the responses API with provider-specific params (aws_*, vertex_*)
without explicitly passing custom_llm_provider, the code crashed with:
AttributeError: 'NoneType' object has no attribute 'startswith'

Root cause: local_vars was captured via locals() before get_llm_provider()
detected the provider from the model string (e.g., "bedrock/..."), so
custom_llm_provider remained None when processing provider-specific params.

Fix: Update local_vars["custom_llm_provider"] after get_llm_provider() call
so the detected provider is available for param processing.

Affected provider-specific params:
- aws_* (aws_region_name, aws_access_key_id, etc.) for Bedrock/SageMaker
- vertex_* (vertex_project, vertex_location, etc.) for Vertex AI
 2026-01-26 20:47:35 -08:00
Krish DholakiaGitHubCursor Agent
 		6a54dcfa93 feat: Add model_id label to Prometheus metrics (#18048) (#19678) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-01-26 20:32:08 -08:00