tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-09 18:25:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,198 Commits 2,072 Branches 1,425 Tags
f2d2ed5a0dbe435f68282f748e331c8904799034
Commit Graph
5805 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 9c5fed4f52 [Feat] LiteLLM Vector Stores - Add permission management for users, teams (#19972) 
* fix: create_vector_store_in_db

* add team/user to LiteLLM_ManagedVectorStore

* add _check_vector_store_access

* add new fields

* test_check_vector_store_access

* add vector_store/list endpoints

* fix code QA checks
 2026-01-28 18:55:40 -08:00
Alexsander HamirandGitHub 69bd4426e8 [Release Day] - Fixed CI/CD issues & changed processes (#19902) 2026-01-28 17:57:24 -08:00
Ishaan JaffGitHubmichelligabrieleCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		d12ce3cd5d [Fix] VertexAI Pass through - fix regression that caused vertex ai passthroughs to stop working for router models (#19967) 
* fix(vertex_ai): replace custom model names with actual Vertex AI model names in passthrough URLs (#19948)

When the passthrough URL already contains project and location, the code
was skipping the deployment lookup and forwarding the URL as-is to Vertex AI.
For custom model names like gcp/google/gemini-2.5-flash, Vertex AI returned
404 because it only knows the actual model name (gemini-2.5-flash).

The fix makes the deployment lookup always run, so the custom model name
gets replaced with the actual Vertex AI model name before forwarding.

* add _resolve_vertex_model_from_router

* fix: get_llm_provider

* Potential fix for code scanning alert no. 4020: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: michelligabriele <gabriele.michelli@icloud.com>
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2026-01-28 16:54:01 -08:00
Alexsander HamirandGitHub 3816570313 fix(presidio): reuse HTTP connections to prevent OOMs (#19964) 2026-01-28 16:08:53 -08:00
yuneng-jiangandGitHub cccda30a9e Merge pull request #19960 from BerriAI/litellm_ui_spend_logs_error_message 
[Feature] Add error_message Search in Spend Logs Endpoint
 2026-01-28 16:04:29 -08:00
yuneng-jiang cb8ead6013 Add error_message search in spend logs endpoint 2026-01-28 15:06:31 -08:00
Ishaan JaffandGitHub 3ef475b70e [Fix] A2a Gateway - Allow supporting old A2a card formats (#19949) 
* fix: LiteLLMA2ACardResolver

* fix: LiteLLMA2ACardResolver

* feat: .well-known/agent.json

* test_card_resolver_fallback_from_new_to_old_path
 2026-01-28 15:02:08 -08:00
Ishaan Jaffer 5135efb60e fix pypdf: >=6.6.2 2026-01-28 14:54:58 -08:00
Alexsander HamirandGitHub 4c1b24eed9 Fix thread leak in OpenTelemetry dynamic header path (#19946) 2026-01-28 10:35:37 -08:00
michelligabrieleandGitHub ea3853e977 fix(vertex_ai): support model names with slashes in passthrough URLs (#19944) 
The regex in get_vertex_model_id_from_url() was using [^/:]+
which stopped at the first slash, truncating model names like
'gcp/google/gemini-2.5-flash' to just 'gcp'. This caused
access_groups checks to fail for custom model names.

Changed the pattern to [^:]+ to allow slashes in model names,
only stopping at the colon before the action (e.g., :generateContent).
 2026-01-28 09:33:53 -08:00
boarder7395andGitHub 8e4f06583a Fix team cli auth flow (#19666) 
* Cleanup code for user cli auth, and make sure not to prompt user for team multiple times while polling

* Adding tests

* Cleanup normalize teams some more
 2026-01-28 08:52:52 -08:00
Sameer KankuteandGitHub 169c9dae79 Merge pull request #19914 from BerriAI/litellm_responses_api_bridge_usage 
Fix: output_tokens_details.reasoning_tokens None
 2026-01-28 18:35:30 +05:30
Sameer KankuteandGitHub 9fe8b12f44 Merge pull request #19924 from BerriAI/litellm_minimax_reasoning_caching_1 
Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi
 2026-01-28 18:04:13 +05:30
Sameer KankuteandGitHub b6c769880e Merge pull request #19842 from BerriAI/litellm_fix_timeout_test_fix 
Fixes Timeouts during chat completion calls no longer reported as timeout in failure callback
 2026-01-28 18:03:21 +05:30
Sameer KankuteandGitHub f5e5569e40 Merge pull request #19636 from BerriAI/litellm_langfuse_callback 
Add litellm_callback_logging_failures_metric for Langfuse, Langfuse Otel and other Otel providers
 2026-01-28 18:02:17 +05:30
Sameer Kankute c5c1fbc5a2 Fix test_calculate_usage_completion_tokens_details_always_populated and logging object test 2026-01-28 18:00:42 +05:30
Sameer KankuteandGitHub 0fadcbb21f Merge pull request #19915 from BerriAI/litellm_x_ai_responses_web 
Add xai websearch params support fo Responses API
 2026-01-28 17:34:28 +05:30
Sameer KankuteandGitHub 7386621d04 Merge pull request #19839 from BerriAI/litellm_oss_staging_01_27_2026 
Litellm oss staging 01 27 2026
 2026-01-28 17:33:27 +05:30
Sameer Kankute f6ead49afe Add Prompt caching and reasoning support for MiniMax, GLM, Xiaomi 2026-01-28 17:25:26 +05:30
Sameer KankuteandGitHub 4f7425df0c Merge pull request #19661 from Chesars/fix/oci-image-url-format 
fix(oci): serialize imageUrl as object for OCI GenAI API
 2026-01-28 15:26:50 +05:30
Sameer KankuteandGitHub 9b44984510 Merge pull request #19899 from xianzongxie-stripe/add_native_background_mode_override 
Add native_background_mode to override polling_via_cache for specific models
 2026-01-28 12:27:19 +05:30
Sameer Kankute bd15ebba84 fix: Pydantic will fail to parse it because cached_tokens is required but not provided 2026-01-28 11:51:26 +05:30
Sameer Kankute 6fb2a0d11f Fix: output_tokens_details.reasoning_tokens None 2026-01-28 11:35:18 +05:30
yuneng-jiang 28ca991296 Allow dynamic setting of store_prompts_in_spend_logs 2026-01-27 20:52:07 -08:00
Sameer Kankute d76fb5932a Add xai websearch params support 2026-01-28 09:54:43 +05:30
Sameer KankuteandGitHub 5276085f3c Merge branch 'litellm_fix_timeout_test_fix' into litellm_merge_timeout_issue 2026-01-28 08:56:29 +05:30
mubashir1osmaniandGitHub 9a245031bd feat(hosted_vllm): support thinking parameter in anthropic_messages() and .completion() 
feat(hosted_vllm): support `thinking` parameter in `anthropic_messages()` and `.completion()`
 2026-01-27 22:13:53 -05:00
Sameer KankuteandGitHub 42a0d576f3 Merge pull request #19910 from BerriAI/main 
merge 01 27
 2026-01-28 08:30:47 +05:30
yuneng-jiangandGitHub 7109aafe4c Merge pull request #19903 from BerriAI/litellm_ui_model_table_adjustable_col 
[Feature] Add sortBy and sortOrder params for /v2/model/info
 2026-01-27 17:16:22 -08:00
yuneng-jiang 1581bcf985 add sortBy and sortOrder params for /v2/model/info 2026-01-27 16:54:52 -08:00
Xianzong Xie f9eea06a37 Add tests for native_background_mode feature 
Added 8 new unit tests for the native_background_mode feature:
- test_polling_disabled_when_model_in_native_background_mode
- test_polling_disabled_for_native_background_mode_with_provider_list
- test_polling_enabled_when_model_not_in_native_background_mode
- test_polling_enabled_when_native_background_mode_is_none
- test_polling_enabled_when_native_background_mode_is_empty_list
- test_native_background_mode_exact_match_required
- test_native_background_mode_with_provider_prefix_in_request
- test_native_background_mode_with_router_lookup

Committed-By-Agent: cursor
 2026-01-27 16:48:22 -08:00
Ishaan JaffandGitHub 51339f5ef1 [Feat] RAG API - Add s3_vectors as provider on /vector_store/search API + UI for creating + PDF support for /rag/ingest (#19895) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION

* init ui for bedrock s3 vectors

* fix add /search support for s3_vectors

* init atransform_search_vector_store_request

* feat: S3VectorsVectorStoreConfig

* TestS3VectorsVectorStoreConfig

* atransform_search_vector_store_request

* fix: S3VectorsVectorStoreConfig

* add validation for bucket name etd

* fix UI validation for s3 vector store

* init extract_text_from_pdf

* add pypdf

* fix code QA checks

* fix navbar

* init s3_vector.png

* fix QA code
 2026-01-27 16:30:59 -08:00
Ishaan JaffandGitHub fe444f3ed5 [Feat] RAG API - Add support for using s3 Vectors as Vector Store Provider for /rag/ingest (#19888) 
* init S3VectorsRAGIngestion as a supported ingestion provider for RAG API

* test: TestRAGS3Vectors

* init S3VectorsVectorStoreOptions

* init s3 vectors

* code clean up + QA

* fix: get_credentials

* S3VectorsRAGIngestion

* TestRAGS3Vectors

* docs: AWS S3 Vectors

* add asyncio QA checks

* fix: S3_VECTORS_DEFAULT_DIMENSION
 2026-01-27 14:45:26 -08:00
michelligabrieleandGitHub 7d5439adda fix(bedrock): support tool search header translation for Sonnet 4.5 (#19871) 
Extend advanced-tool-use header translation to include Claude Sonnet 4.5
in addition to Opus 4.5 on Bedrock Invoke API.

When Claude Code sends the advanced-tool-use-2025-11-20 header, it now
gets correctly translated to Bedrock-specific headers for both:
- Claude Opus 4.5
- Claude Sonnet 4.5

Headers translated:
- tool-search-tool-2025-10-19
- tool-examples-2025-10-29

Fixes defer_loading validation error on Bedrock with Sonnet 4.5.

Ref: https://platform.claude.com/docs/en/agents-and-tools/tool-use/tool-search-tool
 2026-01-27 12:17:09 -08:00
yuneng-jiangandGitHub 45954155d7 Merge pull request #19799 from BerriAI/litellm_sso_email_casing 
[Fix] SSO Email Case Sensitivity
 2026-01-27 09:52:03 -08:00
yuneng-jiangandGitHub 50612715a5 Merge pull request #19814 from BerriAI/litellm_team_member_add_fix 
[Fix] /team/member_add User Email and ID Verifications
 2026-01-27 09:49:01 -08:00
michelligabrieleandGitHub 388b4c90b6 fix(proxy): handle agent parameter in /interactions endpoint (#19866) 2026-01-27 09:34:58 -08:00
michelligabrieleandGitHub fc7a9b4cb0 fix(enterprise): correct error message for DISABLE_ADMIN_ENDPOINTS (#19861) 
The error message for DISABLE_ADMIN_ENDPOINTS incorrectly said
"DISABLING LLM API ENDPOINTS is an Enterprise feature" instead of
"DISABLING ADMIN ENDPOINTS is an Enterprise feature".

This was a copy-paste bug from the is_llm_api_route_disabled() function.

Added regression tests to verify both error messages are correct.
 2026-01-27 09:34:30 -08:00
Harshit JainandGitHub 0f0b71e6d9 feat: add feature to make silent calls (#19544) 
* feat: add feature to make silent calls

* add test or silent feat

* add docs for silent feat

* fix lint issues and  UI logs

* add docs of ab testing and deep copy
 2026-01-27 09:16:53 -08:00
Sameer KankuteandGitHub 5c1588e3b7 Merge pull request #19841 from BerriAI/litellm_bedrock_tool_search_header 
Translate advanced-tool-use to Bedrock-specific headers for Claude Opus 4.5
 2026-01-27 17:48:51 +05:30
Sameer KankuteandGitHub 8565a9f5a2 Merge pull request #19847 from BerriAI/litellm_image_streaming_download 
Fix: Stream the download in chunks for image handling
 2026-01-27 17:47:35 +05:30
Sameer KankuteandGitHub 29fc4f8f61 Merge pull request #19850 from BerriAI/litellm_grok_reasonnig_support 
Add grok reasoning content
 2026-01-27 17:46:07 +05:30
Sameer KankuteandGitHub c834d7d1fe Merge branch 'main' into litellm_oss_staging_01_27_2026 2026-01-27 17:11:15 +05:30
Sameer KankuteandGitHub 0214cb04cd Merge branch 'main' into litellm_oss_staging_01_26_2026 2026-01-27 17:00:58 +05:30
Sameer KankuteandGitHub adf6d7e1db Merge pull request #19692 from BerriAI/litellm_oss_staging_01_24_2026 
Litellm oss staging 01 24 2026
 2026-01-27 16:59:28 +05:30
Sameer KankuteandGitHub 9a2750f8ec Merge pull request #19617 from BerriAI/litellm_oss_staging_01_23_2026 
Litellm oss staging 01 23 2026
 2026-01-27 16:55:32 +05:30
Sameer Kankute e695cb5367 Add grok reasoning content 2026-01-27 16:34:57 +05:30
Sameer Kankute 988dd2a911 Fix: Stream the download in chunks 2026-01-27 14:35:54 +05:30
Sameer KankuteandGitHub 13313ac2be Merge pull request #19232 from natimofeev/fix-gigachat-function-output-format 
Fix: ensure function content is valid JSON for GigaChat
 2026-01-27 13:02:38 +05:30
Sameer KankuteandGitHub f98eba24d4 Merge pull request #19040 from Point72/ephrimstanley/batch-list 
Fix /batches to return encoded ids (from managed objects table)
 2026-01-27 13:02:05 +05:30