tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-15 06:23:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,931 Commits 2,072 Branches 1,425 Tags
fb5429bfe7a14c0eb4ae9657e4eb7e00a4ca4250
Commit Graph
4351 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub edfc35ddac [Feature]: Add Provider publicai.co (#17230) 
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
 2025-11-27 13:08:03 -08:00
Ishaan JaffandGitHub 38ddd50628 [Bug fix] Vector Store List Endpoint Returns 404 (#17229) 
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
 2025-11-27 12:51:51 -08:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		d612d71ef4 [Feat] Add guardrails for pass through endpoints (#17221) 
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2025-11-27 12:06:53 -08:00
Ishaan Jaffer 96a0f960a9 test_e2e_batches_files 2025-11-27 09:14:43 -08:00
Ishaan JaffandGitHub 31ecd4ce49 Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer KankuteandGitHub 83c1138067 Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header 
Respect custom llm provider in header
 2025-11-27 22:27:42 +05:30
abbas jafariandGitHub af5f31eb9f Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer KankuteandGitHub 1f6d8fc151 Merge pull request #17079 from naaa760/fix/vertex-batch-support 
fix: support Vertex AI batch listing in LiteLLM proxy
 2025-11-27 16:50:17 +05:30
Sameer Kankute d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
Ishaan Jaffer 772be1778a test_append_system_prompt_messages 2025-11-26 19:00:31 -08:00
Ishaan Jaffer 01fd4d7cef fix fireworks test 2025-11-26 18:58:32 -08:00
Sameer KankuteandGitHub b09c64e4f3 Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking 
Add cost tracking for streaming in vertex ai passthrough
 2025-11-27 08:24:41 +05:30
Krish DholakiaGitHubCursor Agent
 		1cb5fcddba make generic api OSS + support multiple generic API's (#17152) 
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-11-26 18:38:38 -08:00
yuneng-jiangandGitHub ac1827cbfc Merge pull request #17168 from BerriAI/litellm_ui_users_loading 
[Feature] UI - Better Loading State for Internal User Page
 2025-11-26 17:28:40 -08:00
Ishaan Jaffer 0346d1ea23 fix 2025-11-26 17:11:33 -08:00
yuneng-jiang f0e5921bbd Add emoji for exact text match 2025-11-26 17:09:07 -08:00
yuneng-jiang 67f9c6cc08 Adjusting e2e tests for new loading state 2025-11-26 16:47:37 -08:00
Ishaan JaffandGitHub 379655e16b [Feat] LiteLLM RAG API - Add support for Vertex RAG engine (#17117) 
* add VertexAIVectorStoreOptions

* Revert "add VertexAIVectorStoreOptions"

This reverts commit b086adf10b122a72abc7071dce5a7061f456f575.

* add VertexAIVectorStoreOptions

* add get_rag_ingestion_class

* add VertexAIRAGTransformation

* test ingestion

* docs vertex ai rag engine
 2025-11-26 15:49:04 -08:00
Ishaan Jaffer ce60453855 test_gemini_get_complete_url 2025-11-26 14:35:03 -08:00
Sameer KankuteandGitHub b97ea585b2 Add method for extracting vector store ids from path params (#16566) 
* Add method for extracting vector store ids from path params

* Add vector id handling from path

* Move method to utils
 2025-11-26 14:19:30 -08:00
Ishaan JaffandGitHub d987593855 [Feat] Add audio transcriptions for WatsonX (#17160) 
* feat: add IBMWatsonXAudioTranscriptionConfig

* init IBMWatsonXAudioTranscriptionConfig

* add inits

* test_watsonx_transcription_url_and_headers

* docs watsox audio

* docs watsonx audi

* docs
 2025-11-26 14:15:49 -08:00
yuneng-jiangandGitHub 1a9b2d2206 Merge pull request #16560 from BerriAI/litellm_org_usage 
[Feature] Organization Usage
 2025-11-26 13:55:58 -08:00
Ishaan Jaffer 529c56423c test_opentelemetry_integration 2025-11-26 12:28:47 -08:00
Ishaan Jaffer 44e3133827 test_imagen_get_complete_url 2025-11-26 12:26:49 -08:00
yuneng-jiang 046b5fc27b Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-26 12:23:43 -08:00
Ishaan Jaffer 4bf5830106 test fix 2025-11-26 12:07:58 -08:00
Ishaan Jaffer 983ada20c3 mock test fixes 2025-11-26 12:02:35 -08:00
Ishaan Jaffer 2d70aee0c2 test_edit_mcp_server_redacts_credentials 2025-11-26 11:54:11 -08:00
Ishaan Jaffer 50328d15d4 test_process_chunk_with_response_completed_event 2025-11-26 11:52:05 -08:00
Ishaan Jaffer 6530749c89 test fixes 2025-11-26 11:42:12 -08:00
Ishaan Jaffer 85d4000af6 test_vertex_ai_partner_models_token_counting_endpoint 2025-11-26 11:37:55 -08:00
Ishaan Jaffer 19a6693dfc test_create_mcp_server_direct 2025-11-26 11:35:23 -08:00
Sameer KankuteandGitHub d4e80c6132 Merge pull request #17124 from BerriAI/litellm_gemini_file_search 
Add gemini file search support
 2025-11-26 22:07:11 +05:30
Sameer KankuteandGitHub 79c1203377 Merge pull request #17129 from BerriAI/litellm_fix_mcp_responses_anthropic 
Fix Thinking may not be enabled when tool_choice forces tool use
 2025-11-26 22:06:59 +05:30
Sameer KankuteandGitHub 1c317ac316 Merge pull request #17145 from BerriAI/main 
merge main
 2025-11-26 21:48:19 +05:30
abi_jey 98344417ab fix: tested e2e implementation and added sample config. 2025-11-26 12:37:13 +00:00
abbas jafariandGitHub fdee1e2946 Merge branch 'BerriAI:main' into main 2025-11-26 10:22:13 +01:00
Sameer Kankute 86a9b74fc8 Fix Thinking may not be enabled when tool_choice forces tool use 2025-11-26 13:32:13 +05:30
Sameer Kankute 241ad27843 Add gemini file search support 2025-11-26 11:17:30 +05:30
ripepersimmonandGitHub be970735de feat: Add gemini-3-pro-image-preview model support for imageSize parameters (#17019) 
- Add model identifier to FLASH_IMAGE_PREVIEW_MODEL_IDENTIFIERS
- Add imageSize parameter support (1K, 2K, 4K) with GeminiImageSize type
- Add tests for imageSize parameter transformation
- Update documentation with new model
 2025-11-25 19:38:29 -08:00
Igal BoxermanandGitHub e6e1e8fca4 feat(pillar): add automatic LiteLLM context headers (#17076) 
- Automatically pass LiteLLM virtual key context as X-LiteLLM-* headers
- Includes key_alias, user_id, team_id, org_id, and user_email
- No configuration required - always enabled for application/user tracking
- Excludes sensitive data (metadata, API tokens) for security
- Add comprehensive tests (30 tests, all passing)
- Update documentation with header details
 2025-11-25 19:35:39 -08:00
Carlo Alberto FerrarisandGitHub b50fcc4b56 vertex ai: use the correct domain for the global location when counting tokens (#17116) 2025-11-25 19:22:20 -08:00
Sameer KankuteandGitHub cd65a84abd Merge pull request #16844 from Chesars/fix/response-format-to-text-format-bridge-conversion 
fix: Support response_format parameter in completion -> responses bridge
 2025-11-26 08:51:09 +05:30
Ishaan JaffandGitHub 5c192a23c3 [Feat] Add new RAG API on LiteLLM AI Gateway (#17109) 
* init RAG api types

* add RAG endpoints

* init main.py for RAG ingest API

* init RecursiveCharacterTextSplitter

* add BaseRAGIngestion

* fix OpenAIRAGIngestion

* fix img handler

* init OpenAIRAGIngestion

* init BedrockRAGIngestion

* init BedrockRAGIngestion

* init rag tests

* init BedrockVectorStoreOptions

* implement BedrockRAGIngestion

* add BaseRAGAPI

* add endpoint for RAG ingest

* add ingest RAG endpoints

* add test doc

* add parse_rag_ingest_request

* update endpoints

* docs add docs for new RAG API

* fix qa check

* fix linting

* docs ficx

* docs

* add max depth checks

* docs anthropic
 2025-11-25 17:54:29 -08:00
Kerem TurgutluandGitHub 8637d74e17 include server_tool_use in streaming usage (#16826) 
* include server_tool_use in streaming usage

* add test
 2025-11-25 14:50:17 -08:00
Ishaan JaffandGitHub be712908a3 [Feat] Add OpenAI compatible bedrock imported models. - qwen etc (#17097) 
* test_bedrock_openai_imported_model

* AmazonBedrockOpenAIConfig

* add openai route for bedrock

* docs fix

* fix code qa check
 2025-11-25 12:20:39 -08:00
Sameer KankuteandGitHub 67622fb040 Add day 0 support for anthropic new feat (#17091) 
* Added tool search support for anthropic

* Add programtic tool calling support

* Add tool use input examples support

* Add anthropic effort param support

* Add anthropic effort param support

* Add blog for new features

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* Add better handling

* Add better handling
 2025-11-25 11:28:47 -08:00
abi_jey aec0ab777b feat: add GA protocol as litellm_params for realtime api on azure provider 2025-11-25 19:18:41 +00:00
Sameer KankuteandGitHub 3249f6dd2d Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support 
Add vertex ai image gen support for both gemini and imagen models
 2025-11-26 00:04:03 +05:30
Sameer KankuteandGitHub 83a9dcd2d2 Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support 
Added support for azure anthopic models via chat completion
 2025-11-26 00:03:52 +05:30