tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-06 22:22:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,994 Commits 2,072 Branches 1,425 Tags
ce0dc0c8b91f50ce6ec08e829604abe87f1cebdf
Commit Graph
4376 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub ce0dc0c8b9 [Feat] WatsonX - allow passing zen_api_key dynamically (#16655) 
* test_watsonx_zen_api_key_from_client

* zen api key

* docs using zen api key
 2025-12-01 12:55:47 -08:00
orgersh92andGitHub 7808a610f8 Fix session consistency, move Lasso API version away from source code (#17316) 
* store and fetch lasso-conversation id from cache

* include gateway/v# in the baseUrl to allow simpler version migrations in the future

* add tests for cached conversation ID
 2025-12-01 10:03:51 -08:00
YutaSaitoandGitHub 6de6107673 fix: respect guardrail mock_response during during_call to return blocked output (#17247) 2025-12-01 09:59:01 -08:00
Sameer KankuteandGitHub 353c779c34 Merge pull request #17301 from BerriAI/litellm_claude_code_beta_fix 
Remove not compatible beta header from Bedrock
 2025-12-01 21:39:37 +05:30
Sameer Kankute 983ba7aa0f Remove not compatible beta header from claude code 2025-12-01 17:22:04 +05:30
Sameer Kankute 7dac498efb Add passthrough cost tracking for veo 2025-12-01 14:33:03 +05:30
Sameer KankuteandGitHub 7f42b9b987 Merge pull request #17193 from BerriAI/litellm_twelvelabs_int 
Added support for twelvelabs pegasus
 2025-11-28 22:09:00 +05:30
hxomerandGitHub b85df0b1fb Better handle anonymization (#17207) 
* Better handle anonymization

* Fix tests
 2025-11-28 08:22:19 -08:00
Sameer Kankute 9d058398df Fix pegasus response and add doc 2025-11-28 21:41:25 +05:30
Sameer KankuteandGitHub bcc35a6069 Merge pull request #17253 from BerriAI/litellm_nova_embedding_support 
Add nova embedding support
 2025-11-28 21:16:06 +05:30
Sameer KankuteandGitHub bb11c4fb3f Merge pull request #17258 from BerriAI/litellm_add_tags_in_ui 
Fix metadata tags and model name display in UI for Azure passthrough + Add cost tracking for responses API
 2025-11-28 21:15:39 +05:30
Sameer KankuteandGitHub 6c326ceb87 Merge pull request #17142 from BerriAI/litellm_anthropic_update_new_feat 
Update new anthropic feats as reviewed
 2025-11-28 21:06:34 +05:30
Sameer Kankute f0d3c96a8d Add tags and other field in UI logs and add responses api cost tracking 2025-11-28 17:23:15 +05:30
Sameer Kankute 8700c5ced6 Add nova embedding support 2025-11-28 14:56:46 +05:30
v0rtex20kandGitHub 205a563b65 Allow wildcard routes for nonproxy admin (SCIM) (#17178) 
* checked for wildcards in nonproxy

* ready
 2025-11-27 22:10:19 -08:00
Andy ForestandGitHub 8aa4f3d476 fix(bedrock): handle cohere v4 embed response dictionary format (#17220) 2025-11-27 21:50:35 -08:00
Saar wintrovandGitHub 87050c6a02 SSO: fix the generic SSO provider (#17227) 
* SSO: fix the generic SSO provider

* adding tests
 2025-11-27 21:27:23 -08:00
YutaSaitoandGitHub 334d09b3b2 feat: add regex-based tool_name/tool_type matching for tool-permission (#17164) 
* feat: add regex-based tool_name/tool_type matching for tool-permission

* docs: update tool permission quick start for UI workflow
 2025-11-27 21:26:27 -08:00
Wei-Chiet KuGitHubKu Wei Chiet
 		d43c077653 Fix/issue 16759 streaming error validation (#17242) 
* Enhance error handling in OpenAIResponsesAPIConfig to coalesce null error codes into a default string, preventing validation errors and improving stability during streaming iterations.

* Add test for coalescing null error codes in streaming responses

This test ensures that when a streaming error event has error.code set to None, the system correctly transforms it to 'unknown_error' and returns an ErrorEvent instance without raising a ValidationError.

---------

Co-authored-by: Ku Wei Chiet <chietkuw@fpt.com>
 2025-11-27 21:24:04 -08:00
Sameer KankuteandGitHub 71f41352fa Merge pull request #17202 from BerriAI/litellm_azure_ai_anthropic_support 
(Bug)Migrate Anthropic provider to azure ai
 2025-11-28 08:14:14 +05:30
yuneng-jiang a33a2cb5b5 Adding timeout to flaky test 2025-11-27 17:53:09 -08:00
Ishaan JaffandGitHub edfc35ddac [Feature]: Add Provider publicai.co (#17230) 
* init PublicAIChatConfig

* add publicai

* init public ai

* add publicai

* add publicai/swiss-ai models etc
 2025-11-27 13:08:03 -08:00
Ishaan JaffandGitHub 38ddd50628 [Bug fix] Vector Store List Endpoint Returns 404 (#17229) 
* fix vector store management

* fix: add vector_store_management_router

* TestVectorStoreManagementEndpointsExist

* fix pass_through
 2025-11-27 12:51:51 -08:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		d612d71ef4 [Feat] Add guardrails for pass through endpoints (#17221) 
* add PassThroughGuardrailsConfig

* init JsonPathExtractor

* feat PassthroughGuardrailHandler

* feat pt guardrails

* pt guardrails

* add Pass-Through Endpoint Guardrail Translation

* add PassThroughEndpointHandler

* execute simple guardrail config and dict settings

* TestPassthroughGuardrailHandlerNormalizeConfig

* add passthrough_guardrails_config on litellm logging obj

* add LiteLLMLoggingObj to base trasaltino

* cleaner _get_guardrail_settings

* update guardrails settings

* docs pt guardrail

* docs Guardrails on Pass-Through Endpoints

* fix typing

* fix typing

* test_no_fields_set_sends_full_body

* fix typing

* Potential fix for code scanning alert no. 3834: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2025-11-27 12:06:53 -08:00
Sameer Kankute 9669f33b39 fix tests/test_litellm/llms/azure_ai/claude/test_azure_anthropic_handler.py 2025-11-27 22:59:29 +05:30
Sameer Kankute cf6dda5e29 block input_examples in fucntion definition for non anthropic providers 2025-11-27 22:46:28 +05:30
Ishaan Jaffer 96a0f960a9 test_e2e_batches_files 2025-11-27 09:14:43 -08:00
Ishaan JaffandGitHub 31ecd4ce49 Revert "Respect custom llm provider in header" (#17211) 2025-11-27 09:12:44 -08:00
Sameer KankuteandGitHub 83c1138067 Merge pull request #17195 from BerriAI/litellm_respect_custom_llm_header 
Respect custom llm provider in header
 2025-11-27 22:27:42 +05:30
Sameer Kankute 5fc950ec05 migrate anthropic provider to azure ai provider 2025-11-27 19:47:54 +05:30
abbas jafariandGitHub af5f31eb9f Merge branch 'BerriAI:main' into main 2025-11-27 14:46:15 +01:00
Sameer KankuteandGitHub 1f6d8fc151 Merge pull request #17079 from naaa760/fix/vertex-batch-support 
fix: support Vertex AI batch listing in LiteLLM proxy
 2025-11-27 16:50:17 +05:30
Sameer Kankute d4bc1cf23d Respect custom llm provider in header 2025-11-27 16:38:37 +05:30
Sameer Kankute 247160277e Added support for twelvelabs pegasus 2025-11-27 15:46:04 +05:30
Ishaan Jaffer 772be1778a test_append_system_prompt_messages 2025-11-26 19:00:31 -08:00
Ishaan Jaffer 01fd4d7cef fix fireworks test 2025-11-26 18:58:32 -08:00
Sameer KankuteandGitHub b09c64e4f3 Merge pull request #16874 from BerriAI/litellm_vertex_ai_anthopic_cost_tracking 
Add cost tracking for streaming in vertex ai passthrough
 2025-11-27 08:24:41 +05:30
Krish DholakiaGitHubCursor Agent
 		1cb5fcddba make generic api OSS + support multiple generic API's (#17152) 
* feat(generic_api_callback.py): make generic api OSS + support multiple generic API's

Enables https://github.com/BerriAI/litellm/pull/17094#discussion_r2562832967

* feat(callback_utils.py): support custom generic api callbacks

* feat(generic_api_callback.py): support specifying which event types to run the generic api for

* fix(litellm_logging.py): log system prompt for anthropic messages

* feat(generic_api_callback.py): support generic api compatible api's - e.g. rubrik agent cloud

* docs(sidebars.js): document new OSS generic api

* docs(generic_api.md): document new OSS Generic API

* docs(custom_webhook_api.md): document custom webhook api integration tutorial

* docs(custom_webhook_api.md): cleanup

* docs(custom_webhook_api.md): document what get's logged to custom webhook api

* Refactor: Pass callback config to GenericAPILogger

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Fix: Handle empty messages list in logging payload

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Checkpoint before follow-up message

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* feat: Cache GenericAPILogger instances to improve performance

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-11-26 18:38:38 -08:00
yuneng-jiangandGitHub ac1827cbfc Merge pull request #17168 from BerriAI/litellm_ui_users_loading 
[Feature] UI - Better Loading State for Internal User Page
 2025-11-26 17:28:40 -08:00
Ishaan Jaffer 0346d1ea23 fix 2025-11-26 17:11:33 -08:00
yuneng-jiang f0e5921bbd Add emoji for exact text match 2025-11-26 17:09:07 -08:00
yuneng-jiang 67f9c6cc08 Adjusting e2e tests for new loading state 2025-11-26 16:47:37 -08:00
Ishaan JaffandGitHub 379655e16b [Feat] LiteLLM RAG API - Add support for Vertex RAG engine (#17117) 
* add VertexAIVectorStoreOptions

* Revert "add VertexAIVectorStoreOptions"

This reverts commit b086adf10b122a72abc7071dce5a7061f456f575.

* add VertexAIVectorStoreOptions

* add get_rag_ingestion_class

* add VertexAIRAGTransformation

* test ingestion

* docs vertex ai rag engine
 2025-11-26 15:49:04 -08:00
Ishaan Jaffer ce60453855 test_gemini_get_complete_url 2025-11-26 14:35:03 -08:00
Sameer KankuteandGitHub b97ea585b2 Add method for extracting vector store ids from path params (#16566) 
* Add method for extracting vector store ids from path params

* Add vector id handling from path

* Move method to utils
 2025-11-26 14:19:30 -08:00
Ishaan JaffandGitHub d987593855 [Feat] Add audio transcriptions for WatsonX (#17160) 
* feat: add IBMWatsonXAudioTranscriptionConfig

* init IBMWatsonXAudioTranscriptionConfig

* add inits

* test_watsonx_transcription_url_and_headers

* docs watsox audio

* docs watsonx audi

* docs
 2025-11-26 14:15:49 -08:00
yuneng-jiangandGitHub 1a9b2d2206 Merge pull request #16560 from BerriAI/litellm_org_usage 
[Feature] Organization Usage
 2025-11-26 13:55:58 -08:00
Ishaan Jaffer 529c56423c test_opentelemetry_integration 2025-11-26 12:28:47 -08:00
Ishaan Jaffer 44e3133827 test_imagen_get_complete_url 2025-11-26 12:26:49 -08:00
yuneng-jiang 046b5fc27b Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-26 12:23:43 -08:00