f7e1a22947
[Feat] New Model - amazon.nova-2-pro-preview-20251202-v1:0 ( #20033 )
...
* init: amazon.nova-2-pro-preview-20251202-v1:0
* init: nova amazon.nova-2-pro
* add s3_vectors
2026-01-29 16:55:55 -08:00
ad1edd38d5
Merge branch 'main' into litellm_staging_01_21_2026
2026-01-22 17:56:40 +05:30
4106d24215
feat: add GMI Cloud provider support ( #19376 )
...
* feat: add GMI Cloud provider support
Add GMI Cloud as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 16 models (Claude, GPT, DeepSeek, Gemini, etc.)
- Sidebar entry for docs navigation
* Add gmi_cloud to provider_endpoints_support.json
Add provider entry to pass CI validation check that ensures all
providers in openai_like/providers.json are documented.
* Fix provider key: gmi_cloud -> gmi
Match the provider key with providers.json
---------
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
2026-01-21 15:48:15 -08:00
751786aab9
fix ./tests/code_coverage_tests/check_provider_folders_documented.py
2026-01-21 18:54:32 +05:30
09941dd1d1
add search provider for brave search api ( #19433 )
...
* add search provider for brave search api
Introduces a minimal implementation of the Brave Search API as a search provider. Additionally, this PR introduces a test file to ensure the provider works properly, and numerous other smaller changes (e.g., changes to docs to mention the new option).
* Update transformation.py
2026-01-20 19:23:29 -08:00
29adf34313
Add ChatGPT subscription support and responses bridge ( #19030 )
...
* Add ChatGPT subscription support and responses bridge
* Fix typing import for responses bridge
* Guard device code timestamp parsing
* add /v1/messages endpoint to chatgpt model
2026-01-19 05:37:45 -08:00
c0cf8bc27d
[Feat] Manus FILES API - Add File upload, get, delete, list ( #18904 )
...
* add MANUS get response
* init TwoStepFileUploadRequest
* init TwoStepFileUploadConfig
* add async_create_file to handle 2 step uploads
* init ManusFilesConfig
* add add get_provider_files_config MANUS
* fix validate_environment
* test_manus_files_api_e2e_all_methods
* aws fix base
* init files API MANUS
* test_manus_responses_api_with_file_upload
* mypy lint fixes
* fix BedrockFilesConfig
* manus docs
* docs manus
* mypy lint
* add add fix resposne api utils MANUS
2026-01-10 13:27:54 -08:00
844c766c65
Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026
...
Staging - 01/07/2026
2026-01-09 17:01:58 +05:30
b482d336b3
[Feat] New provider - Manus API on /responses, GET /responses ( #18804 )
...
* init ManusResponsesAPIConfig
* init MANUS ApI
* init MANUS create responses
* init MANUS
* test_extract_agent_profile
* transform_get_response_api_request
* test fix
* fixes non stream
* fix streaming
* add MANUSConfig
* test_multiturn_responses_api
* code QA check
* add manus
* Potential fix for code scanning alert no. 3961: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-01-08 18:37:42 +05:30
bae625bdc6
OpenRouter embeddings API support ( #18391 )
...
* support for OpenRouter embeddings
* add bearer
* add content header
2026-01-08 00:57:31 +05:30
929af510fa
[Feat] New provider - Add Azure BFL FLux for image edits ( #18766 )
...
* add azure_ai/flux.2-pro
* get_flux2_image_generation_url
* azure_client_params
* docs
* add Image Editing
* add azure ai image edits
* AzureFoundryFlux2ImageEditConfig
* TestAzureAIFlux2ImageEdit
2026-01-07 23:28:39 +05:30
dc4ce7c5a2
feat: Add abliteration.ai provider ( #18678 )
...
* feat: Add abliteration.ai provider
* adding signoz integration to observability docs
* Fixing build
* Adding timeout for flaky test
* Fixing e2e
* add team member budget duration in team/update
* Reusable Duration Select and update team member budget UI
---------
Co-authored-by: Goutham Karthi <goutham@signoz.io >
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com >
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com >
2026-01-07 21:46:54 +05:30
80ead21c3a
Litellm improve endpoint discovery ( #18762 )
...
* docs: document all endpoints in .json and add consistency checks against docs + providers.json
* docs: add more tests + improve coverage
2026-01-07 17:35:01 +05:30
1f141f0dbb
[Feat] Litellm new endpoint add container file upload ( #18743 )
...
* init upload_container_file
* init upload_container_file
* _prepare_multipart_file_upload
* fix upload_container_file
* aupload_container_file, upload_container_file
* register_container_file_endpoints
2026-01-07 13:36:55 +05:30
76eda472be
[Feat] New API Endpoint - Responses API (v1/responses/compact) ( #18697 )
...
* init transform_compact_response_api_request
* init acompact_responses
* init async_compact_response_api_handler in llm http handler
* init transform_compact_response_api_request for openai
* init acompact_responses
* fix acompact_responses
* add OAI Compact API
* docs responses API Compact
* code qa checks
* test_openai_compact_responses_api
* fix mypy linting
2026-01-06 16:24:04 +05:30
0f63cbea59
[Feat] Interactions API - allow using all litellm providers (interactions -> responses api bridge) ( #18373 )
...
* add BaseInteractionsTest
* add interactions_api_handler
* init bridge
* init LiteLLMResponsesInteractionsConfig
* LiteLLMResponsesInteractionsHandler
* mv test
* fixes api spec
* docs
* fix transform+iterators
* docs fix
* fix iterator
2025-12-23 22:30:22 +05:30
69897bea48
Add 5 AI providers using openai_like ( #18362 )
...
* Add 5 AI providers using `openai_like`:
* Synthetic.new
* Apertis / Stima.tech
* NanoGPT
* Poe
* Chutes.ai
* Update additional missing locations
2025-12-23 15:35:54 +05:30
2677d9d30d
[Feat] New provider TTS - Add AWS polly API for TTS ( #18326 )
...
* add aws_polly as new provider
* init AWSPollyTextToSpeechConfig
* test_aws_polly_tts_with_native_voice
* init aws_polly + AWS polly dispatch
* init AWSPollyTextToSpeechConfig
* fix transform
* add aws_polly as a new provider for TTS API
* add to sidebar
* docs aws polly
* code qa fix
* add AWS Polly Text-to-Speech
* add cost tracking for AWS polly
* docs fix
2025-12-22 18:19:34 +05:30
01a517a2c6
v 1.80.11
2025-12-20 23:48:10 +05:30
afba676b2e
Add Amazon Nova to sidebar and under supported models in README ( #18220 )
2025-12-19 19:07:34 +05:30
274d996a87
[Feat] New Search API Provider - LinkUp Search ( #18174 )
...
* add linkup search provider
* add Linkup Search docs
* add get_provider_search_config
* get_provider_search_config
* add linkup/search provider
* fix mypy linting
2025-12-18 14:27:36 +05:30
0052953fc9
docs init
2025-12-17 02:27:54 +04:00
244d83ff47
[Docs] Litellm add docs vertex ai engine ( #18027 )
...
* new provider doc
* add to sidebar
* stash docs
* docs fix
* docs vertex agent engine
2025-12-15 20:11:40 -08:00
ce113f4e4b
[Docs] Add docs on using pydantic ai agents with LiteLLM A2a gateway ( #18026 )
...
* init A2AProviderConfigManager
* move file
* move file
* add pydnatic ai folder
* init providers
* test_pydantic_ai_non_streaming
* fix import
* INIT pydantic
* use_a2a_form_fields
* test_vertex_agent_engine_streaming
* add agent_engine
* init transform for agent engine
* init agent engine
* VertexAgentEngineSSEStreamIterator
* sample
* ui add new fields
* fix vertex_credentials
* working SSE iterator
* TestVertexAgentEngineTransformRequest
* fix code QA check
* stash docs
* docs fix
* fix logo
* docs fix
* doc pydantic ai
* docs pydantic ai
* new provider
* docs fix
2025-12-15 19:43:12 -08:00
c79e0c165f
add vllm batches
2025-12-14 12:36:07 -08:00
2641f58be5
Litellm 1 80 10 ( #17945 )
...
* update providers
* v0
* docs fix
* docs fix
* docs fix
2025-12-13 17:19:58 -08:00
cca21c0926
[Feat] New API Provider - Add Azure AI Foundry Agents on /chat/completions, /responses, /messages + Agent Gateway ( #17845 )
...
* init get_azure_ai_route
* init AzureAIAgentsConfig
* init AzureAIAgentsConfig
* AzureAIAgentsHandler
* test_azure_ai_agents_acompletion_non_streaming
* test_azure_ai_agents_acompletion_streaming
* fix stream
* _process_sse_stream
* Azure AI Foundry Agents
* init Azure AI Foundry Agent
* fix code QA checks
* fix api key
* docs fix
2025-12-11 15:21:28 -08:00
5ee32167c0
[Feat] New Provider - add langgraph ( #17783 )
...
* init LANGGRAPH
* init LangGraphConfig
* init LangGraphConfig types
* init langgraph
* init getting api base and key
* init transform langgraph
* fix SSE issues
* test_langgraph_acompletion_non_streaming
* add LangGraph to docs
* docs: Setting Up a Local LangGraph Server
* fix langgraph SSE
* fix import uuid
2025-12-10 12:30:35 -08:00
42f5770cfa
[docs] add docs for containers files api + code interpreter on LiteLLM ( #17749 )
...
* add new container api on OpenAI
* add related
* docs fix
* docs code interpreter
* code interp
* docs code interptert
* docs code int
* docs code interp
* docs code interp
2025-12-09 18:11:28 -08:00
3a43042fad
docs - add sap gen ai provider on LiteLLM ( #17667 )
2025-12-08 12:43:42 -08:00
a9b654224e
1.80.8 RC docs ( #17605 )
...
* stash docs
* docs fix
* doc fix
* docs fix
2025-12-06 10:40:00 -08:00
e4f954b354
[Docs] Agent Gateway ( #17454 )
...
* init litellm A2a client
* simpler a2a client interface
* test a2a
* move a2a invoking tests
* test fix
* ensure a2a send message is tracked n logs
* rename tags
* add streaming handlng
* add a2a invocation
* add a2a invocation i cost calc
* test_a2a_logging_payload
* update invoke_agent_a2a
* test_invoke_agent_a2a_adds_litellm_data
* add A2a agent
* fix endpoints on A2a
* UI allow testing a2a endpoints
* add agent imgs
* add a2a as an endpoint
* add a2a
* docs a2a invoke
* docs a2a
* docs A2a invoke
2025-12-03 18:57:41 -08:00
6c188c5ae2
[Feat] New model/provider - Adds support for Google Cloud Chirp3 HD on /speech ( #17391 )
...
* docs vertex tts
* place vertex ai types in file
* use VertexAITextToSpeechConfig
* use vertex_voice_dict
* refactor docs
* docs vertex ai chirp
* TestVertexAITextToSpeechConfig
* new provider vertex ai chirp3
* test_litellm_speech_vertex_ai_chirp
* add vertex_ai/chirp cost trackign
2025-12-02 15:36:23 -08:00
37ecb03d4f
Add support of audio transcription for OVHcloud ( #17305 )
2025-12-01 18:26:39 -08:00
edfc35ddac
[Feature]: Add Provider publicai.co ( #17230 )
...
* init PublicAIChatConfig
* add publicai
* init public ai
* add publicai
* add publicai/swiss-ai models etc
2025-11-27 13:08:03 -08:00
d987593855
[Feat] Add audio transcriptions for WatsonX ( #17160 )
...
* feat: add IBMWatsonXAudioTranscriptionConfig
* init IBMWatsonXAudioTranscriptionConfig
* add inits
* test_watsonx_transcription_url_and_headers
* docs watsox audio
* docs watsonx audi
* docs
2025-11-26 14:15:49 -08:00
d2b90e6644
[Docs] Claude Skills API ( #17052 )
...
* add skillls api
* init doc
* docs fix
* skills API
2025-11-24 15:32:03 -08:00
8e318dd06c
[Feat] New LLM Provider - Docker Model Runner ( #16948 )
...
* add DOCKER_MODEL_RUNNER
* add DockerModelRunnerChatConfig Transorm
* add docker_model_runner
* add docker_model_runner
* docs docker model runner
* add DockerModelRunnerChatConfig
* add docker_model_runner to providers
* test_completion_hits_correct_url_and_body
* fix sidebar
* TestDockerModelRunnerIntegration
* test_completion_with_custom_engine_and_host
* docs docker model runner
* docs fix
2025-11-21 16:09:32 -08:00
124ba463f8
[Feat] RunwayML - Add support for /audio/speech eleven_multilingual_v2 endpoint ( #16604 )
...
* init RunwayMLTextToSpeechConfig
* add RunwayMLTextToSpeechConfig
* add RunwayMLTextToSpeechConfig
* test_runwayml_tts_async
* runway ml speech
* fix voices
* fix test
* docs runway lm
* add runwayml here
* fix RunwayMLTextToSpeechConfig
* test_openai_voice_mapping_to_runwayml
2025-11-13 14:32:09 -08:00
b30439257b
[Feat] Add RunwayML Img Gen API support ( #16557 )
...
* TestRunwaymlImageGeneration
* fix RUNWAYML
* rename
* fix rename
* get_runwayml_image_generation_config
* get_runwayml_image_generation_config
* TestRunwaymlImageGeneration
* add RUNWAYML_POLLING_TIMEOUT
* fix rnwayml transform img gen
* runwayml_image_cost_calculator
* runwayml_image_cost_calculator
* docs runwayml
* fix runwayML polling
* test_get_first_default_fallback
2025-11-12 18:20:14 -08:00
50b5cf5215
[Feat] New Provider - Add RunwayML Provider for video generations ( #16505 )
...
* add RUNWAYML
* init folders
* add RunwayMLVideoConfig
* add RUNWAYML_DEFAULT_API_VERSION
* add RunwayMLVideoConfig
* fix getting status
* add async_transform_video_content_response
* add runwayml transform_video_content_response
* fix config.yaml
* add runwayml docs
* add runwayml to videos
* docs runwayml video gen
* add new models to model cost map
* TestRunwayMLVideoTransformation
* fix linting errors
2025-11-11 18:48:23 -08:00
60f3a3b0ad
[Feat] add serxng search API provider ( #16259 )
...
* TestFirecrawlSearch
* add SearchProviders
* add to get_provider_search_config
* add FirecrawlSearchConfig
* add FirecrawlSearchRequest
* add firecrawl API docs
* add pricing firecrawl/search
* add new search APIs
* add SearXNGSearchConfig
* add searxng/search
* add serxng params
* TestSearXNGSearch
* docs serxng
* docs fix
* docs fix
* docs serxng
2025-11-04 17:56:07 -08:00
af78a93ecf
[Feat] /search API - add firecrawl search API support ( #16257 )
...
* TestFirecrawlSearch
* add SearchProviders
* add to get_provider_search_config
* add FirecrawlSearchConfig
* add FirecrawlSearchRequest
* add firecrawl API docs
* add pricing firecrawl/search
* add new search APIs
2025-11-04 17:52:12 -08:00
57295cedef
[Feat] Add Azure AI Doc Intelligence OCR ( #16219 )
...
* TestAzureDocumentIntelligenceOCR
* add AZURE_DOCUMENT_INTELLIGENCE_API_VERSION
* add AzureDocumentIntelligenceOCRConfig
* add async_transform_ocr_response
* use async transform
* add AzureDocumentIntelligenceOCRConfig
* add AzureDocumentIntelligenceOCRConfig
* add AzureDocumentIntelligenceOCRConfig
* add get_azure_ai_ocr_config
* add azure_ai/doc-intelligence
* add azure_ai/doc-intelligence
* docs fix
* docs fix
* add azure doc intel
* fix lint error
2025-11-03 17:22:19 -08:00
71c61c274f
[Feat] /ocr - Add VertexAI OCR provider support + cost tracking ( #16216 )
...
* add VertexAIOCRConfig
* __all__ = ["VertexAIOCRConfig"]
add
* add get_provider_ocr_config
* use GenericLiteLLMParams for litellm params
* fix _async_prepare_ocr_request
* fix _prepare_ocr_request
* fix get_complete_url
* fix validate_environment
* add safe_get_vertex_ai_project
* add VertexAIOCRConfig
* fix get_complete_url
* add TestVertexAIOCR
* add mistral-ocr-2505 cost
* add OCR to provider info
* docs vertex ai ocr
* fix _handle_rate_limits
* Potential fix for code scanning alert no. 3632: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-11-03 15:56:49 -08:00
0428229032
[Docs] readme fixes add supported providers ( #16109 )
...
* add provider test
* docs readme.md
* docs providers
* order providers
* test_providers_alphabetically_ordered
* docs endpoint
* fix config
* add ENDPOINT_COLUMNS
* add provider endpoints
* docs fix
2025-10-30 17:23:20 -07:00
Ishaan Jaff