tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 22:17:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,058 Commits 2,072 Branches 1,425 Tags
ebeea46fc4e12ac9ee79acbf19bc8a8585322e9f
Commit Graph
714 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub 844c766c65 Merge pull request #18763 from BerriAI/litellm_staging_01_07_2026 
Staging - 01/07/2026
 2026-01-09 17:01:58 +05:30
Ishaan JaffandGitHub cbac70a4ec MANUS docs (#18817) 2026-01-08 18:58:10 +05:30
Abliteration AIGitHubGoutham Karthiyuneng-jiangYutaSaito
 		dc4ce7c5a2 feat: Add abliteration.ai provider (#18678) 
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
 2026-01-07 21:46:54 +05:30
Krish DholakiaandGitHub 80ead21c3a Litellm improve endpoint discovery (#18762) 
* docs: document all endpoints in .json and add consistency checks against docs + providers.json

* docs: add more tests + improve coverage
 2026-01-07 17:35:01 +05:30
drorIvryandGitHub 000913fa12 Hotfix - docs qualifire (#18724) 
* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire

* Hotfix - docs qualifire
 2026-01-07 17:23:12 +05:30
Lundin MatthewsandGitHub 762345172c Add LlamaGate as a new provider (#18673) 
Adds LlamaGate (https://llamagate.dev) as an OpenAI-compatible provider with:
- Provider configuration in providers.json
- Documentation page with usage examples
- Model pricing for 17 models across categories:
  - General purpose (Llama 3.1/3.2, Mistral, Qwen, Dolphin)
  - Reasoning (DeepSeek R1, OpenThinker)
  - Code (Qwen Coder, DeepSeek Coder, CodeLlama)
  - Vision (Qwen VL, LLaVA, Gemma 3)
  - Embeddings (Nomic, Qwen3 Embedding)

Provider details:
- Base URL: https://api.llamagate.dev/v1
- Auth: Bearer token via LLAMAGATE_API_KEY
- Pricing: $0.02-$0.55 per 1M tokens
- All models are open-weights
 2026-01-07 00:00:30 +05:30
Ishaan JaffandGitHub 76eda472be [Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 
* init transform_compact_response_api_request

* init acompact_responses

* init async_compact_response_api_handler in llm http handler

* init transform_compact_response_api_request for openai

* init acompact_responses

* fix acompact_responses

* add OAI Compact API

* docs responses API Compact

* code qa checks

* test_openai_compact_responses_api

* fix mypy linting
 2026-01-06 16:24:04 +05:30
Ishaan JaffandGitHub bf1c5bef59 [UI] Add view for estimating costs across requests (#18645) 
* add estimate_cost endpoint

* TestCostEstimateEndpoint

* fix estimate_cost

* add /cost/estimate to spend tracking routes

* fix code QA checks

* fixes endpoint

* v0 cost estimator

* v0 cost estimator

* formatNumberWithCommas

* fix admin view

* docs

* docs fix + export PDF/CSV

* fixes for export
 2026-01-05 19:19:58 +05:30
Matt CowgerandGitHub 9f4a4fd271 Add docs as follow on to #18362 (#18388) 2025-12-25 11:08:47 +05:30
Ishaan JaffandGitHub 1123cfa928 [Feat] AI Gateway - Add support for Platform Fee / Margins (#18427) 
* init cost_margin_config

* feat: add cost margin

* init types

* LITELLM_SETTINGS_SAFE_DB_OVERRIDES

* feat _apply_cost_margin

* ui endpoint

* ui provider margins

* add margin

* refactored ui

* test cost margins

* refactored ui

* provider discounts

* add cost_breakdown to spendLogs

* add CostBreakdownViewer

* fix cost breakdown

* docs fix

* doc margins

* docs margins
 2025-12-25 11:07:27 +05:30
Sameer Kankute 42121ad13b Update minimax docs to be in proper format 2025-12-24 09:25:36 +05:30
Ishaan JaffandGitHub 4f7682f670 [Feat] RAG query endpoint - Add RAG Search / Query endpoint (#18376) 
* add rag query to llm api endpoints

* add rag query as a new endpoint

* docs - new endpoint

* ingest+query

* docs add rag query
 2025-12-23 22:30:37 +05:30
Sameer Kankute c7e0366925 Add support for minmax tts 2025-12-23 21:53:53 +05:30
Sameer Kankute 403875256c Add minmax documentation 2025-12-23 16:11:26 +05:30
Ishaan JaffandGitHub 2677d9d30d [Feat] New provider TTS - Add AWS polly API for TTS (#18326) 
* add aws_polly as new provider

* init AWSPollyTextToSpeechConfig

* test_aws_polly_tts_with_native_voice

* init aws_polly + AWS polly dispatch

* init AWSPollyTextToSpeechConfig

* fix transform

* add aws_polly as a new provider for TTS API

* add to sidebar

* docs aws polly

* code qa fix

* add AWS Polly Text-to-Speech

* add cost tracking for AWS polly

* docs fix
 2025-12-22 18:19:34 +05:30
Farhan AuliandaandGitHub 63c3a6e228 fix: enable JSON-only provider routing + add xiaomi_mimo provider (#18291) 
* fix: enable JSON-only provider routing + add xiaomi_mimo provider

* docs: add xiaomi_mimo provider documentation
 2025-12-22 12:05:22 +05:30
Anil KodaliandGitHub afba676b2e Add Amazon Nova to sidebar and under supported models in README (#18220) 2025-12-19 19:07:34 +05:30
Ishaan JaffandGitHub 5ea0854eda [Feat] Guardrails Load Balancing - Allow Platform admins to load balance between guardrails (#18181) 
* add _aguardrail_helper for LB

* add _aguardrail_helper on router.py

* test_proxy_logging_pre_call_hook_load_balancing

* add _execute_guardrail_with_load_balancing

* add LB TEsting

* docs guard lb

* fix linting

* fix lint
 2025-12-19 00:08:03 +05:30
Krish DholakiaandGitHub 26cd2c4473 Guardrails - add built in guardrails for harmful content, bias, etc. (#18029) 
* feat(litellm_content_filter.py): add support for content filtering categories

make it easy for proxy admin to prevent messages about violence, self harm or illegal weapons going through litellm

* feat: initial commit adding bias detection

allows admin to block inappropriate content about sexual orientation, etc.

* refactor: simplify content_filter.py

use a more exhaustive set of keywords, instead of guessing at potential phrases user can use

* feat(content_filter.py): add new denied topics for in-built content filter guardrails

allow user to automatically block content relating to certain categories from being sent to the LLML

* refactor(content-filter): document new params to litellm content filter

* feat(ui/): litellm content filter - select content categories on ui

* docs: update documentation

* docs(litellm_content_filter.md): document new content filters
 2025-12-18 16:28:58 +05:30
Ishaan JaffandGitHub 274d996a87 [Feat] New Search API Provider - LinkUp Search (#18174) 
* add linkup search provider

* add Linkup Search docs

* add get_provider_search_config

* get_provider_search_config

* add linkup/search provider

* fix mypy linting
 2025-12-18 14:27:36 +05:30
Ishaan Jaffer f80628502d init docs 2025-12-17 02:27:54 +04:00
Ishaan JaffandGitHub 244d83ff47 [Docs] Litellm add docs vertex ai engine (#18027) 
* new provider doc

* add to sidebar

* stash docs

* docs fix

* docs vertex agent engine
 2025-12-15 20:11:40 -08:00
Ishaan JaffandGitHub ce113f4e4b [Docs] Add docs on using pydantic ai agents with LiteLLM A2a gateway (#18026) 
* init A2AProviderConfigManager

* move file

* move file

* add pydnatic ai folder

* init providers

* test_pydantic_ai_non_streaming

* fix import

* INIT pydantic

* use_a2a_form_fields

* test_vertex_agent_engine_streaming

* add agent_engine

* init transform for agent engine

* init agent engine

* VertexAgentEngineSSEStreamIterator

* sample

* ui add new fields

* fix vertex_credentials

* working SSE iterator

* TestVertexAgentEngineTransformRequest

* fix code QA check

* stash docs

* docs fix

* fix logo

* docs fix

* doc pydantic ai

* docs pydantic ai

* new provider

* docs fix
 2025-12-15 19:43:12 -08:00
Ishaan Jaffer 87ba4fabd7 docs fix 2025-12-14 14:20:47 -08:00
Ishaan Jaffer 3cac6b0a40 vllm batch 2025-12-14 12:36:07 -08:00
yuneng-jiang 773c4d08b4 Merge Agent Usage with A2A Cost Tracking 2025-12-13 13:04:28 -08:00
yuneng-jiang b692e87836 Agent doc fix 2025-12-13 12:54:00 -08:00
Ishaan JaffandGitHub 2f82c223d3 Litellm docs a2a cost tracking (#17913) 
* docs - a2a cost tracking

* docs fix

* docs a2a cost trackign

* docs langgraph agents
 2025-12-12 18:23:25 -08:00
Ishaan JaffandGitHub cca21c0926 [Feat] New API Provider - Add Azure AI Foundry Agents on /chat/completions, /responses, /messages + Agent Gateway (#17845) 
* init get_azure_ai_route

* init AzureAIAgentsConfig

* init AzureAIAgentsConfig

* AzureAIAgentsHandler

* test_azure_ai_agents_acompletion_non_streaming

* test_azure_ai_agents_acompletion_streaming

* fix stream

* _process_sse_stream

* Azure AI Foundry Agents

* init  Azure AI Foundry Agent

* fix code QA checks

* fix api key

* docs fix
 2025-12-11 15:21:28 -08:00
Ashton SidhuandGitHub a514313540 Add Hiddenlayer Guardrail Hooks (#17728) 
* Core logic working, need to add tests

* Re add removed files

* Remove mistaken files

* one more file

* Add deployment params

* Add tests

* Remove unused imports

* Update docs from feedback

* Update guardrails
 2025-12-11 07:43:26 -08:00
Ishaan JaffandGitHub 5ee32167c0 [Feat] New Provider - add langgraph (#17783) 
* init LANGGRAPH

* init LangGraphConfig

* init LangGraphConfig types

* init langgraph

* init getting api base and key

* init transform langgraph

* fix SSE issues

* test_langgraph_acompletion_non_streaming

* add LangGraph to docs

* docs: Setting Up a Local LangGraph Server

* fix langgraph SSE

* fix import uuid
 2025-12-10 12:30:35 -08:00
Krish DholakiaGitHubCursor Agent
 		8bc5e2ca7f Add /v1/messages/count_tokens endpoint documentation (#17772) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-12-10 11:34:11 -08:00
Krish DholakiaandGitHub b0a5a4b81d Arize Phoenix OSS - Prompt Management Integration (#17750) 
* docs(prompt_management.md): document how to onboard prompts to litellm

* feat(arize_phoenix_prompt_manager.py): support new prompt management integration

allows users to connect arize phoenix prompt manager to litellm

* fix(proxy/utils.py): remove prompt variables to avoid re-processing prompt

* docs(arize_phoenix_prompts.md): document new prompt management integration
 2025-12-09 22:53:42 -08:00
Cesar GarciaandGitHub b4e0dabb37 fix: use absolute URL for Supported Endpoints link to avoid Docusaurus slug conflict (#17710) 
The relative link was causing Docusaurus to incorrectly associate the
/supported_endpoints page with SDK Functions category instead of the
actual Supported Endpoints generated-index.
 2025-12-09 18:49:49 -08:00
Krrish Dholakia d3531be9a0 docs(community.md): add new integration partner doc 2025-12-09 18:17:14 -08:00
Ishaan JaffandGitHub 42f5770cfa [docs] add docs for containers files api + code interpreter on LiteLLM (#17749) 
* add new container api on OpenAI

* add related

* docs fix

* docs code interpreter

* code interp

* docs code interptert

* docs code int

* docs code interp

* docs code interp
 2025-12-09 18:11:28 -08:00
Ishaan JaffandGitHub a904067d38 [Feat] New model - add bedrock writer models (#17685) 
* add new bedrock models

* test bedrock writer models

* docs bedrock writer palmyra

* add palymra models

* add bedrock writer models

* docs fix
 2025-12-08 17:49:06 -08:00
Ishaan JaffandGitHub 074445edb1 [Fix] AI Gateway Auth - allow using wildcard patterns for public routes (#17686) 
* edit auth utils to allow wildcard patterns

* docs fix private / public routes

* test_route_in_additional_public_routes_wildcard_match
 2025-12-08 17:39:53 -08:00
Cesar GarciaandGitHub dcf5217d17 docs: improve Getting Started page and SDK documentation structure (#17614) 
* docs: update Getting Started page with accurate endpoints and fix exception handling

- Update endpoints list to include /responses, /audio, /batches
- Change "Consistent output" to be endpoint-agnostic
- Clarify Response Format title as "OpenAI Chat Completions Format"
- Fix exception handling example: use litellm exceptions instead of deprecated openai.error
- Add model prefix (anthropic/) to example

* docs: reorganize sidebar and improve SDK documentation structure

Sidebar changes:
- Reorder: Python SDK first, then AI Gateway (Proxy)
- Rename "LiteLLM - Getting Started" to "Getting Started"
- Restructure SDK section with Core Functions, Configuration subsections
- Move budget_manager to Guides
- Move sdk_custom_pricing and migration to Extras
- Remove duplicate embedding/async_embedding and embedding/moderation

Content changes:
- Add Response Format section to response_api.md
- Add async aembedding() section to supported_embedding.md

* docs: add deprecation notice for OpenAI Assistants API

OpenAI has deprecated the Assistants API, shutting down on August 26, 2026.
Added warning banner directing users to the Responses API.

* docs: expand Core Functions in SDK sidebar

Add more SDK functions to Core Functions category:
- text_completion()
- image_generation()
- transcription()
- speech()
- Link to "All Supported Endpoints" for complete list

* Rename Sidebar Item

* docs: revert Getting Started label to original

* Rename sidebar label from 'LiteLLM - Getting Started' to 'Getting Started'
 2025-12-08 13:05:50 -08:00
Ishaan JaffandGitHub 3a43042fad docs - add sap gen ai provider on LiteLLM (#17667) 2025-12-08 12:43:42 -08:00
_juliettechandGitHub ee0812a297 Add Helicone as a provider and update observability documentation (#17663) 
* Add Helicone as a provider to liteLLM

* Add Helicone provider integration
 2025-12-08 12:34:11 -08:00
Tamir KivitiandGitHub 0f5694c8eb add onyx guardrail hooks integration (#16591) 
* add onyx guardrail hooks integration

* fix lint issue

* fix lint issue

* update PR to use the new custom guardrail interface

* lint fix
 2025-12-07 23:33:28 -08:00
yuneng-jiang bff3590dd0 Update sidebar for customer usage 2025-12-06 14:21:18 -08:00
Cesar GarciaandGitHub 8ccfaa21de docs: add Microsoft GraphRAG to projects using LiteLLM (#17616) 
* docs: add Microsoft GraphRAG to projects using LiteLLM

* docs: add arXiv paper link for GraphRAG

* docs: add GraphRAG to sidebar

* Update projects in sidebars.js

Reordered items in the projects list to include 'GraphRAG'.
 2025-12-06 13:47:46 -08:00
Ishaan JaffandGitHub a9b654224e 1.80.8 RC docs (#17605) 
* stash docs

* docs fix

* doc fix

* docs fix
 2025-12-06 10:40:00 -08:00
Krrish Dholakia 497856e1e3 docs: document multi tenant architecture 2025-12-06 09:27:30 -08:00
Sameer KankuteandGitHub 558c8f92d1 Merge pull request #17519 from BerriAI/litellm_cursor_integration 
Add support for cursor BYOK with its own configuration
 2025-12-05 22:23:45 +05:30
Sameer Kankute c8fbcc7f1c add tutorial as well 2025-12-05 12:32:23 +05:30
Sameer KankuteandGitHub acc0b5fe27 Merge pull request #17362 from BerriAI/litellm_vertex-bge-cherrypick 
[Feat] VertexAI - Add BGE Embeddings support
 2025-12-05 11:53:42 +05:30
Sameer Kankute a6006e698c Add support for cursor BYOK with its own configuration 2025-12-05 09:34:49 +05:30