tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-19 10:23:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,859 Commits 2,072 Branches 1,425 Tags
2f33445054ccfb7f4e8ad5e4ef8d1db913161561
Commit Graph
5434 Commits
Author SHA1 Message Date
Sameer KankuteandGitHub 2f33445054 Merge pull request #20738 from BerriAI/main 
merge main
 2026-02-09 15:07:39 +05:30
Sameer Kankute 7fa4d090ec Add doc for chat completion web search 2026-02-09 13:51:26 +05:30
ryan-crabbeandGitHub f39c1e9045 docs: add middleware performance blog post (#20677) 
* docs: add middleware performance blog post

* docs: add Krrish, Ishaan, and author details to middleware blog post
 2026-02-07 17:36:53 -08:00
ryan-crabbeGitHubAlexsander Hamir
 		94db421e67 docs: add callback registration optimization to v1.81.9 release notes (#20681) 
* docs: add callback registration optimization to v1.81.9 release notes

* Update v1.81.9.md

---------

Co-authored-by: Alexsander Hamir <alexsanderhamirgomesbaptista@gmail.com>
 2026-02-07 17:09:45 -08:00
Ishaan Jaffer d8528fbfdb docs fix 2026-02-07 16:00:28 -08:00
Ishaan Jaffer 02cfc87bdb fidocs fix 2026-02-07 15:58:13 -08:00
Alexsander HamirandGitHub 5de7fe2897 docs: add LiteLLM Observatory section to v1.81.9 release notes (#20675) 
- Add paragraph on release validation, extensibility, and 100% coverage goal
- Include OOMs and CPU regressions as issues surfaced under sustained load
 2026-02-07 15:24:15 -08:00
yuneng-jiang 0531254899 reorganize admin UI docs 2026-02-07 15:20:24 -08:00
yuneng-jiang ea255e2bd0 UI contributing and trouble shooting docs 2026-02-07 15:11:49 -08:00
yuneng-jiang 6e984122ba Adding to release notes + sidebar 2026-02-07 14:43:46 -08:00
yuneng-jiang ca24f56b39 Merge remote-tracking branch 'origin' into docs_yj_feb7 2026-02-07 14:40:21 -08:00
Alexsander HamirandGitHub 0f7104f8a5 docs: polish LiteLLM Observatory blog post (#20670) 2026-02-07 14:35:28 -08:00
yuneng-jiang 5876441aa2 warning placement 2026-02-07 14:35:11 -08:00
yuneng-jiang b29572cebc adjusting to add email integration prereq 2026-02-07 14:33:04 -08:00
yuneng-jiang f7fbcefd26 UI team soft budget docs 2026-02-07 14:27:53 -08:00
Ishaan Jaffer 8bce48daa4 docs fix 2026-02-07 14:22:04 -08:00
Ishaan JaffandGitHub caf51a4ca9 Litellm docs rc fixes (#20667) 
* docs

* review 1

* docs fix

* docs

* docs fix

* docs
 2026-02-07 13:32:15 -08:00
Ishaan JaffandGitHub f2ba3cc6e1 [Docs] 1.81.9 stability (#20665) 
* docs

* review 1

* docs fix
 2026-02-07 13:15:23 -08:00
Sameer KankuteandGitHub f5ed7826a4 Merge pull request #20637 from BerriAI/litellm_blog_claude_4_6 
Update opus 4.6 blog with adaptive thinking
 2026-02-07 13:09:56 +05:30
Sameer Kankute 8741512183 Update opus 4.6 blog with adaptive thinking 2026-02-07 13:07:20 +05:30
Ishaan Jaffer 36be0044dc docs 2026-02-06 18:30:17 -08:00
Ishaan JaffandGitHub 1b24a0fdd7 docs (#20626) 2026-02-06 18:24:21 -08:00
Alexsander HamirandGitHub 0d7465694d Add OpenAI/Azure release test suite with HTTP client lifecycle regression detection (#20622) 2026-02-06 18:03:05 -08:00
Krish DholakiaandGitHub ba74e6d9d2 Add http support to custom code guardrails + Unified guardrails for MCP + Agent guardrail support (#20619) 
* fix: fix styling

* fix(custom_code_guardrail.py): add http support for custom code guardrails

allows users to call external guardrails on litellm with minimal code changes (no custom handlers)

Test guardrail integrations more easily

* feat(a2a/): add guardrails for agent interactions

allows the same guardrails for llm's to be applied to agents as well

* fix(a2a/): support passing guardrails to a2a from the UI

* style(code-editor): allow editing custom code guardrails on ui + add examples of pre/post calls for custom code guardrails

* feat(mcp/): support custom code guardrails for mcp calls

allows custom code guardrails to work on mcp input

* feat(chatui.tsx): support guardrails on mcp tool calls on playground
 2026-02-06 17:34:32 -08:00
Sameer KankuteandGitHub eab7a99800 Merge pull request #20578 from BerriAI/litellm_claude_code_beta_headers 
Add unsupported claude code beta headers in json
 2026-02-06 19:10:13 +05:30
Sameer Kankute c1a43914ee Add documentation related to new beta header json 2026-02-06 17:54:56 +05:30
Sameer KankuteandGitHub bfd21b5e00 Merge branch 'main' into litellm_opus_4.6_thinking 2026-02-06 14:17:40 +05:30
Sameer Kankute a2b29d6328 Add complete documentation for claude_opus_4_6 2026-02-06 14:04:39 +05:30
Sameer Kankute 887a977ab4 Add doc on how to enable compaction via chat completion 2026-02-06 12:05:36 +05:30
Cesar GarciaandGitHub 95f8cbe5ca [Feat] add ElevenLabs eleven_v3 and eleven_multilingual_v2 to model cost map (#20522) 
* [Feat] add ElevenLabs `eleven_v3` and `eleven_multilingual_v2` to model cost map

Register ElevenLabs TTS models for cost tracking:
- elevenlabs/eleven_v3: most expressive model, 70+ languages, audio tags
- elevenlabs/eleven_multilingual_v2: default TTS model, 29 languages

Also update ElevenLabs docs with supported models table and eleven_v3 audio tags example.

* docs: remove model-agnostic tip from ElevenLabs docs
 2026-02-05 19:37:42 -08:00
Cesar GarciaandGitHub 8263c8ad15 feat(web_search): add gpt-5-search-api model and docs clarifications (#20512) 
* docs(web_search): clarify OpenAI search model requirements

- Add gpt-5-search-api to supported OpenAI search models
- Add warning that regular models (gpt-5, gpt-4.1) do NOT support web_search_options
- Add tip that web_search_options is optional for search models

* feat(models): add gpt-5-search-api pricing for OpenAI and Azure
 2026-02-05 19:36:43 -08:00
Ishaan Jaffer bff5f8d7b0 doc fix 2026-02-05 15:31:41 -08:00
Ishaan Jaffer ea35ab6d4e day 0 blog post 2026-02-05 11:47:36 -08:00
Krish DholakiaGitHubCursor Agent
 		f65eec8fa8 docs: Update CLI arguments documentation with all available options (#20437) 
- Reorganized documentation into logical sections (Server Configuration,
  Server Backend Options, SSL/TLS Configuration, Model Configuration,
  Model Parameters, Database Configuration, Debugging, Testing & Health Checks)
- Added missing CLI arguments:
  - --iam_token_db_auth: RDS IAM token authentication for database connections
  - --run_gunicorn: Start proxy with gunicorn backend
  - --run_hypercorn: Start proxy with hypercorn backend (HTTP/2 support)
  - --ssl_keyfile_path, --ssl_certfile_path, --ciphers: SSL/TLS configuration
  - --keepalive_timeout: Uvicorn keepalive timeout setting
  - --max_requests_before_restart: Worker recycling for memory management
  - --use_prisma_db_push: Alternative database schema update method
  - --test_async, --num_requests: Async endpoint testing
  - --version/-v: Print version
  - --max_budget: Set budget limits for API calls
  - --headers, --add_key, --save: Model configuration options
  - --use_queue: Celery workers for async endpoints
  - --local: Local debugging flag
- Updated default value for --num_workers to reflect actual behavior
- Added environment variable documentation for applicable options

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-02-05 08:46:37 -08:00
michelligabrieleandGitHub 8e1201ca3d docs: improve Okta SSO setup guide with step-by-step instructions (#20353) 
* docs: improve Okta SSO setup guide with step-by-step instructions

- Add clear steps for creating OIDC app in Okta Admin Console
- Document critical Authorization Server Access Policy configuration
- Add troubleshooting table for common errors
- Link to official Okta documentation for detailed UI instructions
- Fix incorrect OAuth endpoint examples (was using Auth0 URLs)

* docs: add Okta console screenshots for SSO setup guide

- Add screenshot showing Sign-in redirect URI configuration
- Add screenshot showing Client Credentials location
- Add screenshot showing Authorization Server Access Policy setup

* docs: replace Okta screenshots with annotated Scribe versions

- Replace screenshots with Scribe-annotated versions highlighting key areas
- Add step-by-step screenshots for Authorization Server Access Policy setup
- Remove old unannotated screenshots
 2026-02-04 18:39:51 -08:00
Shivam RawatandGitHub 795ba8efe3 Merge pull request #20443 from BerriAI/docs_langfuse_multi_project_cred_support 
langfuse doc update
 2026-02-04 15:55:04 -08:00
shivam 555e1da9b4 langfuse doc update 2026-02-04 15:53:24 -08:00
Sameer KankuteandGitHub b2feedc469 Merge pull request #20318 from BerriAI/litellm_oss_staging_02_03_2026 
feat(guardrails): implement team-based isolation guardrails mgmnt (#1…
 2026-02-04 17:49:30 +05:30
Sameer KankuteandGitHub bfc0c4b4ab Merge pull request #20396 from BerriAI/litellm_copilot_kit_sdk 
[DOCS]Add copilotkit sdk doc as supported agents sdk
 2026-02-04 13:41:08 +05:30
Sameer KankuteGitHubgreptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 		cdd4569064 Apply suggestion from @greptile-apps[bot] 
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
 2026-02-04 11:56:17 +05:30
Sameer Kankute 465bbf3514 Add copilotkit sdk doc as supported agents sdk 2026-02-04 11:53:49 +05:30
Sameer Kankute 8109413a54 Add copilotkit sdk doc as supported agents sdk 2026-02-04 11:52:17 +05:30
Ishaan Jaffer 7b8e3c7736 docs fix 2026-02-03 20:11:48 -08:00
Ishaan JaffandGitHub da4cf4942f [Feat] Add xAI /realtime API Support - works with LiveKitSDK (#20381) 
* init: _realtime_health_check + routing

* refactor: OpenAIRealtime

* refactor: XAI_API_BASE

* feat: XAIRealtime

* init feat: XAIRealtime

* OpenAIRealtime

* TestXAIRealtime

* test fixes

* test OAI

* TEST xAI, OAI

* clean realtime jobs

* refactor

* test XAI

* docs xAI

* fix xAI

* fix lint errors

* test_async_realtime_url_contains_model

* test fix

* document test changes

* _realtime_health_check

* docs xai realtime

* fix handlers

* add additional_headers

* fix
 2026-02-03 19:58:28 -08:00
Krish DholakiaandGitHub 7056d9984e Custom Code Guardrails UI Playground (#20377) 
* feat(guardrails/): allow custom code execution for guardrails

first step in allowing teams to submit custom code for guardrails

* feat: custom_code_guardrail.md

support passing custom code for guardrails

* feat: initial commit adding ui for custom code guardrails

allows users to write guardrails based on custom code

* feat: expose new test custom code guardrail endpoint

allows ui testing playground to sanity check if guardrail is working as expected

* fix: fix linting errors

* fix: fix max recursion check

* fix: fix linting error
 2026-02-03 19:57:24 -08:00
Sameer KankuteandGitHub 25fa1ad4e7 Merge pull request #20386 from naaa760/fix/extra-head-chat-comp-brid 
fix(proxy): forward extra headers in chat
 2026-02-04 09:11:43 +05:30
Ishaan JaffandGitHub d267c69086 [Feat] Use A2A registered agents with /chat/completions (#20362) 
* test_a2a_registry_integration

* fix: render agents on model dropdown on UI

* init append_agents_to_model_group

* route_a2a_agent_request

* is_a2a_agent_model

* route_a2a_agent_request

* fix: error handling

* docs A2A usage

* docs fix

* feat: working A2a streaming

* fix transform
 2026-02-03 15:25:38 -08:00
Xiaohan FuandGitHub 2b25d03046 Fix fail-open for grayswan and pass metadata to cygnal api endpoint (#19837) 
* fix fail-open for grayswan; pass metadata to cygnal api endpoint; update docs

* pass litellm_metadata to cygnal in payload

* switch error msg to const, and clean exception handling.

* update pyproject.toml as requested

* Revert "update pyproject.toml as requested"

This reverts commit 4eece154d056ba33689a5584c86c8fc352bb7cdd.
 2026-02-03 14:41:31 -08:00
Sameer KankuteandGitHub b7f0d05dfd Merge pull request #20337 from BerriAI/main 
update 02 staging PR
 2026-02-03 17:08:01 +05:30
Sameer Kankute 017b78de40 Fix code quality tests 2026-02-03 15:01:17 +05:30