Commit Graph

5306 Commits

Author SHA1 Message Date
Krrish Dholakia 06519e3f03 docs: specify when users can expect prod version 2025-06-15 01:39:14 -07:00
Krrish Dholakia 48845065f5 docs: specify rc docker version on release notes 2025-06-15 01:38:25 -07:00
Krrish Dholakia 48ac5a940f docs: cleanup 2025-06-15 01:33:49 -07:00
Krrish Dholakia 30827d0522 docs: cleanup docs 2025-06-15 01:33:06 -07:00
Krish Dholakia bb256c6d83 Release note updates + Responses API Bridge improvements (#11740)
* docs: track which items need docs

* docs(anthropic.md): add tool_choice="none" to docs

* docs: add docs for new anthropic + perplexity features

* docs: cleanup mistral reasoning docs

* docs: add links to docs

* docs(index.md): update docs

* docs: refactor to add a new 'integrations' tab to docs

* refactor(docs/): create separate tab for integrations

make it easier to highlight new integrations

* docs: sort sidebar

* docs: update

* feat: working claude code with openai codex mini

* docs: add responses api to docs

* feat(index.md): update docs

* fix: fix linting error
2025-06-15 01:13:10 -07:00
Krish Dholakia d15664c8e6 Litellm stable docs 06 14 2025 p2 (#11738)
* docs: track which items need docs

* docs(anthropic.md): add tool_choice="none" to docs

* docs: add docs for new anthropic + perplexity features

* docs: cleanup mistral reasoning docs

* docs: add links to docs

* docs(index.md): update docs

* docs: refactor to add a new 'integrations' tab to docs

* refactor(docs/): create separate tab for integrations

make it easier to highlight new integrations

* docs: sort sidebar

* docs: update
2025-06-14 19:38:46 -07:00
Ishaan Jaff 4efdfc00ab docs MCP 2025-06-14 18:13:29 -07:00
Ishaan Jaff 55af010d26 docs mcp 2025-06-14 18:10:37 -07:00
Ishaan Jaff 515e008974 docs mcp 2025-06-14 17:59:28 -07:00
Ishaan Jaff 45a7d1adfe docs mcp 2025-06-14 17:51:45 -07:00
Karthick J ac4c29c352 feat(azure): Make Azure AD scope configurable (#11621) 2025-06-14 17:43:01 -07:00
Ishaan Jaff fc57a53a60 docs - cleanup mcp 2025-06-14 17:31:55 -07:00
Ishaan Jaff a4530b49d8 clean up mcp docs 2025-06-14 17:31:22 -07:00
Ishaan Jaff 001e27aede fix typo 2025-06-14 17:29:50 -07:00
Krish Dholakia 0908618a19 Litellm stable release 06 14 2025 (#11737)
* docs: initial commit with stable release changelog notes

* docs: style updates

* docs(index.md): updated changelog

* docs(index.md): cleanup

* docs(index.md): add general proxy improvements

* docs: index.md

cleanup
2025-06-14 16:56:29 -07:00
Cole McIntosh d1bd68155e Add Langfuse OpenTelemetry Integration (#11607)
* feat(langfuse_otel): add Langfuse OpenTelemetry integration for observability

- Introduced a new integration for Langfuse OpenTelemetry, allowing users to send LiteLLM traces and observability data.
- Updated sidebars to include documentation for the new integration.
- Added example usage and configuration details in the documentation.
- Implemented necessary classes and methods to handle OpenTelemetry attributes and configuration.
- Included tests to validate the integration functionality and environment variable handling.

Still WIP

* Remove example script for Langfuse OpenTelemetry integration with LiteLLM
2025-06-14 14:18:38 -07:00
Ishaan Jaff f79737ad90 docs SCIM enterprise only 2025-06-14 14:03:59 -07:00
Ishaan Jaff b091c1ac4d [Feat] Prometheus - Allow controlling exposed metrics and labels (#11489)
* feat: init prometheus_metrics_config

* feat: add prometheus_metrics_config

* test prometheus

* feat: use factor to init metrics

* fix - pretty print allowed metrics controls

* fix config

* fix - working get_labels_for_metric

* test_no_prometheus_config

* docs update prometheus
2025-06-14 13:56:40 -07:00
Ishaan Jaff 7afbd897b8 docs mcp permissions 2025-06-13 18:32:08 -07:00
Krrish Dholakia 5007ef868f docs: doc updates 2025-06-13 10:21:54 -07:00
Krrish Dholakia b6714cfd4f docs(index.md): add stable pip package 2025-06-13 10:21:54 -07:00
Krrish Dholakia bb75d7e240 docs(caching.md): remove batch redis get recommendation - old code path, no longer necessary 2025-06-12 19:59:45 -07:00
Ishaan Jaff 61838bbbfc [Feat] Use dedicated Rest endpoints for list, calling MCP tools (#11684)
* fix: (fix) use specific rest endpoints for MCP

* ui - use rest mcp endpoints

* fix imports

* docs DISABLE_AIOHTTP_TRUST_ENV
2025-06-12 19:02:20 -07:00
Cole McIntosh 6b9754e2aa Merge pull request #11642 from colesmcintosh/mistral-reasoning
Enhance Mistral model support with reasoning capabilities
2025-06-12 16:42:53 -06:00
Ishaan Jaff 470dc55d48 docs - fix link 2025-06-12 11:24:34 -07:00
Ishaan Jaff e40ffa306c fix img link 2025-06-12 11:22:40 -07:00
Ishaan Jaff 6657012f07 docs release note 2025-06-12 11:11:00 -07:00
Cole McIntosh bee41c1961 Update Mistral documentation and enhance reasoning prompt handling
- Revised the reasoning support indicators in the Mistral model documentation for clarity.
- Improved the `_add_reasoning_system_prompt_if_needed` method to handle both string and list content types for system messages, ensuring the reasoning prompt is correctly prepended.
- Added a new test case to verify the functionality of adding the reasoning system prompt when the existing content is a list.
2025-06-12 11:17:48 -06:00
Cole McIntosh c5f91b9d77 Merge branch 'BerriAI:main' into mistral-reasoning 2025-06-12 11:04:57 -06:00
Krrish Dholakia e4c89135f5 docs(index.md): clarify pip install will be live by eod 2025-06-11 19:04:17 -07:00
Krrish Dholakia bdb1222a57 docs(index.md): remove pip install - not live yet 2025-06-11 19:03:31 -07:00
Krrish Dholakia 1bd2b03b4d docs(index.md): update docs to indicate v1.72.2-stable is now live 2025-06-11 19:03:11 -07:00
Cole McIntosh a30ed8ce0b [Feat] Add Mistral AI reasoning capabilities docs 2025-06-11 18:20:17 -06:00
.mobo a2cbc74fca Merge branch 'BerriAI:main' into main 2025-06-11 09:47:54 +02:00
Krish Dholakia 39de3610be fix(internal_user_endpoints.py): support user with + in email on us… (#11601)
* fix(internal_user_endpoints.py): support user with `+` in email on user info

ensures user is correctly parsed from input

* fix(factory.py): support vertex function call args as None

handles empty string in args for vertex gemini calls

* docs(langfuse_integration.md): pin langfuse sdk version on docs

* fix(vertex_ai/): return empty dict, instead of none when empty string given

* refactor: reduce function size

* fix: fix linting errors

* fix: revert check

* fix(internal_user_endpoints.py): fix check

* test: update tests

* test: update tests
2025-06-10 22:13:10 -07:00
Ishaan Jaff 2d0ea74cf4 [Bug Fix] No module named 'diskcache' (#11600)
* (build) show clear error when disk cache does not exist

* docs disk cache

* add caching to pyproject
2025-06-10 14:54:11 -07:00
Ishaan Jaff 55cd5f096c [Feat] LiteLLM Allow setting Uvicorn Keep Alive Timeout (#11594)
* Add keepalive timeout option for uvicorn server configuration

* docs Keepalive Timeout

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-06-10 13:30:19 -07:00
Konstantin Lapine 62e6cb315b Pangea/kl/udpate readme (#11570)
* chore(pangea-guardrail): Fix typo in debug message.

* docs(pangea-guardrail): Fix YAML example in pangea.md (README)."

* docs(pangea-guardrail): Update pangea.md (README).

* chore(pangea-guardrail): Format with Black.
2025-06-10 08:29:12 -07:00
Ishaan Jaff c6d0878160 [Feat] Add Lasso Guardrail to LiteLLM (#11565)
* Feature/lasso guardrail (#9002)

* first version of lasso guardrail in litellm

* update to the new Lasso API

* change  prod api_base and kill the request when lasso detect issue.

* change test for now api, local test pass

* add async tests

* all tests pass

* add docs for the new lasso guardrail

* Remove support for modes other than pre_call in Lasso guardrail

* code structure and naming

* only pre_call docs

* fix lint errors

* move test to the new location  follows the same directory structure as litellm/.

* add lasso guard

* docs lasso docs

* add lasso guardrail

* fix lasso guardrail

---------

Co-authored-by: oroxenberg <oro@lasso.security>
2025-06-09 18:47:26 -07:00
Krrish Dholakia 230dd70604 docs(data_security.md): data_security.md
update to indicate litellm does have soc 2 type2
2025-06-09 17:53:11 -07:00
Marc Abramowitz 3bd36238dc Simplify management_cli.md CLI docs (#10799)
Offer just 1 easy option for installing with `uv tool` so people can get
started quickly
2025-06-09 17:38:06 -07:00
Ishaan Jaff cd8ec4556f [Feat] Add reasoning_effort support for perplexity models (#11562)
* fix: add reasoning_effort for pplx

* docs pplx reasoning

* [tests] add mock tests for pplx reasoning (#11564)

* Add tests for Perplexity reasoning models and effort parameter

* tests perplexity reasoning effort

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>

* test pplx reasoning effort

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-06-09 17:07:31 -07:00
Cole McIntosh 322aefb97d Update documentation for configuring web search options in config.yaml (#11537)
* Update web_search.md to include new supported providers and models, enhance web search options, and improve documentation for using web search with various AI models.

* Update LiteLLM version in web_search.md to reflect the latest stable release.

* Fix formatting in web_search.md for model declaration consistency.

* docs(web_search.md): add configuration options for web search in config.yaml

This update introduces sections for setting default and custom web search options in the proxy config file, including examples for different models and context sizes. A note clarifies that users can override these settings in API requests.
2025-06-09 15:19:57 -07:00
fengbohello 400acd4297 docs: fix database_url config description (#11547) 2025-06-09 15:18:37 -07:00
Krrish Dholakia 35bc2d52a3 docs(index.md): document rate limiting improvements 2025-06-07 19:51:26 -07:00
Krrish Dholakia ff5a52fe3f docs(index.md): reference anthropic mcp docs on release notes 2025-06-07 19:27:54 -07:00
Krrish Dholakia 483f835c65 docs(anthropic.md): document anthropic mcp tool calling support 2025-06-07 19:21:14 -07:00
Ishaan Jaff bb8a5e752e docs 1.72.2 notes 2025-06-07 18:32:51 -07:00
Ishaan Jaff 3f41b84408 docs add audit logs to release note 2025-06-07 18:27:27 -07:00
Ishaan Jaff 6f6f9bf58e docs cleanup 2025-06-07 17:22:40 -07:00