Commit Graph

3542 Commits

Author SHA1 Message Date
Ishaan Jaff fc8d28f7df docs - DEFAULT_MAX_RECURSE_DEPTH_SENSITIVE_DATA_MASKER 2025-05-14 18:29:31 -07:00
Ishaan Jaff abe7b71e6a Revert "Revert "[Fix] Allow overriding all constants using a .env variable (#10803)""
This reverts commit cf4b2ebda4.
2025-05-14 18:27:43 -07:00
Jugal D. Bhatt a754a25828 Feat add retention config (#10815)
* add function to check config flag

* added unit tests

* convert to seconds support

* added in settings.md

* Updated config_settings.md

* remove extra point

* change config var

* resolve conflict
2025-05-14 18:16:25 -07:00
Ishaan Jaff be18923250 fix code qa check for OTEL env vars 2025-05-14 17:56:27 -07:00
Damien Pontifex 63a4287bff Supper OTLP standard environment variables for configuration (#10813)
- Environment variables outlined at https://opentelemetry.io/docs/languages/sdk-configuration/otlp-exporter/
- Default to OTLP standard, but fallback to existing so as to not break backwards compatibility
2025-05-14 17:40:28 -07:00
Ishaan Jaff cf4b2ebda4 Revert "[Fix] Allow overriding all constants using a .env variable (#10803)"
This reverts commit de901bbf24.
2025-05-13 21:27:44 -07:00
Ishaan Jaff 8142c20c98 [Feat] Allow specifying PII Entities Config when using Presidio Guardrails (#10810)
* refactor: use analyze_text, anonymize_text

* feat: allow defining pii_entities_config for presidio

* feat: use entities config for presidio analyze request

* feat: add test_presidio_pii.py

* testing: add guardrails testing job

* feat: allow blocking specific entities pii

* test: use 1 file for presidio guard tests

* fix: presidio pii tests

* test: presidio blocked entity

* clean up docs

* docs presidio pii parsing

* fix: raise_exception_if_blocked_entities_detected

* fix: linting errors
2025-05-13 19:48:56 -07:00
Ishaan Jaff 5fbcd22604 [Fix] Allow overriding all constants using a .env variable (#10803)
* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* test: test_vertex_ai_complex_response_schema

* fix: allow all constants to be overriden

* fix: allow all numeric constants to be overriden with env vars

* fix: remove dup DEFAULT_MAX_TOKENS in constants.py

* document all constants env vars

* docs - DEFAULT_PROMPT_INJECTION_SIMILARITY_THRESHOLD
2025-05-13 16:10:55 -07:00
Krish Dholakia 53f6514f12 Support Anthropic web search tool + Add more google finish reason mapping (#10785)
* fix(vertex_and_google_ai_studio_gemini.py): handle additional google finish reasons

Fixes https://github.com/BerriAI/litellm/issues/10768

* test: add more unit tests

* fix(anthropic/chat/transformation.py): support anthropic web search

Fixes https://github.com/BerriAI/litellm/issues/10664

* fix(anthropic/chat/transformation.py): add anthropic web search 'max uses' param support

* docs(anthropic.md): add doc for web search tool calling

Closes https://github.com/BerriAI/litellm/issues/10664

* build(model_prices_and_context_window.json): add search tool pricing for anthropic

* fix: suppress linting error

* test: update tests

* fix: fix ruff check
2025-05-12 22:45:51 -07:00
Krish Dholakia d37cc63250 Add new model provider Novita AI (#7582) (#9527)
* Add new model provider Novita AI (#7582)

* feat: add new model provider Novita AI

* feat: use deepseek r1 model for examples in Novita AI docs

* fix: fix tests

* fix: fix tests for novita

* fix: fix novita transformation

* ci: fix ci yaml

* fix: fix novita transformation and test (#10056)

---------

Co-authored-by: Jason <ggbbddjm@gmail.com>
2025-05-12 21:49:30 -07:00
Ishaan Jaff 643d2a8ccb [Feat] Option to force/always use the litellm proxy (#10559) (#10633) (#10773)
* [Feat] Option to force/always use the litellm proxy (#10559) (#10633)

* fix: add use_litellm_proxy

* fix: update LiteLLMProxyChatConfig

* fix get llm provider logic

* tests get llm provider logic

* add dynamic use_litellm_proxy

* docs forcsing litellm proxy usage

* fix: _should_use_litellm_proxy_by_default

* fixes: get_custom_llm_provider

---------

Co-authored-by: Antoine Legrand <2t.antoine@gmail.com>
2025-05-12 20:22:54 -07:00
Oscar Savolainen 75135ac884 Update Nscale model providers to point to website (#10764)
* Instead of listing models and pricing, we provide a link to our website. We also highlight our free credits.

* Add all models supported tip to top of NScale README

* add space

---------

Co-authored-by: Oscar Savolainen <oscar.savolainen@enscale.com>
2025-05-12 17:10:39 -07:00
Ishaan Jaff 2cc4a87861 [Docs] Using litellm with Google ADK (#10777)
* docs litellm ADK usage

* docs litellm google adk

* docs litellm ADK

* docs litellm with ADK usage examples

* docs litellm proxy with ADK

* cookbook litellm ADK
2025-05-12 16:41:49 -07:00
Krrish Dholakia 0d6efff312 docs: update change on docs 2025-05-10 23:59:40 -07:00
Ishaan Jaff 8bcd5b6094 docs fix order 2025-05-10 23:16:51 -07:00
Ishaan Jaff e439cdcb9b docs release notes 2025-05-10 23:02:21 -07:00
Ishaan Jaff 97e23f9c03 docs email notifs 2.0 2025-05-10 23:00:20 -07:00
Ishaan Jaff af201d7c5d docs release notes 2025-05-10 22:48:58 -07:00
Ishaan Jaff b42c32fae5 docs - stable release 2025-05-10 22:35:05 -07:00
Ishaan Jaff 5764ae5b7c docs release notes 2025-05-10 19:35:01 -07:00
Ishaan Jaff cba56a8cc1 docs anthropic unified 2025-05-10 17:29:06 -07:00
Ishaan Jaff 9a481c1c05 docs email notifs 2025-05-10 17:27:09 -07:00
Ishaan Jaff 7942f6f595 [Docs] Email notifs (#10733)
* docs emails

* docs email notifs
2025-05-10 17:24:18 -07:00
Ishaan Jaff 037b2f9033 docs complete release note 2025-05-10 17:11:17 -07:00
Ishaan Jaff 893c149f45 docs complete ui, spend management fixes 2025-05-10 17:11:07 -07:00
Ishaan Jaff e81af78b07 complete Management Endpoints / UI 2025-05-10 17:10:58 -07:00
Ishaan Jaff c4074ec7a1 docs Logging / Guardrail Integrations 2025-05-10 17:10:43 -07:00
Ishaan Jaff d087aa1620 [Docs] v1.69.0-stable (#10731)
* docs init 1.69.0-stable

* (docs): New Models / Updated Models

* docs completed apis and new models
2025-05-10 16:31:36 -07:00
Krrish Dholakia 10ce3b478d docs(managed_batches.md): clarify cancel batches is coming soon 2025-05-10 16:29:44 -07:00
Krrish Dholakia b13ed6b860 docs(litellm_managed_files.md): cleanup 2025-05-10 11:55:12 -07:00
Krrish Dholakia 5c0b972135 docs(managed_batches.md): add line numbers to code examples 2025-05-10 11:54:17 -07:00
Krrish Dholakia 3ec8a394a6 docs(managed_batches.md): file cleanup 2025-05-10 11:52:39 -07:00
Krrish Dholakia 990d6f5c93 docs(managed_batches.md): add docs on unified file id with batches 2025-05-10 11:28:24 -07:00
Marc Abramowitz 3787aa27b0 Add management client docs (#10703)
* Add management client docs

* Docs enhancements

* Add "proxy/management_cli" to sidebar

* Small formatting changes

* Add overview table

* Wrap long line

* Add "Quick Start" section

* Document uv tool upgrade and uninstall

* Add blank lines to eliminate yellow squigglies in VS Code

* For each section link to section on swagger used

* Wrap some long command examples

* Break long http request command on to multiple lines
2025-05-09 18:59:24 -07:00
Tom Matthews e2a9cd0c75 Add nscale support for streaming (#10698) 2025-05-09 11:39:23 -07:00
GPTLocalhost (Word Add-in) 86f19d2fae Add GPTLocalhost to "docs/my-website/docs/projects" (#10687)
* Create GPTLocalhost.md

* Update sidebars.js
2025-05-09 07:44:48 -07:00
Tom Matthews ff279faf35 Add support for Nscale (EU-Sovereign) Provider (#10638)
* Add support for nscale provider

* Add image generation support and fix unit tests

* Add docs for nscale

* Fix unit test import issues

* Minor doc improvement

* Remove redundant null tokens from model cost map

* Address PR review comments for doc updates

* Revert changes to large text
2025-05-08 08:50:15 -07:00
Ishaan Jaff 6a3ea83b23 [Feat] Bedrock Guardrails - Add support for PII Masking with bedrock guardrails (#10642)
* allow defining mask_request_content for guardrails

* allow pii masking with bedrock

* implement bedrock pre call hook

* docs bedrock pii masking

* fix linting error

* fix code quality checks
2025-05-07 18:30:57 -07:00
Thom Lane 5f47df4627 Update instructor.md (#10549)
Simplified examples
2025-05-05 21:15:53 -07:00
Krrish Dholakia 9ae239b3e1 docs(index.md): add graphic 2025-05-05 20:49:47 -07:00
Ishaan Jaff 489f1a6c25 [Feat] v2 Custom Logger API Endpoints (#10575)
* fixes for generic api logger

* tests for generic api logger

* test_generic_api_callback_multiple_logs

* allow health checking generic api endpoints

* docs generic api endpoint for logging

* allow setting headers for generic api  callback

* fix for test_init_custom_logger_compatible_class_as_callback

* fix linting
2025-05-05 16:57:55 -07:00
Young Han b1e28a3bc4 [Docs] Change llama-api link for litellm (#10556)
* docs: change llama-api link for litellm

* docs: init supported models table
2025-05-05 12:37:37 -07:00
Krrish Dholakia 914ab00805 docs(index.md): add key highlights to docs 2025-05-03 22:04:22 -07:00
Ishaan Jaff bccab23a6a add vector stores to release note 2025-05-03 21:51:03 -07:00
Krrish Dholakia 3f09da21e3 docs(meta_llama.md): clarify meta llama works on responses api 2025-05-03 21:41:00 -07:00
Ishaan Jaff 8aa57ff0c0 add meta llma api to release notes 2025-05-03 21:00:22 -07:00
Ishaan Jaff f52593486c [Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538)
* Support Llama-api as an LLM provider (#10451)

* init: support llama-api as a llm provider

* docs: fix endpoint url

* fix: rename meta dir to meta-llama

* docs: add meta-llama info

* fix: mv LlamaAPIConfig under chat directory

* feat: add LlamaAPIConfig in ProviderConfigManager

* fix: provider_config from ProviderConfigManager

* feat: add supports_tool_choice param

* fix: remove optional_params using model_info

* fix: rename meta-llama to meta_llama

* init: test for meta_llama

* fix: model names

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* fix file naming convention

* fix file naming convention for meta_llama

* docs meta llama api litellm

---------

Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2025-05-03 16:29:03 -07:00
Krish Dholakia 7ce687ef39 Litellm stable release notes 05 03 2025 (#10536)
* build(release_cycle.md): document bar for minor vs. patch updates

* docs(index.md): initial changelog doc

* docs(index.md): update llama docs

* docs(index.md): add docs for llm api endpoints + spend tracking/budget improvements

* docs: more doc cleanup

* docs(index.md): more doc cleanup

* docs(index.md): final doc cleanup
2025-05-03 12:47:11 -07:00
Ishaan Jaff ee8aa23c19 docs VectorStoreRegistry 2025-05-03 12:05:49 -07:00
Ishaan Jaff 42ea608b4b docs add section on bedrock provider to show how to use KBs 2025-05-03 11:55:16 -07:00