tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-15 08:27:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
22,007 Commits 2,072 Branches 1,425 Tags
8a7fdf3dd509fbca5e724faa2ec7d6c734da2183
Commit Graph
3551 Commits
Author SHA1 Message Date
Jugal D. BhattandGitHub 7702663666 add constant to config settings.md (#10908) 2025-05-16 18:33:19 -07:00
Jugal D. BhattandGitHub 44c100d05d [Feat] handle multi-pod deployment for SpendLogs Retention (#10895) 
* handle multi-pod deployment

* fix utc and ruff errors

* add constants.py

* add lock duration acc to interval

* add lock duration on pod lock manager

* update tests to use redis

* update comments from review

* update config_Settings.md

* lint errors

* remove custom ttl setting

* add constants.py

* add constants.py

* add check for pod lock manager, and allow otherwise

* remove dup try except and move to finally

remove args
 2025-05-16 18:18:51 -07:00
Ishaan JaffandGitHub bd1e0634bf [Feat] Add Lakera v2 Guardrail Support (#10880) 
* feat: add types for lakera v2

* feat: add call v2 guard for lakera

* feat: add call v2 guard for lakera

* feat: add LAKERA_V2

* feat: add LAKERA_V2 params

* feat: add initialize_lakera_v2

* fix: lakera pii masking

* test: lakera pii masking

* fix: lakera pii masking with tracing

* fix: lakera pii masking with tracing

* fix: fix linting errors

* fix: lakera ai docs
 2025-05-16 17:08:21 -07:00
Will ChenandGitHub 0942a9d51d Fix example commands in reliability.md (#10894) 
-D is incorrect and dumps the headers.
The correct flag is -d which sets it as data
 2025-05-16 13:21:34 -07:00
JasonandGitHub 803dda05ed fix: fix novita ai docs (#10882) 2025-05-16 10:04:55 -07:00
Krrish Dholakia ffcdf441d2 fix: fix docs 2025-05-15 22:32:02 -07:00
Damian GleumesandGitHub 384a7ba94d [Feat]: Configure LiteLLM to Parse User Headers from Open Web UI (#9802) 
* add user_header_name

* docs: add per-user tracking to Open WebUI with LiteLLM doc

* docs: standardize "OpenWeb UI" spelling across openweb_ui.md

* docs: improve wording for openweb_ui guide

* fix end_user_id not being set

- move user header parsing to add_litellm_data_to_request
- also set  user_api_key_dict.end_user_id from user header
 2025-05-15 22:01:12 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		1e08816489 build(deps): bump undici from 6.21.1 to 6.21.3 in /docs/my-website (#10855) 
Bumps [undici](https://github.com/nodejs/undici) from 6.21.1 to 6.21.3.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v6.21.1...v6.21.3)

---
updated-dependencies:
- dependency-name: undici
  dependency-version: 6.21.3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-05-15 08:33:12 -07:00
user202729andGitHub 044f5f973b Add documentation on in-memory and disk caching (#10522) 2025-05-14 23:07:13 -07:00
Ishaan Jaff fc8d28f7df docs - DEFAULT_MAX_RECURSE_DEPTH_SENSITIVE_DATA_MASKER 2025-05-14 18:29:31 -07:00
Ishaan Jaff abe7b71e6a Revert "Revert "[Fix] Allow overriding all constants using a .env variable (#10803)"" 
This reverts commit cf4b2ebda4.
 2025-05-14 18:27:43 -07:00
Jugal D. BhattandGitHub a754a25828 Feat add retention config (#10815) 
* add function to check config flag

* added unit tests

* convert to seconds support

* added in settings.md

* Updated config_settings.md

* remove extra point

* change config var

* resolve conflict
 2025-05-14 18:16:25 -07:00
Ishaan Jaff be18923250 fix code qa check for OTEL env vars 2025-05-14 17:56:27 -07:00
Damien PontifexandGitHub 63a4287bff Supper OTLP standard environment variables for configuration (#10813) 
- Environment variables outlined at https://opentelemetry.io/docs/languages/sdk-configuration/otlp-exporter/
- Default to OTLP standard, but fallback to existing so as to not break backwards compatibility
 2025-05-14 17:40:28 -07:00
Ishaan Jaff cf4b2ebda4 Revert "[Fix] Allow overriding all constants using a .env variable (#10803)" 
This reverts commit de901bbf24.
 2025-05-13 21:27:44 -07:00
Ishaan JaffandGitHub 8142c20c98 [Feat] Allow specifying PII Entities Config when using Presidio Guardrails (#10810) 
* refactor: use analyze_text, anonymize_text

* feat: allow defining pii_entities_config for presidio

* feat: use entities config for presidio analyze request

* feat: add test_presidio_pii.py

* testing: add guardrails testing job

* feat: allow blocking specific entities pii

* test: use 1 file for presidio guard tests

* fix: presidio pii tests

* test: presidio blocked entity

* clean up docs

* docs presidio pii parsing

* fix: raise_exception_if_blocked_entities_detected

* fix: linting errors
 2025-05-13 19:48:56 -07:00
Ishaan JaffandGitHub 5fbcd22604 [Fix] Allow overriding all constants using a .env variable (#10803) 
* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* test: test_vertex_ai_complex_response_schema

* fix: allow all constants to be overriden

* fix: allow all numeric constants to be overriden with env vars

* fix: remove dup DEFAULT_MAX_TOKENS in constants.py

* document all constants env vars

* docs - DEFAULT_PROMPT_INJECTION_SIMILARITY_THRESHOLD
 2025-05-13 16:10:55 -07:00
Krish DholakiaandGitHub 53f6514f12 Support Anthropic web search tool + Add more google finish reason mapping (#10785) 
* fix(vertex_and_google_ai_studio_gemini.py): handle additional google finish reasons

Fixes https://github.com/BerriAI/litellm/issues/10768

* test: add more unit tests

* fix(anthropic/chat/transformation.py): support anthropic web search

Fixes https://github.com/BerriAI/litellm/issues/10664

* fix(anthropic/chat/transformation.py): add anthropic web search 'max uses' param support

* docs(anthropic.md): add doc for web search tool calling

Closes https://github.com/BerriAI/litellm/issues/10664

* build(model_prices_and_context_window.json): add search tool pricing for anthropic

* fix: suppress linting error

* test: update tests

* fix: fix ruff check
 2025-05-12 22:45:51 -07:00
Krish DholakiaGitHubJason
 		d37cc63250 Add new model provider Novita AI (#7582) (#9527) 
* Add new model provider Novita AI (#7582)

* feat: add new model provider Novita AI

* feat: use deepseek r1 model for examples in Novita AI docs

* fix: fix tests

* fix: fix tests for novita

* fix: fix novita transformation

* ci: fix ci yaml

* fix: fix novita transformation and test (#10056)

---------

Co-authored-by: Jason <ggbbddjm@gmail.com>
 2025-05-12 21:49:30 -07:00
Ishaan JaffGitHubAntoine Legrand
 		643d2a8ccb [Feat] Option to force/always use the litellm proxy (#10559) (#10633) (#10773) 
* [Feat] Option to force/always use the litellm proxy (#10559) (#10633)

* fix: add use_litellm_proxy

* fix: update LiteLLMProxyChatConfig

* fix get llm provider logic

* tests get llm provider logic

* add dynamic use_litellm_proxy

* docs forcsing litellm proxy usage

* fix: _should_use_litellm_proxy_by_default

* fixes: get_custom_llm_provider

---------

Co-authored-by: Antoine Legrand <2t.antoine@gmail.com>
 2025-05-12 20:22:54 -07:00
Oscar SavolainenGitHubOscar Savolainen
 		75135ac884 Update Nscale model providers to point to website (#10764) 
* Instead of listing models and pricing, we provide a link to our website. We also highlight our free credits.

* Add all models supported tip to top of NScale README

* add space

---------

Co-authored-by: Oscar Savolainen <oscar.savolainen@enscale.com>
 2025-05-12 17:10:39 -07:00
Ishaan JaffandGitHub 2cc4a87861 [Docs] Using litellm with Google ADK (#10777) 
* docs litellm ADK usage

* docs litellm google adk

* docs litellm ADK

* docs litellm with ADK usage examples

* docs litellm proxy with ADK

* cookbook litellm ADK
 2025-05-12 16:41:49 -07:00
Krrish Dholakia 0d6efff312 docs: update change on docs 2025-05-10 23:59:40 -07:00
Ishaan Jaff 8bcd5b6094 docs fix order 2025-05-10 23:16:51 -07:00
Ishaan Jaff e439cdcb9b docs release notes 2025-05-10 23:02:21 -07:00
Ishaan Jaff 97e23f9c03 docs email notifs 2.0 2025-05-10 23:00:20 -07:00
Ishaan Jaff af201d7c5d docs release notes 2025-05-10 22:48:58 -07:00
Ishaan Jaff b42c32fae5 docs - stable release 2025-05-10 22:35:05 -07:00
Ishaan Jaff 5764ae5b7c docs release notes 2025-05-10 19:35:01 -07:00
Ishaan Jaff cba56a8cc1 docs anthropic unified 2025-05-10 17:29:06 -07:00
Ishaan Jaff 9a481c1c05 docs email notifs 2025-05-10 17:27:09 -07:00
Ishaan JaffandGitHub 7942f6f595 [Docs] Email notifs (#10733) 
* docs emails

* docs email notifs
 2025-05-10 17:24:18 -07:00
Ishaan Jaff 037b2f9033 docs complete release note 2025-05-10 17:11:17 -07:00
Ishaan Jaff 893c149f45 docs complete ui, spend management fixes 2025-05-10 17:11:07 -07:00
Ishaan Jaff e81af78b07 complete Management Endpoints / UI 2025-05-10 17:10:58 -07:00
Ishaan Jaff c4074ec7a1 docs Logging / Guardrail Integrations 2025-05-10 17:10:43 -07:00
Ishaan JaffandGitHub d087aa1620 [Docs] v1.69.0-stable (#10731) 
* docs init 1.69.0-stable

* (docs): New Models / Updated Models

* docs completed apis and new models
 2025-05-10 16:31:36 -07:00
Krrish Dholakia 10ce3b478d docs(managed_batches.md): clarify cancel batches is coming soon 2025-05-10 16:29:44 -07:00
Krrish Dholakia b13ed6b860 docs(litellm_managed_files.md): cleanup 2025-05-10 11:55:12 -07:00
Krrish Dholakia 5c0b972135 docs(managed_batches.md): add line numbers to code examples 2025-05-10 11:54:17 -07:00
Krrish Dholakia 3ec8a394a6 docs(managed_batches.md): file cleanup 2025-05-10 11:52:39 -07:00
Krrish Dholakia 990d6f5c93 docs(managed_batches.md): add docs on unified file id with batches 2025-05-10 11:28:24 -07:00
Marc AbramowitzandGitHub 3787aa27b0 Add management client docs (#10703) 
* Add management client docs

* Docs enhancements

* Add "proxy/management_cli" to sidebar

* Small formatting changes

* Add overview table

* Wrap long line

* Add "Quick Start" section

* Document uv tool upgrade and uninstall

* Add blank lines to eliminate yellow squigglies in VS Code

* For each section link to section on swagger used

* Wrap some long command examples

* Break long http request command on to multiple lines
 2025-05-09 18:59:24 -07:00
Tom MatthewsandGitHub e2a9cd0c75 Add nscale support for streaming (#10698) 2025-05-09 11:39:23 -07:00
GPTLocalhost (Word Add-in)andGitHub 86f19d2fae Add GPTLocalhost to "docs/my-website/docs/projects" (#10687) 
* Create GPTLocalhost.md

* Update sidebars.js
 2025-05-09 07:44:48 -07:00
Tom MatthewsandGitHub ff279faf35 Add support for Nscale (EU-Sovereign) Provider (#10638) 
* Add support for nscale provider

* Add image generation support and fix unit tests

* Add docs for nscale

* Fix unit test import issues

* Minor doc improvement

* Remove redundant null tokens from model cost map

* Address PR review comments for doc updates

* Revert changes to large text
 2025-05-08 08:50:15 -07:00
Ishaan JaffandGitHub 6a3ea83b23 [Feat] Bedrock Guardrails - Add support for PII Masking with bedrock guardrails (#10642) 
* allow defining mask_request_content for guardrails

* allow pii masking with bedrock

* implement bedrock pre call hook

* docs bedrock pii masking

* fix linting error

* fix code quality checks
 2025-05-07 18:30:57 -07:00
Thom LaneandGitHub 5f47df4627 Update instructor.md (#10549) 
Simplified examples
 2025-05-05 21:15:53 -07:00
Krrish Dholakia 9ae239b3e1 docs(index.md): add graphic 2025-05-05 20:49:47 -07:00
Ishaan JaffandGitHub 489f1a6c25 [Feat] v2 Custom Logger API Endpoints (#10575) 
* fixes for generic api logger

* tests for generic api logger

* test_generic_api_callback_multiple_logs

* allow health checking generic api endpoints

* docs generic api endpoint for logging

* allow setting headers for generic api  callback

* fix for test_init_custom_logger_compatible_class_as_callback

* fix linting
 2025-05-05 16:57:55 -07:00