Commit Graph
23118 Commits
Author SHA1 Message Date
Emerson GomesandGitHub a6412cd98a Add Azure Cohere Embed v4 (#10806)
Add Azure Cohere Embed v4 to model db
2025-05-13 15:25:35 -07:00
Emerson GomesandGitHub e7ad0b043c Add Azure gpt-4o-mini-tts (#10807)
Add Azure gpt-4o-mini-tts to model db
2025-05-13 15:25:22 -07:00
Jugal D. BhattandGitHub 2b5a781fa4 add ollama api base defaults (#10805) 2025-05-13 14:58:36 -07:00
Ishaan JaffandGitHub 3bd2c91164 [Fix] Maximum Vertex Recursion Depth Reached when transforming response_format (#10798)
* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* fix: bump: DEFAULT_MAX_RECURSE_DEPTH

* test: test_vertex_ai_complex_response_schema
2025-05-13 14:29:23 -07:00
Young HanandGitHub 71d1fabc21 [README] Add Llama API in supported providers table (#10802)
* docs: add llama-api in supported table

* docs: revert formatting
2025-05-13 13:49:21 -07:00
Krrish Dholakia 9ae4185e6d fix: cleanup print 2025-05-13 11:57:26 -07:00
Dat Daryl NgoandGitHub f1136fd217 fix: URL encode OTEL_EXPORTER_OTLP_TRACES_HEADERS for Phoenix Integration (#10654)
* fix: URL encode OTEL_EXPORTER_OTLP_TRACES_HEADERS for Arize Phoenix integration

- Add URL encoding for Bearer token in authorization header
- Follow OpenTelemetry Protocol Exporter specification
- Fix header format validation error in Phoenix integration

* add mock test for arize phoenix
2025-05-13 09:45:39 -07:00
Ishaan JaffandGitHub 3130c4f8f9 [Refactor] Move LLM Guard, Secret Detection to Enterprise Pip packagea (#10782)
* refactor: move guardrails to pip

* refactor: move guardrails to pip

* testing fix: move guardrails to pip

* git commit setup_litellm_enterprise_pip
v1.69.2-nightly
2025-05-13 09:42:22 -07:00
Krrish Dholakia e0b49c3b0c bump: version 1.69.1 → 1.69.2 2025-05-12 22:50:03 -07:00
Krish DholakiaandGitHub ff68cbda8e Fix azure dall e 3 call with custom model name + Handle Bearer $LITELLM_API_KEY in x-litellm-api-key custom header (#10776)
* fix(main.py): use base model instead of user model if given

Fixes https://github.com/BerriAI/litellm/issues/10760

* feat(azure/image_generation/__init__.py): make azure image gen check more robust

Fixes https://github.com/BerriAI/litellm/issues/10760

* fix(user_api_key_auth.py): support bearer token auth for `x-litellm-api-key` header

Fixes earlier regression on vertex ai passthrough auth

* fix(user_api_key_auth.py): refactor get api key into separate function

enables easier testing

* fix: cleanup

* fix: fix linting error

* fix: cleanup

* test: update tests
2025-05-12 22:49:35 -07:00
Krish DholakiaandGitHub 53f6514f12 Support Anthropic web search tool + Add more google finish reason mapping (#10785)
* fix(vertex_and_google_ai_studio_gemini.py): handle additional google finish reasons

Fixes https://github.com/BerriAI/litellm/issues/10768

* test: add more unit tests

* fix(anthropic/chat/transformation.py): support anthropic web search

Fixes https://github.com/BerriAI/litellm/issues/10664

* fix(anthropic/chat/transformation.py): add anthropic web search 'max uses' param support

* docs(anthropic.md): add doc for web search tool calling

Closes https://github.com/BerriAI/litellm/issues/10664

* build(model_prices_and_context_window.json): add search tool pricing for anthropic

* fix: suppress linting error

* test: update tests

* fix: fix ruff check
2025-05-12 22:45:51 -07:00
Krrish Dholakia fea3966d8e refactor: rename tests 2025-05-12 22:04:55 -07:00
Krrish Dholakia 9658d20bc9 build(model_prices_and_context_window.json): update poetry lock 2025-05-12 21:58:15 -07:00
d37cc63250 Add new model provider Novita AI (#7582) (#9527)
* Add new model provider Novita AI (#7582)

* feat: add new model provider Novita AI

* feat: use deepseek r1 model for examples in Novita AI docs

* fix: fix tests

* fix: fix tests for novita

* fix: fix novita transformation

* ci: fix ci yaml

* fix: fix novita transformation and test (#10056)

---------

Co-authored-by: Jason <ggbbddjm@gmail.com>
2025-05-12 21:49:30 -07:00
be9ce96a64 feat: Addded EU Anthropic Inference profile for Claude 3.7 (#10767)
Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-05-12 20:55:07 -07:00
643d2a8ccb [Feat] Option to force/always use the litellm proxy (#10559) (#10633) (#10773)
* [Feat] Option to force/always use the litellm proxy (#10559) (#10633)

* fix: add use_litellm_proxy

* fix: update LiteLLMProxyChatConfig

* fix get llm provider logic

* tests get llm provider logic

* add dynamic use_litellm_proxy

* docs forcsing litellm proxy usage

* fix: _should_use_litellm_proxy_by_default

* fixes: get_custom_llm_provider

---------

Co-authored-by: Antoine Legrand <2t.antoine@gmail.com>
2025-05-12 20:22:54 -07:00
Ishaan JaffandGitHub eeb27d70c1 [Fix] Allow using dynamic aws_region with /messages on Bedrock (#10779)
* fix: fix get_complete_url

* test: test_anthropic_messages_bedrock_dynamic_region
2025-05-12 20:22:38 -07:00
75135ac884 Update Nscale model providers to point to website (#10764)
* Instead of listing models and pricing, we provide a link to our website. We also highlight our free credits.

* Add all models supported tip to top of NScale README

* add space

---------

Co-authored-by: Oscar Savolainen <oscar.savolainen@enscale.com>
2025-05-12 17:10:39 -07:00
Ishaan Jaff 405b0c1ed7 fix: code quality on ollama chat 2025-05-12 16:47:55 -07:00
Ishaan JaffandGitHub 2cc4a87861 [Docs] Using litellm with Google ADK (#10777)
* docs litellm ADK usage

* docs litellm google adk

* docs litellm ADK

* docs litellm with ADK usage examples

* docs litellm proxy with ADK

* cookbook litellm ADK
2025-05-12 16:41:49 -07:00
Krrish Dholakia 2eb4aae26f fix(ollama_chat.py): fix key error + remove redundant code 2025-05-12 16:03:27 -07:00
Ishaan JaffandGitHub a4fb1da2d9 fix: pass application/json for GenericAPILogger (#10772)
* fix: pass application/json for GenericAPILogger

* fix: test_generic_api_callback
2025-05-12 14:15:33 -07:00
51930c07c5 [Fix]: /messages - allow using dynamic AWS params (#10769)
* fix: dynamic AWS params added for messages routes

* Update tests/pass_through_unit_tests/test_anthropic_messages_passthrough.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
v1.69.0.dev1
2025-05-12 14:09:17 -07:00
Ishaan JaffandGitHub 6de80a29cb [Feat] Add tools support for Nvidia NIM (#10763)
* feat:: add tools support for nvidia nim

* fix: test_chat_completion_nvidia_nim_with_tools
2025-05-12 14:07:35 -07:00
LouisSharkandGitHub e865a4cdda fix(factory.py): Add reasoning content handling for missing assistant… (#10688)
* fix(factory.py): Add reasoning content handling for missing assistant content

* fix(factory.py): Improve handling of thinking blocks for assistant content

* test(factory.py): Add test for Bedrock processing of thinking blocks with None content
2025-05-12 08:13:15 -07:00
Ashish Kumar VermaandGitHub 0eb0cf4515 Fixed Ollama Structured Response not working #10616 (#10617)
* Fixed Json.dumps in JSON Schema Validation Error

* Added Response Schema to Ollama chat for structured response

* Added Test cases

* refactor(ollama): remove redundant response_format check

The response_format parameter conversion is already handled in utils.py's
get_optional_params function, making the duplicate check in ollama_chat.py
unnecessary. This change removes the redundant code while maintaining the
same functionality.
2025-05-12 07:02:52 -07:00
Krrish Dholakia b7fc72628c bump: version 1.69.0 → 1.69.1 v1.69.1-nightly 2025-05-11 00:24:00 -07:00
Krish DholakiaandGitHub ec89f7d622 Handle gemini audio input (#10739)
* fix(vertex_ai/gemini/transformation.py): handle gemini audio data translation

Fixes https://github.com/BerriAI/litellm/issues/10070

* feat(vertex_ai/gemini/transformation.py): Handle audio format param translation

Fixes https://github.com/BerriAI/litellm/issues/10070

* fix: fix linting error

* test: update test

* fix: fix linting error
2025-05-11 00:23:18 -07:00
Krrish Dholakia 0d6efff312 docs: update change on docs 2025-05-10 23:59:40 -07:00
Ishaan Jaff 8bcd5b6094 docs fix order 2025-05-10 23:16:51 -07:00
Ishaan Jaff e439cdcb9b docs release notes 2025-05-10 23:02:21 -07:00
Ishaan Jaff 97e23f9c03 docs email notifs 2.0 2025-05-10 23:00:20 -07:00
Ishaan Jaff af201d7c5d docs release notes 2025-05-10 22:48:58 -07:00
Ishaan Jaff b42c32fae5 docs - stable release 2025-05-10 22:35:05 -07:00
Ishaan Jaff 5764ae5b7c docs release notes 2025-05-10 19:35:01 -07:00
Krish DholakiaandGitHub beae5cfea9 Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724)
* Support pdf url's to openai (#10640)

* fix(gpt_transformation.py): support pdf url input to openai

pass as base64 as openai doesn't support image url's

* fix(openai.py): support async message transformation

allows async get request to convert url to base64

* fix(gpt_transformation.py): fix linting errrors and use common components across sync + async flows

* fix: fix linting errors

* fix(openai.py): pop correct var

* Fix sagemaker chat calls - content length error  (#10607)

* fix(sagemaker_chat/): support passing dynamic aws params

previously being ignored

* refactor(sagemaker/chat): more refactoring

* fix(sagemaker_chat/): make sure streaming is correctly handled post-refactor

* refactor: more refactoring to support using signed json str

* fix(sagemaker/chat): working sync streaming post refactor

* fix(sagemaker/chat): support async streaming post refactor

* fix(llm_http_handler.py): await async function

* fix: remove print statements

* test: update test

* test: update test

* fix(llm_http_handler.py): retain passing in data as json str

* test: update test

* fix(base_model_iterator.py): fix linting error

* test: test auth

* fix: fix linting error

* test: update test

* test: update translation test

* fix(gpt_transformation.py): handle awaitable/non-awaitable object

* fix: handle async flow for message transformation on openai compatible api's

* test: cleanup testing

* test: update test

* test(test_router.py): use model with higher quota

* test: simplify test

* test: update test
v1.69.0-stable
2025-05-10 17:41:57 -07:00
Ishaan Jaff b1fae09a7c bump litellm enterprise 0.1.2 2025-05-10 17:40:42 -07:00
Ishaan Jaff 4dfa913306 bump litellm proxy extras 2025-05-10 17:38:41 -07:00
Ishaan Jaff 580ea6052d fix: docs 2025-05-10 17:37:04 -07:00
Ishaan Jaff 4d8f667b5e ui new build 2025-05-10 17:31:44 -07:00
Ishaan Jaff cba56a8cc1 docs anthropic unified 2025-05-10 17:29:06 -07:00
Ishaan Jaff 9a481c1c05 docs email notifs 2025-05-10 17:27:09 -07:00
Ishaan Jaff d13117992c fix: test_init_custom_logger_compatible_class_as_callback 2025-05-10 17:26:12 -07:00
Ishaan JaffandGitHub 7942f6f595 [Docs] Email notifs (#10733)
* docs emails

* docs email notifs
2025-05-10 17:24:18 -07:00
Ishaan JaffandGitHub 07cb100fdc Litellm emails smtp fixes (#10730)
* feat: smtp email logger

* feat: smtp email logger

* fix: linting errors
2025-05-10 17:23:59 -07:00
Ishaan Jaff 037b2f9033 docs complete release note 2025-05-10 17:11:17 -07:00
Ishaan Jaff 893c149f45 docs complete ui, spend management fixes 2025-05-10 17:11:07 -07:00
Ishaan Jaff e81af78b07 complete Management Endpoints / UI 2025-05-10 17:10:58 -07:00
Ishaan Jaff c4074ec7a1 docs Logging / Guardrail Integrations 2025-05-10 17:10:43 -07:00
Ishaan JaffandGitHub d087aa1620 [Docs] v1.69.0-stable (#10731)
* docs init 1.69.0-stable

* (docs): New Models / Updated Models

* docs completed apis and new models
2025-05-10 16:31:36 -07:00