Commit Graph
21896 Commits
Author SHA1 Message Date
51930c07c5 [Fix]: /messages - allow using dynamic AWS params (#10769)
* fix: dynamic AWS params added for messages routes

* Update tests/pass_through_unit_tests/test_anthropic_messages_passthrough.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
v1.69.0.dev1
2025-05-12 14:09:17 -07:00
Ishaan JaffandGitHub 6de80a29cb [Feat] Add tools support for Nvidia NIM (#10763)
* feat:: add tools support for nvidia nim

* fix: test_chat_completion_nvidia_nim_with_tools
2025-05-12 14:07:35 -07:00
LouisSharkandGitHub e865a4cdda fix(factory.py): Add reasoning content handling for missing assistant… (#10688)
* fix(factory.py): Add reasoning content handling for missing assistant content

* fix(factory.py): Improve handling of thinking blocks for assistant content

* test(factory.py): Add test for Bedrock processing of thinking blocks with None content
2025-05-12 08:13:15 -07:00
Ashish Kumar VermaandGitHub 0eb0cf4515 Fixed Ollama Structured Response not working #10616 (#10617)
* Fixed Json.dumps in JSON Schema Validation Error

* Added Response Schema to Ollama chat for structured response

* Added Test cases

* refactor(ollama): remove redundant response_format check

The response_format parameter conversion is already handled in utils.py's
get_optional_params function, making the duplicate check in ollama_chat.py
unnecessary. This change removes the redundant code while maintaining the
same functionality.
2025-05-12 07:02:52 -07:00
Krrish Dholakia b7fc72628c bump: version 1.69.0 → 1.69.1 v1.69.1-nightly 2025-05-11 00:24:00 -07:00
Krish DholakiaandGitHub ec89f7d622 Handle gemini audio input (#10739)
* fix(vertex_ai/gemini/transformation.py): handle gemini audio data translation

Fixes https://github.com/BerriAI/litellm/issues/10070

* feat(vertex_ai/gemini/transformation.py): Handle audio format param translation

Fixes https://github.com/BerriAI/litellm/issues/10070

* fix: fix linting error

* test: update test

* fix: fix linting error
2025-05-11 00:23:18 -07:00
Krrish Dholakia 0d6efff312 docs: update change on docs 2025-05-10 23:59:40 -07:00
Ishaan Jaff 8bcd5b6094 docs fix order 2025-05-10 23:16:51 -07:00
Ishaan Jaff e439cdcb9b docs release notes 2025-05-10 23:02:21 -07:00
Ishaan Jaff 97e23f9c03 docs email notifs 2.0 2025-05-10 23:00:20 -07:00
Ishaan Jaff af201d7c5d docs release notes 2025-05-10 22:48:58 -07:00
Ishaan Jaff b42c32fae5 docs - stable release 2025-05-10 22:35:05 -07:00
Ishaan Jaff 5764ae5b7c docs release notes 2025-05-10 19:35:01 -07:00
Krish DholakiaandGitHub beae5cfea9 Litellm staging 05 10 2025 - openai pdf url support + sagemaker chat content length error fix (#10724)
* Support pdf url's to openai (#10640)

* fix(gpt_transformation.py): support pdf url input to openai

pass as base64 as openai doesn't support image url's

* fix(openai.py): support async message transformation

allows async get request to convert url to base64

* fix(gpt_transformation.py): fix linting errrors and use common components across sync + async flows

* fix: fix linting errors

* fix(openai.py): pop correct var

* Fix sagemaker chat calls - content length error  (#10607)

* fix(sagemaker_chat/): support passing dynamic aws params

previously being ignored

* refactor(sagemaker/chat): more refactoring

* fix(sagemaker_chat/): make sure streaming is correctly handled post-refactor

* refactor: more refactoring to support using signed json str

* fix(sagemaker/chat): working sync streaming post refactor

* fix(sagemaker/chat): support async streaming post refactor

* fix(llm_http_handler.py): await async function

* fix: remove print statements

* test: update test

* test: update test

* fix(llm_http_handler.py): retain passing in data as json str

* test: update test

* fix(base_model_iterator.py): fix linting error

* test: test auth

* fix: fix linting error

* test: update test

* test: update translation test

* fix(gpt_transformation.py): handle awaitable/non-awaitable object

* fix: handle async flow for message transformation on openai compatible api's

* test: cleanup testing

* test: update test

* test(test_router.py): use model with higher quota

* test: simplify test

* test: update test
v1.69.0-stable
2025-05-10 17:41:57 -07:00
Ishaan Jaff b1fae09a7c bump litellm enterprise 0.1.2 2025-05-10 17:40:42 -07:00
Ishaan Jaff 4dfa913306 bump litellm proxy extras 2025-05-10 17:38:41 -07:00
Ishaan Jaff 580ea6052d fix: docs 2025-05-10 17:37:04 -07:00
Ishaan Jaff 4d8f667b5e ui new build 2025-05-10 17:31:44 -07:00
Ishaan Jaff cba56a8cc1 docs anthropic unified 2025-05-10 17:29:06 -07:00
Ishaan Jaff 9a481c1c05 docs email notifs 2025-05-10 17:27:09 -07:00
Ishaan Jaff d13117992c fix: test_init_custom_logger_compatible_class_as_callback 2025-05-10 17:26:12 -07:00
Ishaan JaffandGitHub 7942f6f595 [Docs] Email notifs (#10733)
* docs emails

* docs email notifs
2025-05-10 17:24:18 -07:00
Ishaan JaffandGitHub 07cb100fdc Litellm emails smtp fixes (#10730)
* feat: smtp email logger

* feat: smtp email logger

* fix: linting errors
2025-05-10 17:23:59 -07:00
Ishaan Jaff 037b2f9033 docs complete release note 2025-05-10 17:11:17 -07:00
Ishaan Jaff 893c149f45 docs complete ui, spend management fixes 2025-05-10 17:11:07 -07:00
Ishaan Jaff e81af78b07 complete Management Endpoints / UI 2025-05-10 17:10:58 -07:00
Ishaan Jaff c4074ec7a1 docs Logging / Guardrail Integrations 2025-05-10 17:10:43 -07:00
Ishaan JaffandGitHub d087aa1620 [Docs] v1.69.0-stable (#10731)
* docs init 1.69.0-stable

* (docs): New Models / Updated Models

* docs completed apis and new models
2025-05-10 16:31:36 -07:00
Krrish Dholakia 10ce3b478d docs(managed_batches.md): clarify cancel batches is coming soon 2025-05-10 16:29:44 -07:00
Krrish Dholakia 7934610f63 test: update test to handle rate limit error v1.69.0-nightly 2025-05-10 16:15:48 -07:00
Krrish Dholakia c7b6f661b3 bump: version 1.68.3 → 1.69.0 2025-05-10 15:24:48 -07:00
Krrish Dholakia 10e80f0742 build(pyproject.toml): publish new litellm-proxy-extras version 2025-05-10 15:24:32 -07:00
Krrish Dholakia 7262e8a790 test: clear env var before running test 2025-05-10 14:49:55 -07:00
2655fb1977 fix: headers parameter to default to None rather than empty dict (#10728)
Signed-off-by: Teryl Taylor <terylt@ibm.com>
Co-authored-by: Teryl Taylor <terylt@ibm.com>
2025-05-10 14:40:07 -07:00
Ishaan JaffandGitHub 3ddaf313c2 fix: fix update_db_model (#10726) 2025-05-10 14:28:37 -07:00
Ishaan JaffandGitHub 3d8c3d7b96 [DB] Add index for session_id on LiteLLM_SpendLogs (#10727)
* build: add index session_id

* build: add db migration
2025-05-10 14:28:20 -07:00
Ishaan JaffandGitHub 214a427038 fix: allow using credentials with amoderation (#10723) 2025-05-10 14:27:57 -07:00
Krish DholakiaandGitHub 7210b713dc Add target model name validation (#10722)
* fix(auth_checks.py): enforce auth checks on target model names

ensures user has access to models they are trying to call

* test(test_auth_utils.py): add unit tests for auth check

* fix(exception_mapping_utils.py): handle mistral 429 exception

* fix: fix linting error

* fix(auth_checks.py): add max fallback depth
2025-05-10 14:27:06 -07:00
Ishaan JaffandGitHub 02f0e13642 [UI] QA Logs page - Fix bug where log did not remain in focus + text overflow on error logs (#10725)
* logs page, ensure that the selected log remains in focus

* fix error view
2025-05-10 14:20:59 -07:00
Ishaan JaffandGitHub e88ac57176 [UI] Bug Fix - Allow Copying Request / Response on Logs Page (#10720)
* dont show country with API req

* ui: allow copying request / response on logs
2025-05-10 12:54:16 -07:00
Krish DholakiaandGitHub b8fe0e057f complete unified batch id support - replace model in jsonl to be deployment model name (#10719)
* feat(router.py): translate the model in jsonl for create file deployment to use the deployment model name

* test: add unit test for replace model in jsonl

* test(test_router.py): add unit tests

* test: add unit tests
2025-05-10 12:04:01 -07:00
Krrish Dholakia b13ed6b860 docs(litellm_managed_files.md): cleanup 2025-05-10 11:55:12 -07:00
Krrish Dholakia 5c0b972135 docs(managed_batches.md): add line numbers to code examples 2025-05-10 11:54:17 -07:00
Krrish Dholakia 3ec8a394a6 docs(managed_batches.md): file cleanup 2025-05-10 11:52:39 -07:00
Krrish Dholakia 990d6f5c93 docs(managed_batches.md): add docs on unified file id with batches 2025-05-10 11:28:24 -07:00
Krish DholakiaandGitHub 8a8dc7ceda Litellm Unified File ID output file id support (#10713)
* fix(router.py): write file to all deployments

allows unified file id to work across multiple deployments

* fix(view_logs/index.tsx): show call type in request logs

* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs

* fix(batch_utils.py): broaden check

* fix(router_utils.py): handle null type for function name

* fix(proxy_track_cost_callback.py): fix ruff check error

* fix(router.py): handle healthy_deployments as a dict

* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)

* feat(managed_files.py): support encoding / decoding unified batch id when using managed files

allows routing retrieve batch to the right model id

* fix: fix linting error

* feat(managed_files.py): support unified output file id

enables batch output file id to be used to retrieve the actual file

* fix(managed_files.py): attempt to fix ci/cd linting error

* fix: fix ruff check
2025-05-10 11:02:09 -07:00
Ishaan Jaff 2c8f4efd33 (UI) fix regression on Logs page 2025-05-10 09:25:21 -07:00
Ishaan Jaff 8ab4ad1355 fix merge conflicts 2025-05-10 09:08:43 -07:00
Ishaan Jaff 56b5626554 Revert "Filter logs on status and model (#10670)"
This reverts commit d4f7403cb9.
2025-05-10 09:07:49 -07:00
Ishaan Jaff 9bc8130ad5 Revert "Fix log table bugs (after filtering logic was added) (#10712)"
This reverts commit 3fafe37eb9.
2025-05-10 09:07:32 -07:00