Commit Graph
23118 Commits
Author SHA1 Message Date
Krrish Dholakia 95de41d10c build: publish new litellm-proxy-extras file 2025-05-27 17:44:23 -07:00
0590b1eb3a [Fix] Prometheus Metrics - Do not track end_user by default + expose flag to enable tracking end_user on prometheus (#11192)
* fix: testing for disabling end user on metrics

* fix: fixes for test_prometheus_factory

* Delete litellm/model_prices_and_context_window_backup.json

* fix: issues with merge conflicts

* fix: test_get_end_user_id_for_cost_tracking_prometheus_only

* Update tests/test_litellm/integrations/test_prometheus.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-05-27 17:06:58 -07:00
Krish DholakiaandGitHub 4c82dd9b27 Ollama Chat - parse tool calls on streaming (#11171)
* fix(user_api_key_auth.py): fix else block

Fixes https://github.com/BerriAI/litellm/issues/11170

* refactor(ollama/chat): refactor to base config pattern

easier to maintain fixes

* fix(ollama/chat): support tool call parsing on streaming

Closes https://github.com/BerriAI/litellm/issues/11104

* test: update import location

* fix: cleanup unused import

* fix: fix ruff check error

* test: update import

* test: update test on ci

* ci: cleanup

* fix: fix chekc

* fix: fix api key check order

* test: fix import

* ci: fix script

* test: fix imports

* fix: fix tests
2025-05-27 16:14:49 -07:00
Krish DholakiaandGitHub 64096aeb1e Codestral - return litellm latency overhead on /v1/completions + Add '__contains__' support for ChatCompletionDeltaToolCall (#10879)
* feat(codestral/completion): return litellm latency overhead for codestral

enables easier debugging of latency issues

* fix(types/utils.py): support _response_ms on hidden params model dump

Fixes issue where 'x-litellm-overhead-duration-ms' wasn't being returned on text c
ompletion calls

* fix(types/utils.py): add '__contains__' support for chatcompletiondeltatool call

Fixes https://github.com/BerriAI/litellm/issues/7099

* fix: fix linting error

* fix: fix linting error
2025-05-27 16:13:44 -07:00
Akim TsvigunandGitHub acaa80294c Integration with Nebius AI Studio added (#11143)
* integration with Nebius AI Studio added

* Merged with main

* Reviewer's comments resolved

* spelling error fixed

* accidental change reverted
2025-05-27 11:05:22 -07:00
Ishaan JaffandGitHub 215fa133d6 [Fix] - Duplicate maxTokens parameter being sent to Bedrock/Claude model with thinking (#11181)
* fix: using thinking with bedrock models

* fix: using thinking with bedrock models
2025-05-27 08:16:39 -07:00
Krrish Dholakia 54fe927da7 test: fix imports 2025-05-26 22:06:53 -07:00
Krrish Dholakia 0017d5f1db build(ui/): Allow empty values in daily agg table + reintroduce 'unassigned' teams in spend tracking 2025-05-26 22:03:34 -07:00
Krish DholakiaandGitHub 066a502b89 Litellm dev 05 26 2025 p1 (#11165)
* fix(utils.py): prevent leaking sensitive keys to langfuse

Fixes https://github.com/BerriAI/litellm/issues/11150

* test(langfuse/): unit test preventing future bedrock key leaks

Fixes https://github.com/BerriAI/litellm/issues/11150

* test(test_langfuse_e2e_test.py): add unit test for vertex - make sure no key leaks occur

* ci(test-litellm.yml): add pytest retry to github workflow

* fix(proxy_server.py): support forwarding `/sso/key/generate` to the server root path url

Fixes https://github.com/BerriAI/litellm/issues/10761

* fix(proxy_server.py): don't rewrite absolute path (PROXY_BASE_URL) with relative path (SERVER_ROOT_PATH)

This causes issues when using a custom path with sso, when doing redirects

* fix(utils.py): ignore token - will mistakenly redact 'max_tokens' as well
2025-05-26 22:00:48 -07:00
Ishaan JaffandGitHub 4d2edc4e7a [Fixes] Aiohttp transport fixes - add handling for aiohttp.ClientPayloadError and ssl_verification settings (#11162)
* fix: AiohttpResponseStream transport

* fix: use AiohttpResponseStream transport by default

* fix: AiohttpResponseStream transport

* fixes: mapping aiohttp exceptions

* fixes: aiohttp rollout

* fixes: add support ssl_verify for aiohttp

* fixes: add support ssl_verify for aiohttp

* fixes: remove duplicates
2025-05-26 21:14:35 -07:00
e606bfe31d [Feat - Contributor PR] Add Video support for Bedrock Converse (#11166)
* feat: add video support for bedrock converse api (#11043)

* fixes: bedrock add video support

* fixes: bedrock add video support

---------

Co-authored-by: yytdfc <fuchen@foxmail.com>
2025-05-26 20:17:07 -07:00
Krish DholakiaandGitHub ef42461c1e Litellm fix GitHub action testing (#11163)
* test: add __init__.py files

* refactor: rename test folder to avoid naming conflict

* test: update workflows

* test: update tests

* test: update imports

* test: update tests

* test: remove unused import

* ci(test-litellm.yml): add pytest retry to github workflow

* test: fix test
2025-05-26 14:41:42 -07:00
k10andGitHub 9a35c41462 added logprobs (#11161) 2025-05-26 11:21:47 -07:00
Ishaan JaffandGitHub 1876b3ae35 [Fix] Rollback to httpx==0.27.0 (#11146)
* fix - fix - use old httpx version

* fix - fix - use old httpx version

* fix: test

* fix: comment
2025-05-26 10:44:11 -07:00
Kyrylo YefimenkoandGitHub f37a1a5854 Fix deprecation_date value for llama groq models (#11151) 2025-05-26 10:43:35 -07:00
Ishaan JaffandGitHub 1009defbdc [Feat] Add /image/edits support for Azure (#11160)
* feat: add image edits on litellm router

* feat: add image edits endpoint

* fix: use pure async for image edits

* fix: base_process_llm_request

* fix: get_image_content_type

* feat: add image edits endpoint

* add image edits on UI

* test: image edits support

* fix: linting errors

* fix: linting errors

* test fix img gen

* feat: azure image edits

* fix: fix url construction of azure image edits

* fix: mock endpoints for azure images
2025-05-26 10:37:48 -07:00
828f9491dd Fix #9295 docker-compose healthcheck test uses curl but curl is not in the image (#9737)
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-05-26 10:19:59 -07:00
Adam HolmbergandGitHub c93a78cd6c feat: Make gemini accept the openai parameter parallel_tool_calls (#11125)
* feat: Make gemini accept the openai parameter parallel_tool_calls

When mapping, allow the parameter: True because that is the
intrinsic behavior of Gemini. Allow False, but reject if there
are multiple tools because there's no actual equivalent in Gemini.

fixes #9686

ref: issues/9686

* chore: cleanup and move test_vertex.py down to tests/litellm

as suggested in https://github.com/BerriAI/litellm/pull/11125#discussion_r2105905871
2025-05-26 07:51:27 -07:00
Ishaan Jaff 77d2615185 docs release notes 2025-05-24 21:24:44 -07:00
Ishaan Jaff 66c44bb9f3 docs notes 2025-05-24 21:00:01 -07:00
Ishaan Jaff c0239a0a79 feat - add code_execution tool to anthropic v1.71.1-nightly v1.71.1-stable 2025-05-24 20:50:09 -07:00
Ishaan Jaff 39c85c22de docs document all config settings 2025-05-24 20:48:09 -07:00
Krish DholakiaandGitHub a78d121ef4 Litellm fix multi instance checks on teams (#11137)
* fix(auth_checks.py): set ttl on in-memory team objects

ensures objects expire

* fix(in_memory_cache.py): allow ttl override if existing ttl expired (no 'get_cache' ever called)
2025-05-24 20:33:06 -07:00
Krrish Dholakia bfbec06214 docs(index.md): cleanup 2025-05-24 19:53:59 -07:00
Ishaan Jaff 95b59cbf4d docs image edits 2025-05-24 19:46:10 -07:00
Ishaan Jaff 7fae80b4c6 docs image edits 2025-05-24 19:44:54 -07:00
Ishaan Jaff cadd86af95 docs image edit 2025-05-24 19:44:20 -07:00
Ishaan Jaff 1637413677 docs image edits 2025-05-24 19:43:48 -07:00
Ishaan Jaff cd3e01ea4a test fixes 2025-05-24 19:27:30 -07:00
Ishaan Jaff 59fd3d5fd9 test test fixes 2025-05-24 19:17:39 -07:00
Krrish Dholakia cb58fc7f6d docs: doc improvements 2025-05-24 19:06:00 -07:00
Ishaan Jaff 16c92c2e61 test fix test_ssl_context_transport 2025-05-24 18:52:23 -07:00
Ishaan Jaff 8a2b68a8d5 ui new build 2025-05-24 18:26:28 -07:00
Krrish Dholakia 061a2a730e docs(managed_finetuning.md): cleanup 2025-05-24 18:21:06 -07:00
Krrish Dholakia 0119c1efaa fix(auth_checks.py): bump in-memory cache ttl for user objects to 60s 2025-05-24 18:11:35 -07:00
Krrish Dholakia f73fca2977 fix(auth_checks.py): set default user in-memory cache to 5s 2025-05-24 18:04:05 -07:00
Krrish Dholakia f71bab3909 fix: fix ruff errors 2025-05-24 17:53:55 -07:00
Krish DholakiaandGitHub 33d5f66387 Litellm revert redis changes (#11135)
* fix: revert user redis changes

* fix(in_memory_cache.py): don't reset ttl, if already set for object

Allows objects to expire and db checks to occur

* test: add unit test for change
2025-05-24 17:52:57 -07:00
Ishaan Jaff 7775e8471c docs benchmarks 2025-05-24 17:43:38 -07:00
Ishaan Jaff 39feb742cd docs aiohttp benchmarks 2025-05-24 17:41:10 -07:00
Ishaan Jaff 85bd3cfca1 fixes 2025-05-24 17:31:57 -07:00
Ishaan Jaff c73ac784d6 docs latest release 2025-05-24 17:31:19 -07:00
Ishaan Jaff c761c0ca2f docs release notes 2025-05-24 17:23:31 -07:00
Ishaan Jaff e957fbf38c docs release notes 2025-05-24 17:17:56 -07:00
Ishaan Jaff db96c8ca53 docs release notes 2025-05-24 17:17:44 -07:00
Ishaan Jaff e7ede28189 notes update 2025-05-24 17:17:30 -07:00
Ishaan JaffandGitHub c3f74b47f8 v1.71.1-stable - notes (#11133)
* draft notes

* fixes anthropic

* fixes release notes
2025-05-24 16:56:25 -07:00
Ishaan JaffandGitHub 9fc8d1c82e [Chore]: feature flag aiohttp transport - users should opt into using aiohttp transport (#11132)
* fix: feature flag aiohttp transport

* fix: feature flag aiohttp transport
2025-05-24 16:29:53 -07:00
Krrish Dholakia c725cbbde6 docs: add managed finetuning docs 2025-05-24 16:14:35 -07:00
Krrish Dholakia 76107bfb6b docs(litellm_managed_files.md): add tutorial on managing file permissions 2025-05-24 14:11:15 -07:00