Commit Graph

24921 Commits

Author SHA1 Message Date
Elias TOURNEUX ef9d1ddc40 feat: Add OVHCloud AI Endpoints as a provider 2025-09-12 13:37:03 +02:00
Krish Dholakia f8036a25a2 Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context
propagate execution context into logging tasks
2025-09-12 00:36:08 -07:00
Krish Dholakia 113d2a8c5a Merge pull request #14459 from holzman/fix-provider-budget
Fix provider budgets
2025-09-12 00:34:52 -07:00
Krish Dholakia 0413a701a2 Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue
fix vertex ai file upload
2025-09-12 00:04:21 -07:00
Ishaan Jaff f374103c46 UI new build 2025-09-11 20:20:52 -07:00
Ishaan Jaff 698a2dd382 fix: convert_anthropic_tool_to_databricks_tool 2025-09-11 20:12:01 -07:00
Ishaan Jaff 32d87c242b [Fixes] Using Qwen API Tiered Pricing (#14479)
* fix: use dashscope cost calc

* add qwen logo
2025-09-11 20:07:41 -07:00
Ishaan Jaff 1e230e87e3 fixes for mypy 2025-09-11 20:05:29 -07:00
Ishaan Jaff 94038108ad fix dashscope api base 2025-09-11 20:00:54 -07:00
Ishaan Jaff 69ef062f55 fix tiered_pricing test 2025-09-11 19:56:44 -07:00
Ishaan Jaff 51d5255452 [Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 (#14475)
* add request body azure img gen

* fix test_get_optional_params_image_gen_filters_empty_values

* test_azure_image_generation_request_body

* test_azure_image_generation_request_body
2025-09-11 19:39:06 -07:00
Ishaan Jaff dda115cc6d [Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471)
* add dashscope logo

* docs fix

* docs fix

* fix supports_batch_calling

* fix naming

* fix input_cost_per_audio_token

* use output_cost_per_reasoning_token

* add tiered_pricing in get_model_info

* test fixes

* fix cost calc

* ruff fix
2025-09-11 18:14:39 -07:00
Krish Dholakia b1025b54fb Merge pull request #14466 from BerriAI/revert-14252-main
Revert "Add additionalProperties to vertex ai Schema definition"
2025-09-11 14:38:57 -07:00
Krish Dholakia 5c3d407b7a Revert "Add additionalProperties to vertex ai Schema definition" 2025-09-11 14:38:25 -07:00
Burt Holzman e9e548d797 Fix provider budgets 2025-09-11 12:08:43 -05:00
Sameer Kankute 090e0fddf4 fix vertex ai file upload 2025-09-11 22:20:54 +05:30
Din ee5a9d0aa0 propagate execution context into logging tasks 2025-09-11 15:54:40 +01:00
Ishaan Jaff 258b674dbb fix deepinfra test 2025-09-10 19:39:23 -07:00
Ishaan Jaff 385206c4bc fix code QA 2025-09-10 19:35:29 -07:00
Ishaan Jaff ea377de5a5 fixes mypy linting 2025-09-10 19:34:35 -07:00
Ishaan Jaff a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392)
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
v1.77.1.dev.2
2025-09-10 19:12:11 -07:00
Ishaan Jaff c09d9e5e8e feat: Validate LiteLLM Virtual Key format (#14428)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-10 18:58:48 -07:00
Ishaan Jaff 1f42e41c8d [Bug]: Fix Authorization header not being sent to configured MCP servers (#14422)
* test: test_mcp_server_config_auth_value_header_used

* fix: authentication_token

* docs: fix instructions on using responses api with MCPs

* mcp fixes
2025-09-10 16:41:08 -07:00
Ishaan Jaff d78ed53cbb fix mypy linting 2025-09-10 16:17:22 -07:00
Ishaan Jaff 199c262e33 EXPERIMENTAL_MULTI_INSTANCE_RATE_LIMITING 2025-09-10 15:55:27 -07:00
Ishaan Jaff d544c6e595 fix DatabricksFunction 2025-09-10 15:52:29 -07:00
Ishaan Jaff dc5650eeda Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421) 2025-09-10 15:47:18 -07:00
Arseny Boykov f3c5a59e57 Revert "Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)" (#14420)
This reverts commit 5b680bb4a3.
2025-09-10 15:46:27 -07:00
Krish Dholakia 037d2380b4 Merge pull request #14410 from BerriAI/krrishdholakia-patch-1
Update README.md
2025-09-10 08:48:48 -07:00
Krish Dholakia 2668112a18 Update README.md 2025-09-10 08:48:37 -07:00
Krish Dholakia 6a47ac15ab Merge pull request #13886 from frankzye/feature/databricks-function-call-missing-pass-description
pass function tool description for databricks provider
2025-09-09 22:42:42 -07:00
Krish Dholakia a80cfe5fb5 Merge branch 'main' into feature/databricks-function-call-missing-pass-description 2025-09-09 22:42:32 -07:00
Krish Dholakia 53bf023876 Merge pull request #14092 from gotsysdba/main
OCI Provder: Update OCIPromptTokensDetails
2025-09-09 22:39:16 -07:00
Krish Dholakia d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia 03a457842d Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
2025-09-09 22:32:40 -07:00
Krish Dholakia e57a05b2dc Merge pull request #14324 from Toy-97/patch-1
update: DeepInfra model data refresh [2025-09-08]
2025-09-09 22:31:44 -07:00
Krish Dholakia b45ce6e4f2 Merge pull request #14374 from dworthen/fix-embedding-with-azure-ad-token-provider
Fix embeddings using azure_ad_token_provider.
2025-09-09 22:21:09 -07:00
Krish Dholakia dde2712ade Merge pull request #14379 from teremterem/main
[Fix] Restore forgotten `raise` keyword in front of an `exception_type()` call
2025-09-09 22:19:58 -07:00
Krish Dholakia 34c5bc7bb0 Merge pull request #14391 from mubashir1osmani/fix_all_docs
added tags to langchain
2025-09-09 22:15:16 -07:00
mubashir1osmani c20a5b0bbd more info for turn_off_logging 2025-09-10 00:51:37 -04:00
Krrish Dholakia a504c7dae3 test: update tests v1.77.1.dev.1 2025-09-09 21:43:37 -07:00
Krrish Dholakia bdd7255bab test: remove redundant tests - moved to parallel_request_limiter_v3.py 2025-09-09 21:35:50 -07:00
mubashir1osmani f51036e092 added tags to langchain 2025-09-10 00:32:26 -04:00
Krrish Dholakia c45ede7187 test: update test 2025-09-09 21:31:34 -07:00
Krrish Dholakia f0de7d1dfd fix: remove EOL model name 2025-09-09 21:15:12 -07:00
Krrish Dholakia d05f58721e test: remove end of life model from tests 2025-09-09 21:01:45 -07:00
Krrish Dholakia e443d01925 test: remove redundant test 2025-09-09 20:37:09 -07:00
Krrish Dholakia bff76715a5 test: skip test with invalid arn 2025-09-09 20:35:44 -07:00
Krrish Dholakia 07a83056a6 test: update test 2025-09-09 20:30:50 -07:00
Krrish Dholakia 44566977f1 test: update test 2025-09-09 20:18:03 -07:00