Commit Graph
24460 Commits
Author SHA1 Message Date
Ishaan Jaff fd39f22e3e test_completion_openrouter_reasoning_content 2025-08-30 09:27:37 -07:00
superpoussin22andGitHub 7ed4a84393 Fix indentation in get_llm_provider_logic.py (#14088)
* Fix indentation in get_llm_provider_logic.py

fix missing closing )

* Fix indentation in get_llm_provider_logic.py

fix typo
2025-08-30 09:24:41 -07:00
Krish DholakiaandGitHub 4d0c1a1769 Merge pull request #13144 from joshualipman123/add-vercel-ai-gateway-provider
Add Vercel AI Gateway provider
2025-08-29 22:27:20 -07:00
Krish DholakiaandGitHub 8b11452d9e Merge branch 'main' into add-vercel-ai-gateway-provider 2025-08-29 22:27:08 -07:00
Krish DholakiaandGitHub ead7e7259b Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token
[Bug]: Set user from token user_id for OpenMeter integration
2025-08-29 22:21:26 -07:00
Krish DholakiaandGitHub 85640e57cd Merge pull request #14075 from BerriAI/fix-collapsible-nav
Fix collapsible navbar design
2025-08-29 22:16:25 -07:00
Krish DholakiaandGitHub 75c327cb9e Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
Bedrock fix structure output
2025-08-29 22:04:51 -07:00
Krish DholakiaandGitHub afa687182a Merge pull request #14026 from TomeHirata/citation-supported-text
Add supported text field to anthropic citation response
2025-08-29 22:02:18 -07:00
Krrish Dholakia 55186dad4c fix: fix linting error 2025-08-29 21:53:37 -07:00
Ishaan Jaff 562790cb31 fix: /v1/realtime check 2025-08-29 18:38:14 -07:00
Ishaan JaffandGitHub 37d885e46a [Fix] LiteLLM does not support new web_search tool (Responses API) (#14083)
* test_basic_openai_responses_with_websearch

* fix: ResponsesAPIResponse

* fix: StandardBuiltInToolCostTracking
2025-08-29 18:33:52 -07:00
Ishaan JaffandGitHub d9ca0f9300 security: fix next js version (#14084) 2025-08-29 18:09:11 -07:00
Ishaan JaffandGitHub be86861eb8 feat: add gpt-realtime models - gpt-realtime (#14082)
* feat: add gpt-realtime models

* add input_cost_per_image
2025-08-29 17:49:47 -07:00
6d81d75948 docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable (#14079)
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 17:38:50 -07:00
Ishaan JaffandGitHub 5ee7a675f2 [Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 (#14078)
* fix: _supports_frequency_penalty

* _supports_frequency_penalty

* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Mubashir OsmaniandGitHub 38df2500b6 docs: usaged-based routing perf warnings (#14080) 2025-08-29 17:31:12 -07:00
Krrish Dholakia 86c5de17bc fix(handle_jwt.py): document the raw received jwt token 2025-08-29 14:53:07 -07:00
Ishaan JaffandGitHub 607f425cc6 [Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default (#14053)
* fix DeepInfraConfig

* track supports reasoning

* fix: get_supported_openai_params

* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
Carson GeeandGitHub e74f1b6b62 Added DataRobot provider to sidebar (#14074) 2025-08-29 13:15:33 -07:00
Ishaan JaffandGitHub 6edc5c18de fix: RPS don't print the request params by default (#14015) 2025-08-29 12:06:54 -07:00
Teddy AmkieandGitHub 7f5c92ddeb Update docs for stream_timeout and timeout (#14073) 2025-08-29 09:59:07 -07:00
tanjiro 14d19a4d72 adjust padding on the screen 2025-08-30 01:45:42 +09:00
tanjiro 9682f76474 move the menu button to top nav+ change the icon size 2025-08-30 01:34:30 +09:00
Krish DholakiaandGitHub bcd38dde2e Merge pull request #14036 from gotsysdba/main
OCI Provider: add oci_key_file as an optional_parameter
2025-08-29 06:27:09 -07:00
Krish DholakiaandGitHub 7513bec0e9 Merge pull request #14037 from NoWall57/feature/force-anthropic-custom-api-base-readme
docs: add documentation for LITELLM_ANTHROPIC_DISABLE_URL_SUFFIX envi…
2025-08-29 06:26:11 -07:00
Krish DholakiaandGitHub f73b9da2cd Merge pull request #14040 from dmvieira/main
Fix error saving latency as timedelta on Redis
2025-08-29 06:25:43 -07:00
Krish DholakiaandGitHub c4f60f1a06 Merge pull request #14038 from datarobot-forks/carsongee/add_docs
📖 Add DataRobot to the provider documentation.
2025-08-29 06:25:13 -07:00
Krish DholakiaandGitHub 38a7c8a560 Merge pull request #14041 from Const-antine/litellm_helm_custom_configmap
[Helm charts] Enhance proxy_config configuration: add support for existing configmap
2025-08-29 06:24:57 -07:00
Krish DholakiaandGitHub fffccc0675 Merge pull request #14042 from WilsonSunBritten/10988-set-truncation-threshold
Allow configuration to set threshold before request entry in spend log gets truncated
2025-08-29 06:24:28 -07:00
Krish DholakiaandGitHub dd33e3f928 Merge pull request #14050 from lmwang9527/fix/logging-worker-graceful-shutdown
Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
2025-08-29 06:23:53 -07:00
Carson GeeandNate Goudreault f90072b226 Apply suggestions from code review
Co-authored-by: Nate Goudreault <50588929+nate-goudreault@users.noreply.github.com>
2025-08-28 23:00:09 -06:00
Carson Gee bf55bf5072 Update datarobot.md 2025-08-28 23:00:09 -06:00
mjnitz02andCarson Gee 5c73b17387 Add initial docs 2025-08-28 23:00:09 -06:00
Ishaan JaffandGitHub 81db36c06c add xai/grok-code-fast (#14054) 2025-08-28 18:10:04 -07:00
Ishaan JaffandGitHub 3fe05b300a fix - use import fastuuid as uuid (#14016) 2025-08-28 17:57:46 -07:00
WilsonSunBritten b3edff02e8 fix mock tests 2025-08-28 17:40:16 -06:00
WilsonSunBritten 8bf2fe2991 attempt to fix unrelated lint error 2025-08-28 17:21:17 -06:00
WilsonSunBritten e6ba9b4c91 lint fix 2025-08-28 17:12:48 -06:00
WilsonSunBritten 4ea92d96cb lint fix 2025-08-28 17:11:50 -06:00
WilsonSunBritten 0721345703 Switch to string constant based truncation 2025-08-28 16:28:36 -06:00
Ishaan JaffandGitHub f3338bef9f [MCP] Bug fix - adding SSE MCP tools - fix connection test when adding MCPs (#14048)
* fix: _execute_with_mcp_client

* add warning for SSE MCP

* docs - MCP videos / guides
2025-08-28 15:16:34 -07:00
Ishaan JaffandGitHub 37a599932d [Bug Fix] Virtual keys with llm_api type cause Internal Server Error when using /anthropic/* and other llm passthrough routes (#14046)
* fix route checks passthrough_routes_wildcard

* refactor check_route_access

* test_virtual_key_llm_api_route_includes_passthrough_prefix
2025-08-28 15:14:09 -07:00
WilsonSunBritten 026480358b Revert "Allow configuration to on what threshold to try truncating request content in db"
This reverts commit 771052d67d.
2025-08-28 16:12:42 -06:00
lmwang 6760a6aaa1 Fix LoggingWorker graceful shutdown to prevent CancelledError warnings
- Change exception logging to debug level during shutdown cancellation
- Add clear_queue() call to process remaining coroutines during shutdown
- Prevents 'RuntimeWarning: coroutine was never awaited' messages
- Add comprehensive tests for graceful shutdown behavior

Fixes #13970
2025-08-28 14:15:17 -07:00
Const-antine f8d1e03450 rework tests 2025-08-28 13:39:09 -04:00
Const-antine 1350336515 fix tests 2025-08-28 13:30:11 -04:00
Const-antine d3b526041f better formatting 2025-08-28 13:18:36 -04:00
Const-antine 730e9c90a2 fix formatting 2025-08-28 13:18:33 -04:00
Const-antine 5d973ea06e update readme 2025-08-28 13:18:26 -04:00
Const-antine 409429ddd6 add new tests 2025-08-28 13:18:23 -04:00