Commit Graph

4233 Commits

Author SHA1 Message Date
Krrish Dholakia 05e3e3685b docs(forward_client_headers.md): document new forwarding client headers to llm api feature 2025-09-12 19:38:07 -07:00
Krrish Dholakia bdd960c451 docs(admin_ui_sso.md): clarify sso usage on docs 2025-09-12 18:03:03 -07:00
Ishaan Jaff dda115cc6d [Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471)
* add dashscope logo

* docs fix

* docs fix

* fix supports_batch_calling

* fix naming

* fix input_cost_per_audio_token

* use output_cost_per_reasoning_token

* add tiered_pricing in get_model_info

* test fixes

* fix cost calc

* ruff fix
2025-09-11 18:14:39 -07:00
Ishaan Jaff a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392)
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
2025-09-10 19:12:11 -07:00
Ishaan Jaff 1f42e41c8d [Bug]: Fix Authorization header not being sent to configured MCP servers (#14422)
* test: test_mcp_server_config_auth_value_header_used

* fix: authentication_token

* docs: fix instructions on using responses api with MCPs

* mcp fixes
2025-09-10 16:41:08 -07:00
Ishaan Jaff 199c262e33 EXPERIMENTAL_MULTI_INSTANCE_RATE_LIMITING 2025-09-10 15:55:27 -07:00
Krish Dholakia d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
2025-09-09 22:35:30 -07:00
Krish Dholakia 34c5bc7bb0 Merge pull request #14391 from mubashir1osmani/fix_all_docs
added tags to langchain
2025-09-09 22:15:16 -07:00
mubashir1osmani c20a5b0bbd more info for turn_off_logging 2025-09-10 00:51:37 -04:00
mubashir1osmani f51036e092 added tags to langchain 2025-09-10 00:32:26 -04:00
Krrish Dholakia 98444a900b fix(config_settings.md): document new env var 2025-09-09 19:25:38 -07:00
Krish Dholakia b9ce3a1587 Merge pull request #12416 from dotmobo/feature/fix-alloy
feat: add a health_check_voice parameter in model_info
2025-09-08 23:12:48 -07:00
Krish Dholakia 5ab091f1a4 Merge pull request #14335 from TeddyAmkie/custom-sso-doc-update
Scim docs updated with user removal behavior
2025-09-08 19:04:45 -07:00
Ishaan Jaff ddfbf7c36c docs v1.76.3 2025-09-08 18:37:28 -07:00
Ishaan Jaff 68d250973c [Feature]: Support "Token" MCPAuth (#14359)
* add MCPAuth.authorization type

* test: Token Auth MCP

* fix: _get_auth_headers to handle auth_type == MCPAuth.authorization

* docs auth types with MCP on config.yaml

* test_mcp_server_works_without_config_auth_value
2025-09-08 18:25:41 -07:00
Ishaan Jaff af751a61dd docs fix 2025-09-08 18:07:33 -07:00
Boopesh Shanmugam f8cb06db60 Changed the model field in the response format to open AI matching the default request (#14354) 2025-09-08 13:45:30 -07:00
Zhengyi Lai 8a77fb4da1 Update docker_quick_start.md (#14322) 2025-09-08 12:58:13 -07:00
berri-teddy a09613edfd Scim docs updated with user removal behavior 2025-09-08 09:20:00 -07:00
Dharamendra Kumar 92596e48fe Merge branch 'main' into feature/aiohttp-dependency-injection 2025-09-07 17:54:55 -07:00
Dharamendra Kumar 009106def0 docs for custom aiohttp session 2025-09-07 17:42:26 -07:00
Krish Dholakia ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish Dholakia d2f02a55b9 Merge pull request #14308 from mubashir1osmani/main
docs: moved custom spend tags
2025-09-06 21:58:20 -07:00
mubashir1osmani b9be68cc45 spend tracking details 2025-09-06 22:24:49 -04:00
mubashir1osmani 2095fe3c98 moved custom spend tags 2025-09-06 22:14:52 -04:00
mubashir1osmani 976967f1e0 Revert "docs: moved custom spend tags metadata to spend tracking"
This reverts commit d1eb87a1e6.
2025-09-06 22:12:16 -04:00
mubashir1osmani d1eb87a1e6 docs: moved custom spend tags metadata to spend tracking 2025-09-06 22:09:03 -04:00
mubashir1osmani 2674c49283 added spend tags 2025-09-06 21:59:45 -04:00
Krish Dholakia a3ffc3060e Merge branch 'main' into litellm_dev_09_01_2025_p1 2025-09-06 18:50:49 -07:00
Krish Dholakia b8fdbd479b Merge pull request #13931 from BerriAI/litellm_release_notes_08_23_2025
docs(index.md): initial commit with release notes
2025-09-06 18:48:44 -07:00
Krish Dholakia f7810eec79 Merge pull request #14299 from TeddyAmkie/docs-update-clean
Doc Updates 9-5-25
2025-09-06 18:47:18 -07:00
Krrish Dholakia 05dfad8837 docs: add basic setup to ui contribution doc 2025-09-06 18:03:17 -07:00
Ishaan Jaff 71ce338b24 docs fix 2025-09-06 16:07:02 -07:00
Ishaan Jaff 0754ad9e02 docs fix 2025-09-06 16:01:03 -07:00
Ishaan Jaff 6533ce45a5 docs fix 2025-09-06 16:00:46 -07:00
Ishaan Jaff 0d5bc894f2 fixes 2025-09-06 15:59:35 -07:00
Ishaan Jaff 2d5868b18d 1.76.3 2025-09-06 15:49:10 -07:00
berri-teddy 3268f1cac6 fix: correct tabs in load_balancing.md 2025-09-06 15:20:40 -07:00
Ishaan Jaff 66860efd5d docs config settings 2025-09-06 14:24:18 -07:00
Ishaan Jaff 8920a645e9 Revert "feat: add redis ssl and username support (#11319)" (#14303)
This reverts commit 31f806f7d0.
2025-09-06 14:01:00 -07:00
Krrish Dholakia 7a083750ce refactor: remove 'input_fidelity' from image gen -> it's a image_edit param 2025-09-06 12:14:27 -07:00
Krish Dholakia 943f6a38ed Merge pull request #14300 from eycjur/gpt-oss-reasoning-effort-mapping
Bug fix for openai.gpt-oss when using reasoning_effort parameter
2025-09-06 09:13:03 -07:00
Ishaan Jaff 29e410b04c docs Video Walkthrough claude code 2025-09-06 09:12:30 -07:00
Mubashir Osmani cb117647fc [docs]: added loom for claude code (#14223)
* added loom for claude code

* docs: add web search models

* added new loom
2025-09-06 09:09:22 -07:00
eycjur b472bf6aef update docs 2025-09-06 21:15:59 +09:00
Teddy Amkie 28545966f5 docs: update access control and load balancing documentation 2025-09-05 22:17:06 -07:00
Teddy Amkie 72b8db6484 docs: update admin UI branding section and add admin settings UI images 2025-09-05 22:15:25 -07:00
Teddy Amkie 3d7ee67aaa docs: clarify and improve logo customization section in admin UI docs (side-by-side images, explanation) 2025-09-05 22:15:25 -07:00
Teddy Amkie e73c558533 docs: clarify users can be on many teams 2025-09-05 22:15:25 -07:00
Ishaan Jaff 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296)
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
2025-09-05 21:29:41 -07:00