Commit Graph

325 Commits

Author SHA1 Message Date
Ishaan Jaff 9a6d5c119e feat: Allow Adding MCP Servers Through LiteLLM UI (#11208)
* feat: MCP Servers with CRUD operations (#10699)

* feat: mcp CRUD operations with authn/authz

* feat: mcp server UI

* mcp server page with overview, mcp tools, and settings page

* Adding MCP Server flow

* prisma generate before test

* UI callbacks add/remove with api server refetch

* test fix: poetry run prisma

* feat: mcp server db and config connection

* fix: MCPTool filter on description when not present

* feat: mcp on UI and integrated with list tools

* feat: Update mcp server endpoint

* tests: Unit and integration tests for mcp management endpoints

* fix: docs and ensuring global_mcp_manage up to date

* ui: remove the mcp tools view

* fix: ruff lint

* fix: unit -> integration test area

* fix(ui): remove left nav menu of previous tools

---------

Co-authored-by: wagnerjt <wagnerjt@github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* fix: sync DB MCP tools with in memory

* fix: sync DB MCP tools with in memory

* fix: stop using prisma.models

* fix: code qa check

* fix: import MCP

* fix: code QA checks

* fix: code QA checks

* fixes - only list tools for the specific MCP server

* fix: only list MCP tools for selected server

* fix linting error

---------

Co-authored-by: Tyler Wagner <wagnerjt@users.noreply.github.com>
Co-authored-by: wagnerjt <wagnerjt@github.com>
2025-05-28 16:29:27 -07:00
Krish Dholakia 4c82dd9b27 Ollama Chat - parse tool calls on streaming (#11171)
* fix(user_api_key_auth.py): fix else block

Fixes https://github.com/BerriAI/litellm/issues/11170

* refactor(ollama/chat): refactor to base config pattern

easier to maintain fixes

* fix(ollama/chat): support tool call parsing on streaming

Closes https://github.com/BerriAI/litellm/issues/11104

* test: update import location

* fix: cleanup unused import

* fix: fix ruff check error

* test: update import

* test: update test on ci

* ci: cleanup

* fix: fix chekc

* fix: fix api key check order

* test: fix import

* ci: fix script

* test: fix imports

* fix: fix tests
2025-05-27 16:14:49 -07:00
Krish Dholakia ef42461c1e Litellm fix GitHub action testing (#11163)
* test: add __init__.py files

* refactor: rename test folder to avoid naming conflict

* test: update workflows

* test: update tests

* test: update imports

* test: update tests

* test: remove unused import

* ci(test-litellm.yml): add pytest retry to github workflow

* test: fix test
2025-05-26 14:41:42 -07:00
Kreato 2e0dcedac0 Proper github images (#10927)
* feat: add seperate image URLs to distinguish types of release

* feat: remove new nightly/dev image URLs, only keep stable
2025-05-23 12:38:00 -07:00
Ishaan Jaff 329e69f610 Update feature_request.yml (#11078) 2025-05-22 21:42:12 -07:00
Ishaan Jaff ae33113908 Update feature_request.yml 2025-05-22 21:39:13 -07:00
Ishaan Jaff dd4a65b83a Feat: add MCP to Responses API and bump openai python sdk (#11029)
* feat: add MCP to responses API

* feat: bump openai version to 1.75.0

* docs MCP + responses API

* fixes: type checking

* fixes: type checking

* build: use latest openai 1.81.0

* fix: linting error

* fix: linting error

* fix: test

* fix: linting errors

* fix: test

* fix: test

* fix: linting

* Revert "fix: linting"

This reverts commit ebb19ff8cb1f8fcc3e224390e351676daccb33de.

* fix: linting
2025-05-22 07:24:10 -07:00
Ishaan Jaff faed9860c0 [Refactor] Move enterprise_routes within litellm_enterprise (#10860)
* fix: move enterprise routes to litellm_enterprise

* refactor: move enterprise routes to litellm_enterprise

* fix: litellm_enterprise routes

* fix test litellm on github workflow
2025-05-15 10:34:26 -07:00
Zoltan K 91dcc50768 Github: Increase timeout of litellm tests (#10568) 2025-05-05 12:37:04 -07:00
Krish Dholakia 9cc39af131 Add vertex ai meta llama 4 support + handle tool call result in content for vertex ai (#10492)
* refactor(vertex_ai/llama): handle response transformation within config

Allows us to handle https://github.com/BerriAI/litellm/issues/10441#issuecomment-2844975599

* fix(vertex_ai/llama): handle tool call in content

Fixes https://github.com/BerriAI/litellm/issues/10441

* fix(vertex_ai/llama): return 'tool_calls' as finish reason if tool call returned

vertex ai returns stop

* feat(vertex_ai/): cost tracking for vertex_ai/meta/llama-4

* ci(test-linting.yml): pin openai version

* build: reorder pinning

* ci(pyproject.toml): limit openai version

temporary patch as new version has linting errors

* ci(pyproject.toml): limit openai version

temporary patch around linting errors

* ci(limit-openai-version): temporary patch

* fix: fix linting errors

* fix: fix linting error

* fix(parallel_request_limiter_v2.py): add team based multi-instance rate limiting

* fix: fix linting errors

* build(pyproject.toml): modify pin

* ci: bump pin
2025-05-01 22:47:06 -07:00
Krrish Dholakia 4e44d7f40c ci(test-linting.yml): pin openai version 2025-05-01 18:55:39 -07:00
user202729 b482618456 docs: Fix link formatting in GitHub PR template (#10417) 2025-04-29 17:23:53 -07:00
Ishaan Jaff faf54e3f29 fixes for EE image 2025-04-26 15:43:21 -07:00
Ishaan Jaff fd3603d4e8 deploy - add build-and-push-image-ee 2025-04-26 14:40:20 -07:00
Krrish Dholakia 611afaf2ab ci(test-linting.yml): update to run black formatting 2025-03-31 17:03:59 -07:00
Krish Dholakia 9b7ebb6a7d build(pyproject.toml): add new dev dependencies - for type checking (#9631)
* build(pyproject.toml): add new dev dependencies - for type checking

* build: reformat files to fit black

* ci: reformat to fit black

* ci(test-litellm.yml): make tests run clear

* build(pyproject.toml): add ruff

* fix: fix ruff checks

* build(mypy/): fix mypy linting errors

* fix(hashicorp_secret_manager.py): fix passing cert for tls auth

* build(mypy/): resolve all mypy errors

* test: update test

* fix: fix black formatting

* build(pre-commit-config.yaml): use poetry run black

* fix(proxy_server.py): fix linting error

* fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
Krish Dholakia 0865e52db3 fix(proxy_server.py): get master key from environment, if not set in … (#9617)
* fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all

* test: mark flaky test

* test(test_proxy_server.py): mock prisma client

* ci: add new github workflow for testing just the mock tests

* fix: fix linting error

* ci(conftest.py): add conftest.py to isolate proxy tests

* build(pyproject.toml): add respx to dev dependencies

* build(pyproject.toml): add prisma to dev dependencies

* test: fix mock prompt management tests to use a mock anthropic key

* ci(test-litellm.yml): parallelize mock testing

make it run faster

* build(pyproject.toml): add hypercorn as dev dep

* build(pyproject.toml): separate proxy vs. core dev dependencies

make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn

* ci(test-litellm.yml): pin python version

* test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing

* ci: add thank you message to ci

* test: add mock env var to test

* test: add autouse to tests

* test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
Krrish Dholakia 24b3e80eba ci: update github action 2025-03-25 23:11:45 -07:00
Krish Dholakia 6cd6ff801f ci(publish-migrations.yml): add action for publishing prisma db migrations (#9537) 2025-03-25 17:55:59 -07:00
Krrish Dholakia 58f46d847c build: update pull_request_template.md 2025-03-21 16:20:28 -07:00
Ishaan Jaff 165b1887bd fix docker img deploy - deploy stable releases from main-stable 2025-03-15 20:34:32 -07:00
Ishaan Jaff f5e9211c1b fix ghcr build 2025-03-15 20:14:04 -07:00
Ishaan Jaff 4f898c9f48 fix ghcr deploy 2025-03-15 19:37:09 -07:00
Ishaan Jaff df7efa17f8 fix docker img tag displayed on stable releases 2025-03-15 13:46:30 -07:00
Krish Dholakia 12b37d2eee Merge pull request #9068 from mknet3/helm-unittest
ci: add helm unittest
2025-03-11 10:10:44 -07:00
Cole McIntosh 07813645e0 docs(pr-template): update unit test command in checklist 2025-03-10 20:18:46 -06:00
Ishaan Jaff ce35240273 Pre-Submission checklist 2025-03-10 16:21:53 -07:00
Ishaan Jaff 8198bc2862 Pre-Submission checklist 2025-03-10 15:49:18 -07:00
Manuel Cañete fb4ebf0fd4 ci: add helm unittest 2025-03-08 01:29:25 +01:00
Ishaan Jaff 4032838408 fix load tests on litellm release notes 2025-02-26 19:11:43 -08:00
Ishaan Jaff bca6e37c24 fix _get_docker_run_command_stable_release 2025-02-25 19:11:30 -08:00
Ishaan Jaff bfae5c4161 fix naming docker stable release 2025-02-11 20:53:52 -08:00
Ishaan Jaff 022917b7b5 fix stale issue mgmt 2025-01-27 18:56:02 -08:00
Ishaan Jaff c1a1c052f0 fix stale issue mgmt 2025-01-27 18:53:59 -08:00
Ishaan Jaff 02edf191a3 action for stale (#8045) 2025-01-27 18:50:58 -08:00
Krrish Dholakia ed1e3e9dc1 ci(reset_stable.yml): fix to run on release created events 2024-12-28 19:53:18 -08:00
Marcos Cannabrava c0a7e8352f docs: cleanup docker compose comments (#7414)
* docs: cleanup docker compose comments

* pr template: fix typo
2024-12-25 16:10:31 -08:00
Krrish Dholakia bb9171e037 ci(reset_stable.yml): modify to work with all kinds of releases 2024-12-21 12:13:26 -08:00
Krrish Dholakia 741500e089 build(reset_stable.yml): rename branch to 'litellm_stable_release_branch'
use this branch to trigger load test / other workflows for stable releases
2024-12-19 17:43:37 -08:00
Krrish Dholakia 19e67b8c0e build(reset_stable.yml): add new workflow to reset litellm_stable to latest release 2024-12-19 17:36:58 -08:00
Ishaan Jaff c7f14e936a (code quality) run ruff rule to ban unused imports (#7313)
* remove unused imports

* fix AmazonConverseConfig

* fix test

* fix import

* ruff check fixes

* test fixes

* fix testing

* fix imports
2024-12-19 12:33:42 -08:00
Krrish Dholakia 7d26c1ab6b ci: fix order of question on issue template 2024-12-03 12:27:55 -08:00
Krrish Dholakia e5e49f5c49 build: fix test 2024-12-03 12:25:36 -08:00
Krrish Dholakia 7ecbc3beec build(label-mlops.yml): fix check 2024-12-03 12:23:31 -08:00
Krrish Dholakia 445ba4de73 build(label-mlops.yml): add tag to mlops user requests 2024-12-03 12:20:48 -08:00
Ishaan Jaff fd2d4254bc Update bug_report.yml 2024-12-02 16:27:35 -08:00
Ishaan Jaff 0e517a8570 Update bug_report.yml 2024-12-02 16:27:18 -08:00
Ishaan Jaff aa3269839d Update bug_report.yml 2024-12-02 16:25:40 -08:00
Ishaan Jaff ad980461a9 Update feature_request.yml 2024-12-02 16:25:28 -08:00
Ishaan Jaff f7a23aee44 Update bug_report.yml 2024-12-02 16:24:49 -08:00