dd4a65b83a
Feat: add MCP to Responses API and bump openai python sdk ( #11029 )
...
* feat: add MCP to responses API
* feat: bump openai version to 1.75.0
* docs MCP + responses API
* fixes: type checking
* fixes: type checking
* build: use latest openai 1.81.0
* fix: linting error
* fix: linting error
* fix: test
* fix: linting errors
* fix: test
* fix: test
* fix: linting
* Revert "fix: linting"
This reverts commit ebb19ff8cb1f8fcc3e224390e351676daccb33de.
* fix: linting
2025-05-22 07:24:10 -07:00
faed9860c0
[Refactor] Move enterprise_routes within litellm_enterprise ( #10860 )
...
* fix: move enterprise routes to litellm_enterprise
* refactor: move enterprise routes to litellm_enterprise
* fix: litellm_enterprise routes
* fix test litellm on github workflow
2025-05-15 10:34:26 -07:00
91dcc50768
Github: Increase timeout of litellm tests ( #10568 )
2025-05-05 12:37:04 -07:00
9cc39af131
Add vertex ai meta llama 4 support + handle tool call result in content for vertex ai ( #10492 )
...
* refactor(vertex_ai/llama): handle response transformation within config
Allows us to handle https://github.com/BerriAI/litellm/issues/10441#issuecomment-2844975599
* fix(vertex_ai/llama): handle tool call in content
Fixes https://github.com/BerriAI/litellm/issues/10441
* fix(vertex_ai/llama): return 'tool_calls' as finish reason if tool call returned
vertex ai returns stop
* feat(vertex_ai/): cost tracking for vertex_ai/meta/llama-4
* ci(test-linting.yml): pin openai version
* build: reorder pinning
* ci(pyproject.toml): limit openai version
temporary patch as new version has linting errors
* ci(pyproject.toml): limit openai version
temporary patch around linting errors
* ci(limit-openai-version): temporary patch
* fix: fix linting errors
* fix: fix linting error
* fix(parallel_request_limiter_v2.py): add team based multi-instance rate limiting
* fix: fix linting errors
* build(pyproject.toml): modify pin
* ci: bump pin
2025-05-01 22:47:06 -07:00
4e44d7f40c
ci(test-linting.yml): pin openai version
2025-05-01 18:55:39 -07:00
b482618456
docs: Fix link formatting in GitHub PR template ( #10417 )
2025-04-29 17:23:53 -07:00
faf54e3f29
fixes for EE image
2025-04-26 15:43:21 -07:00
fd3603d4e8
deploy - add build-and-push-image-ee
2025-04-26 14:40:20 -07:00
611afaf2ab
ci(test-linting.yml): update to run black formatting
2025-03-31 17:03:59 -07:00
9b7ebb6a7d
build(pyproject.toml): add new dev dependencies - for type checking ( #9631 )
...
* build(pyproject.toml): add new dev dependencies - for type checking
* build: reformat files to fit black
* ci: reformat to fit black
* ci(test-litellm.yml): make tests run clear
* build(pyproject.toml): add ruff
* fix: fix ruff checks
* build(mypy/): fix mypy linting errors
* fix(hashicorp_secret_manager.py): fix passing cert for tls auth
* build(mypy/): resolve all mypy errors
* test: update test
* fix: fix black formatting
* build(pre-commit-config.yaml): use poetry run black
* fix(proxy_server.py): fix linting error
* fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
0865e52db3
fix(proxy_server.py): get master key from environment, if not set in … ( #9617 )
...
* fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all
* test: mark flaky test
* test(test_proxy_server.py): mock prisma client
* ci: add new github workflow for testing just the mock tests
* fix: fix linting error
* ci(conftest.py): add conftest.py to isolate proxy tests
* build(pyproject.toml): add respx to dev dependencies
* build(pyproject.toml): add prisma to dev dependencies
* test: fix mock prompt management tests to use a mock anthropic key
* ci(test-litellm.yml): parallelize mock testing
make it run faster
* build(pyproject.toml): add hypercorn as dev dep
* build(pyproject.toml): separate proxy vs. core dev dependencies
make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn
* ci(test-litellm.yml): pin python version
* test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing
* ci: add thank you message to ci
* test: add mock env var to test
* test: add autouse to tests
* test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
24b3e80eba
ci: update github action
2025-03-25 23:11:45 -07:00
6cd6ff801f
ci(publish-migrations.yml): add action for publishing prisma db migrations ( #9537 )
2025-03-25 17:55:59 -07:00
58f46d847c
build: update pull_request_template.md
2025-03-21 16:20:28 -07:00
165b1887bd
fix docker img deploy - deploy stable releases from main-stable
2025-03-15 20:34:32 -07:00
f5e9211c1b
fix ghcr build
2025-03-15 20:14:04 -07:00
4f898c9f48
fix ghcr deploy
2025-03-15 19:37:09 -07:00
df7efa17f8
fix docker img tag displayed on stable releases
2025-03-15 13:46:30 -07:00
12b37d2eee
Merge pull request #9068 from mknet3/helm-unittest
...
ci: add helm unittest
2025-03-11 10:10:44 -07:00
07813645e0
docs(pr-template): update unit test command in checklist
2025-03-10 20:18:46 -06:00
ce35240273
Pre-Submission checklist
2025-03-10 16:21:53 -07:00
8198bc2862
Pre-Submission checklist
2025-03-10 15:49:18 -07:00
fb4ebf0fd4
ci: add helm unittest
2025-03-08 01:29:25 +01:00
4032838408
fix load tests on litellm release notes
2025-02-26 19:11:43 -08:00
bca6e37c24
fix _get_docker_run_command_stable_release
2025-02-25 19:11:30 -08:00
bfae5c4161
fix naming docker stable release
2025-02-11 20:53:52 -08:00
022917b7b5
fix stale issue mgmt
2025-01-27 18:56:02 -08:00
c1a1c052f0
fix stale issue mgmt
2025-01-27 18:53:59 -08:00
02edf191a3
action for stale ( #8045 )
2025-01-27 18:50:58 -08:00
ed1e3e9dc1
ci(reset_stable.yml): fix to run on release created events
2024-12-28 19:53:18 -08:00
c0a7e8352f
docs: cleanup docker compose comments ( #7414 )
...
* docs: cleanup docker compose comments
* pr template: fix typo
2024-12-25 16:10:31 -08:00
bb9171e037
ci(reset_stable.yml): modify to work with all kinds of releases
2024-12-21 12:13:26 -08:00
741500e089
build(reset_stable.yml): rename branch to 'litellm_stable_release_branch'
...
use this branch to trigger load test / other workflows for stable releases
2024-12-19 17:43:37 -08:00
19e67b8c0e
build(reset_stable.yml): add new workflow to reset litellm_stable to latest release
2024-12-19 17:36:58 -08:00
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
7d26c1ab6b
ci: fix order of question on issue template
2024-12-03 12:27:55 -08:00
e5e49f5c49
build: fix test
2024-12-03 12:25:36 -08:00
7ecbc3beec
build(label-mlops.yml): fix check
2024-12-03 12:23:31 -08:00
445ba4de73
build(label-mlops.yml): add tag to mlops user requests
2024-12-03 12:20:48 -08:00
fd2d4254bc
Update bug_report.yml
2024-12-02 16:27:35 -08:00
0e517a8570
Update bug_report.yml
2024-12-02 16:27:18 -08:00
aa3269839d
Update bug_report.yml
2024-12-02 16:25:40 -08:00
ad980461a9
Update feature_request.yml
2024-12-02 16:25:28 -08:00
f7a23aee44
Update bug_report.yml
2024-12-02 16:24:49 -08:00
5fdd1de22a
Update feature_request.yml
2024-12-02 16:23:41 -08:00
47159f1b57
Update feature_request.yml
2024-12-02 16:23:25 -08:00
6464681b68
Update feature_request.yml
2024-12-02 16:22:06 -08:00
66c1ee09cf
ci: remove redundant lint.yml workflow ( #6622 )
2024-11-07 01:05:58 +05:30
45ff74ae81
fix flake8 checks
2024-11-06 10:45:58 -08:00
cc8dd80209
allow configuring httpx hooks for AsyncHTTPHandler ( #6290 ) ( #6415 )
...
* allow configuring httpx hooks for AsyncHTTPHandler (#6290 )
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
* Fixes and minor improvements for Helm Chart (#6402 )
* reckoner hack
* fix default
* add extracontainers option
* revert chart
* fix extracontainers
* fix deployment
* remove init container
* update docs
* add helm lint to deploy step
* change name
* (refactor) prometheus async_log_success_event to be under 100 LOC (#6416 )
* unit testig for prometheus
* unit testing for success metrics
* use 1 helper for _increment_token_metrics
* use helper for _increment_remaining_budget_metrics
* use _increment_remaining_budget_metrics
* use _increment_top_level_request_and_spend_metrics
* use helper for _set_latency_metrics
* remove noqa violation
* fix test prometheus
* test prometheus
* unit testing for all prometheus helper functions
* fix prom unit tests
* fix unit tests prometheus
* fix unit test prom
* (refactor) router - use static methods for client init utils (#6420 )
* use InitalizeOpenAISDKClient
* use InitalizeOpenAISDKClient static method
* fix # noqa: PLR0915
* (code cleanup) remove unused and undocumented logging integrations - litedebugger, berrispend (#6406 )
* code cleanup remove unused and undocumented code files
* fix unused logging integrations cleanup
* update chart version
* add circleci tests
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev >
* fix: fix linting error
* fix(http_handler.py): fix linting error
---------
Co-authored-by: Alejandro Rodríguez <alejorro70@gmail.com >
Co-authored-by: Robert Brennan <accounts@rbren.io >
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
Co-authored-by: Xingyao Wang <xingyao@all-hands.dev >
2024-10-24 22:00:24 -07:00
Ishaan Jaff