tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-14 00:23:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
22,736 Commits 2,072 Branches 1,425 Tags
cfee865f165627a9f55d0d4762bbf6d4e2b3f2f2
Commit Graph
22736 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff cfee865f16 fix test MCP 2025-06-20 12:09:45 -07:00
Ishaan JaffandGitHub 19f13c842f add gemini-2.5-pro (#11927) 2025-06-20 11:29:06 -07:00
Krish DholakiaandGitHub cf83b541e5 Volcengine - thinking param support + Azure - handle more gpt custom naming patterns (#11914) 
* fix(volcengine.py): add thinking param support

Closes https://github.com/BerriAI/litellm/issues/11879

* fix(gpt_transformation.py): handle azure custom names - e.g. `gpt-4-1`

Closes https://github.com/BerriAI/litellm/issues/11834
 2025-06-20 09:40:33 -07:00
Cole McIntoshandGitHub 7abece4ad8 Merge pull request #11899 from colesmcintosh/add-health-check-success-modal 
Add success modal for health check responses
 2025-06-20 08:33:39 -06:00
Cole McIntosh 0ca70bf92e Merge remote-tracking branch 'origin/main' into add-health-check-success-modal 2025-06-20 08:05:36 -06:00
Krrish Dholakia 957df8d38c bump: version 1.72.8 → 1.72.9 2025-06-19 22:35:01 -07:00
Krish DholakiaandGitHub 308e82d885 LiteLLM SDK <-> Proxy improvement (don't transform message client-side) + Bedrock - handle qs:.. in base64 file data + Tag Management - support adding public model names (#11908) 
* fix(factory.py): handle qs:.. in mime type

Fixes https://github.com/BerriAI/litellm/issues/11839

* feat(litellm_proxy/): don't transform messages client-side

leave litellm proxy messages untouched - allow proxy to handle transformation

 prevents double transformation

* feat(tag_management_endpoints.py): support adding models to tag by adding model_name

Closes https://github.com/BerriAI/litellm/issues/11884

* test(test_tag_management_endpoints.py): add unit tests for adding new model by public model name

* test: update test
 2025-06-19 22:34:18 -07:00
Krish DholakiaandGitHub 0e6f1c089d fix(proxy_server.py): fix loading ui on custom root path (#11912) 
Closes https://github.com/BerriAI/litellm/issues/11865
 2025-06-19 22:29:01 -07:00
Krish DholakiaandGitHub 40cc61c8f3 build(model_prices_and_context_window.json): mark all gemini-2.5 mode… (#11907) 
* build(model_prices_and_context_window.json): mark all gemini-2.5 models as supporting pdf input

Closes https://github.com/BerriAI/litellm/issues/11881

* fix(anthropic_transformation.py): set custom llm provider custom property

Fixes https://github.com/BerriAI/litellm/issues/11861

* test: add unit test for checking supports_reasoning

* test: add test for vertex ai flow

* feat(bedrock/anthropic): ensure thinking param correctly passed for bedrock/invoke
 2025-06-19 21:07:25 -07:00
Ishaan Jaff a1abb43319 bump: version 1.72.7 → 1.72.8 2025-06-19 20:44:57 -07:00
Ishaan Jaff 72f73cb56e ui new build 2025-06-19 20:39:28 -07:00
Ishaan JaffandGitHub f6728e6e13 [UI] QA Items for adding pass through endpoints (#11909) 
* ui - fix 1

* fixes

* fix path prefix

* fix path
 2025-06-19 20:37:53 -07:00
Nathan BrakeandGitHub 1c4fdb4a8f Enhance Mistral API: Add support for parallel tool calls (#11770) 
* Enhance Mistral API: Add support for parallel tool calls and refine name handling in tool messages. Plus, introduce a new test for parallel tool calls in the Mistral model.

* tests

* make mypy happy

* Refine name handling in Mistral chat transformation: clarify conditions for removing the 'name' field based on message role and content.
 2025-06-19 20:12:39 -07:00
Victor KrylovandGitHub 1d58fc5429 Add deployment annotations (#11849) 
* Add deployment annotations

* Correct the indent and simplify if 0 annotations
 2025-06-19 20:11:31 -07:00
Rinor MalokuandGitHub 35b791dc49 bumps the anthropic package (#11851) 2025-06-19 20:11:04 -07:00
lgruen-vcgsandGitHub e1c77e70c2 Add AWS Bedrock profiles for the APAC region (#11883) 
Likely fixes #6905, #9228, and addresses https://github.com/BerriAI/litellm/issues/11057#issuecomment-2903257768.
 2025-06-19 20:10:04 -07:00
Ishaan JaffandGitHub d4b34549bc [Fix] Networking - allow using CA Bundles (#11906) 
* fix _get_ssl_context

* fixes for using HTTP handler
 2025-06-19 20:09:08 -07:00
Ishaan JaffGitHubwagnerjt
 		b90d3ca8d0 [Feat] MCP - Allow connecting to MCP with authentication headers + Allow clients to specify MCP headers (#11890) (#11891) 
* initial mcp auth with special header (#11890)

Co-authored-by: wagnerjt <wagnerjt@github.com>

* add mcp auth header

* fixes MCP client for litellm proxy

* fixes loc of MCP types

* fixes use MCP client for auth to MCPs

* fix organization

* fix mcp auth header

* add MCP auth header to litellm auth

* fixes for MCP auth

* Add MCP auth to list tools

* fix MCP call tool

* fixes for MCP auth header

* tests for MCP transport

* TestMCPClientUnitTests

* docs MCP auth

* fix types

* docs fix

* fix MCP auth import

* fix code qa check

* test fix mcp auth token check

---------

Co-authored-by: wagnerjt <wagnerjt@github.com>
 2025-06-19 20:07:08 -07:00
Pascal LimandGitHub ad2e2302e2 feat: add workload identity federation between GCP and AWS (#10210) v1.72.7-nightly 2025-06-19 18:31:58 -07:00
Ishaan Jaff 8cb381b519 ci/cd new build 2025-06-19 17:27:45 -07:00
Ishaan Jaff 0fe8bf2fc2 fix gemini-2.5-flash-lite-preview-06-17 2025-06-19 17:07:34 -07:00
Ishaan Jaff 4796e9c5ba ui - fix linting issue 2025-06-19 16:43:01 -07:00
fatih akyonandGitHub 5b6ba871a5 [Bug Fix] add missing flash-2.5-flash-lite for gemini provider, fix gemini-2.5-flash pricing (#11901) 2025-06-19 16:38:17 -07:00
Krrish Dholakia 3540984965 test: fix tests 2025-06-19 16:35:31 -07:00
Cole McIntoshandGitHub 677ef3cdde Fix health check UI table design - Remove table-in-table design from HealthCheckComponent - Change wrapper from card styling to simple div with mb-6 spacing - Remove padding around table container for cleaner layout - Add proper icon-based actions in health check table - Use PlayIcon for new checks and RefreshIcon for re-running checks - Add loading animation with dots during health checks - Include proper tooltips for action buttons (#11897) 2025-06-19 16:07:43 -07:00
Cole McIntoshandGitHub d2e54944a3 Fix clickable model ID in health check table - Add setSelectedModelId prop to make blue model ID buttons clickable - Fix checkbox selection logic to use model names consistently - Add stopPropagation to prevent unwanted sort triggers on checkbox clicks - Now clicking Model ID opens model details, and select all works properly (#11898) 2025-06-19 16:07:23 -07:00
Ishaan JaffandGitHub 87c2be93c7 [Feat] V2 Add Pass through endpoints on UI (#11905) 
* add pass through ui

* fix accordion for route path

* working route path renderer

* fix use sections

* clean up add pass through form

* docs fix add pass through routing

* clean up route preview

* add route preview
 2025-06-19 16:05:29 -07:00
Krrish Dholakia 753ec7298a fix(internal_user_endpoints.py): fix check 2025-06-19 15:53:28 -07:00
Krish DholakiaandGitHub c6d7d5bc98 Revert "move buttons to the left (#11771)" (#11904) 
This reverts commit bc9f111ee8.
 2025-06-19 15:36:47 -07:00
Krrish Dholakia b05742e814 fix(prometheus.py): fix metrics 2025-06-19 15:30:06 -07:00
Krrish Dholakia 649636b26b build(model_prices_and_context_window.json): ensure tpm/rpm limits are int 
Closes https://github.com/BerriAI/litellm/issues/11882
 2025-06-19 14:58:16 -07:00
Cole McIntosh f892439671 Add success modal for health check responses - Add green info icon next to healthy status badges - Click icon to view full health check response including headers - Show rate limit headers and other response metadata - Store successResponse in health status state - Add showSuccessModal functionality to view JSON response details - Restore ability to inspect successful health check responses 2025-06-19 15:33:26 -06:00
Ishaan JaffandGitHub cda759c8e7 [Bug Fix]: Fix gemini - web search error with responses API (#11894) 
* feat - add websearch tools to responses to chat transform

* test_basic_google_ai_studio_responses_api_with_tools

* fix web search to responses api

* linting fixes
 2025-06-19 14:11:35 -07:00
Ishaan JaffGitHubNishith Jain
 		29bf89cf9c fix(vertex_ai): Handle missing tokenCount in promptTokensDetails (#11… (#11896) 
* fix(vertex_ai): Handle missing tokenCount in promptTokensDetails (#11581)

This PR is a Solution to the Error converting to a valid response block='tokenCount'. File an issue if litellm error - https://github.com/BerriAI/litellm/issues

It's happening because vertex_ai is not sometimes sending the token count for the audio modality.

* test_vertex_ai_usage_metadata_missing_token_count

---------

Co-authored-by: Nishith Jain <167524748+KingNish24@users.noreply.github.com>
 2025-06-19 13:54:02 -07:00
Ishaan JaffGitHubYoung Han
 		08b2b4f5f5 [Feat] Enable Tool Calling for meta_llama (#11895) 
* Enable Tool Calling for `meta_llama` (#11825)

* feat: enable tools and function_call features

* fix: ignore pydantic warnings for StreamingChoices from llama-api

* docs: add tool calling examples

* docs: change default models to Maverick

* docs: fix output of tool use

* test_map_openai_params

---------

Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
 2025-06-19 13:44:22 -07:00
Ishaan Jaff e1764af890 fix meta_llama/Llama-3.3-8B-Instruct 2025-06-19 13:44:05 -07:00
Ishaan JaffandGitHub c975355d47 [Feat] UI - Add Allowed MCPs to Creating/Editing Organizations (#11893) 
* Add MCP Org controls to UI

* Add allowed MCPs for Orgs
 2025-06-19 12:50:09 -07:00
Ishaan Jaff b30bd155d3 fix pip 2025-06-19 12:29:21 -07:00
Ishaan Jaff e90473c40e v1.72.6-stable 2025-06-19 12:21:16 -07:00
tanjiroandGitHub 0a855ad728 rename schema to field_schema (#11887) 2025-06-19 09:29:37 -07:00
Krrish Dholakia b55e1daff9 docs(self_serve.md): document team param 2025-06-18 23:26:05 -07:00
Krrish Dholakia 753aeffe73 build: update with new migration file 2025-06-18 23:07:13 -07:00
Krrish Dholakia b080220d02 build: fix gemini-2.5-pro rate limits 2025-06-18 22:56:56 -07:00
Krrish Dholakia dfafa986ea build(model_prices_and_context_window.json): add gemini google ai studio rate limits 2025-06-18 22:55:54 -07:00
Krrish Dholakia 38eb7c370f docs(sidebars.js): add section for ai tools on integrations tab 
make it easier to discover
 2025-06-18 22:26:32 -07:00
Krrish Dholakia 6bf66ce919 docs(index.md): add tag 2025-06-18 22:15:30 -07:00
Krrish Dholakia 39a1fbfb35 build: bump versions 2025-06-18 22:14:40 -07:00
Ishaan Jaff 9ec6df59e4 fixes for pass through tests 2025-06-18 21:47:37 -07:00
Ishaan Jaff 8818347acc test scim 2025-06-18 21:42:40 -07:00
Krrish Dholakia 164118df81 docs(litellm_logging_code_coverage.py): fix check 2025-06-18 21:36:03 -07:00