tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-23 20:26:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,993 Commits 2,072 Branches 1,425 Tags
db644b6edd13ee186faa479fbcfb31dddb3b15d3
Commit Graph
24993 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub db644b6edd Merge pull request #14500 from luisfucros/feat/update-sambanova-models 
Add sambanova deepseek v3.1 and gpt-oss-120b models
 2025-09-13 23:38:20 -07:00
Krish DholakiaandGitHub 11822e63f1 Merge pull request #14519 from uc4w6c/feat/add_tools_permission_guardrail 
feat: add tool-permission guardrail
 2025-09-13 23:22:31 -07:00
Krish DholakiaandGitHub dc4bbba0a5 Merge pull request #14520 from boopesh07/email_prometheus 
Added user_email labels to the prometheus monitoring.
 2025-09-13 23:19:46 -07:00
Krish DholakiaandGitHub 2ec4b2953c Merge pull request #14531 from mubashir1osmani/main 
fix: DD tool calls passed in metadata
 2025-09-13 23:16:15 -07:00
Krish DholakiaandGitHub 2338dd952e Merge pull request #14546 from BerriAI/filter-on-logs-bug 
The 'last 24 hours' button shows up above the end user dropdown on Logs page
v1.77.2.rc.1 		2025-09-13 23:12:39 -07:00
Krish DholakiaandGitHub 1622d03ecc Merge pull request #14545 from BerriAI/litellm_ui_qa_09_13_2025_p1 
Litellm UI qa 09 13 2025 p1 - fix end user filtering + fix load mcp tool call error + prevent setting max user budget on scroll in edit user settings
 2025-09-13 18:48:43 -07:00
Krrish Dholakia fe546b936a fix(fetch_mcp_tools.tsx): fix load mcp tools 2025-09-13 18:42:42 -07:00
Ishaan JaffandGitHub f37dd6bb95 Litellm 1.77.2 stable notes (#14544) 
* fix release notes instructions

* docs v1

* fix doc

* fix highlights

* docs fix

* docs fix
 2025-09-13 18:41:34 -07:00
Krrish Dholakia 84f934bf36 fix(user_edit_view.tsx): use shared component to prevent accidental setting of edit user budget 2025-09-13 18:20:07 -07:00
Krrish Dholakia bb5e71447d fix(spend_management_endpoints.py): add end user filtering 2025-09-13 18:15:34 -07:00
Boopesh ShanmugamandGitHub 95da14cb96 Docs update on user header mapping (#14527) 2025-09-13 16:58:10 -07:00
Ishaan JaffandGitHub 6172145014 fix: org budget update fix (#14541) 2025-09-13 16:34:26 -07:00
Krrish Dholakia b6bca6369f fix(constants.py): make default num workers 1 2025-09-13 13:57:58 -07:00
Ishaan Jaff 9110af37d0 bump: version 1.77.1 → 1.77.2 2025-09-13 13:55:30 -07:00
Krrish Dholakia dc4b09e26e build(ui/): new ui build 2025-09-13 13:48:27 -07:00
Krish DholakiaandGitHub 6efc898407 Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1 
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
 2025-09-13 13:39:28 -07:00
Ishaan Jaff 6c27e5ce43 fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY v1.77.1-nightly 2025-09-13 12:11:33 -07:00
Ishaan Jaff 252ec8e1ae test_normal_router_call_tpm_v3 2025-09-13 12:04:56 -07:00
Alexsander HamirandGitHub 44d209622b fix: remove dynamic creation of static value (#14538) 2025-09-13 11:58:38 -07:00
Krrish Dholakia 8443000ca4 fix(main.py): route vllm calls via the openai sdk route 
consistent with other openai-like implementations
 2025-09-13 11:49:05 -07:00
Ishaan Jaff 26dafdc493 test fix: note this does not play nice with circleCI, it passes on local 2025-09-13 11:37:19 -07:00
Ishaan Jaff ea280e1a6e _transform_messages: google ai studio 2025-09-13 11:31:19 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		d89c7f0eb7 build(deps): bump hono from 4.6.5 to 4.9.7 in /litellm-js/spend-logs (#14513) 
Bumps [hono](https://github.com/honojs/hono) from 4.6.5 to 4.9.7.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.6.5...v4.9.7)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.9.7
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-09-13 11:10:37 -07:00
Krrish Dholakia a8e2d24d3a fix: fix import 2025-09-13 10:12:32 -07:00
Krish DholakiaandGitHub 269515e525 Merge branch 'main' into litellm_dev_09_12_2025_p1 2025-09-13 10:10:30 -07:00
Ishaan Jaff ec32a0a7d7 fix: get_base_completion_call_args 2025-09-13 09:59:08 -07:00
Krrish Dholakia 9ee9745781 docs(vllm.md): document new endpoint 2025-09-13 09:46:39 -07:00
Ishaan Jaff 69e451458c test_logging_opentelemetry_context_propagation 2025-09-13 09:44:36 -07:00
Krish DholakiaandGitHub 38efd358eb Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode 
Noma non blocking monitor mode & anonymize input support
 2025-09-13 09:41:41 -07:00
Krish DholakiaandGitHub 550feffeb9 Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502 
fix(lm_studio): resolve illegal Bearer header value issue
 2025-09-13 09:40:30 -07:00
Krish DholakiaandGitHub a6ba744085 Merge pull request #14529 from BerriAI/litellm_contributor_prs_09_12_2025_p1 
Fixed Log Tab Key Alias
 2025-09-13 09:39:28 -07:00
Krish DholakiaandGitHub ad9515a81e Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1 2025-09-13 09:38:43 -07:00
mubashir1osmani 3cca2e95a7 fix lint errors 2025-09-13 00:17:57 -04:00
mubashir1osmani fd11159148 fix: DD tool calls passed in metadata 2025-09-13 00:11:18 -04:00
Krish DholakiaandGitHub de8cf40ffa Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3 
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
 2025-09-12 19:56:53 -07:00
Krish DholakiaandGitHub 663dbc6080 Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2 
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
 2025-09-12 19:51:44 -07:00
Ishaan Jaff 8b3b943557 docs fix 2025-09-12 19:51:14 -07:00
Krish DholakiaandGitHub e254d9013b Merge pull request #14469 from sashank5644/litellm_log_key_alias_filtering 
Fixed Log Tab Key Alias filtering inaccurately for failed logs
 2025-09-12 19:46:17 -07:00
Krrish Dholakia 05e3e3685b docs(forward_client_headers.md): document new forwarding client headers to llm api feature 2025-09-12 19:38:07 -07:00
Ishaan JaffandGitHub 93af8fd6ba [QA] E2E - Testing for bedrock batches api (#14525) 
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0

* test_bedrock_batches_api

* fix

* fix import

* test_bedrock_batches_api
 2025-09-12 19:31:19 -07:00
Ishaan Jaff 93d6e9bf49 pip install "google-genai==1.22.0" 2025-09-12 19:30:47 -07:00
Ishaan JaffandGitHub 20c390dc71 [Docs] - Bedrock Batches API (#14526) 
* docs bedrock batch

* docs fix

* docs bedrock batches

* fix Create Batch Request

* docs fix
 2025-09-12 19:08:13 -07:00
Krrish Dholakia 6596c24d5c fix(litellm_pre_call_utils.py): add wildcard model support for forwardable model group headers 2025-09-12 18:45:24 -07:00
Ishaan JaffandGitHub 075a089d82 [Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests (#14522) 
* use is_batch_jsonl_file

* fix valid_content_type

* fix transform_create_file_request

* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content

* test_transform_openai_jsonl_content_to_bedrock_jsonl_content

* fix mypy linting errors

* fix BEDROCK_BATCH_MODEL

* fix working sample

* fix comment

* fix model list

* fix: use with managed batches

* refactor
 2025-09-12 18:32:57 -07:00
Krrish Dholakia 7a5e5a12da fix: fix linting errors 2025-09-12 18:03:50 -07:00
Krrish Dholakia bdd960c451 docs(admin_ui_sso.md): clarify sso usage on docs 2025-09-12 18:03:03 -07:00
Krrish Dholakia 8ec02a5bdc test: add unit tests for ollama chat request transformation 2025-09-12 17:59:59 -07:00
Krrish Dholakia 461e181450 fix(ollama/chat): support images 
Fixes https://github.com/BerriAI/litellm/issues/14217
 2025-09-12 17:49:42 -07:00
Krrish Dholakia dd663f80ce feat(ollama/chat): ensure content is str - even when input is list[str] 
Fixes https://github.com/BerriAI/litellm/issues/14217
 2025-09-12 17:41:25 -07:00
Arseny BoykovandGitHub f4318bccd3 [Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450) 
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
 2025-09-12 17:33:55 -07:00