tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-24 14:28:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,982 Commits 2,072 Branches 1,425 Tags
1622d03ecc0445086ab283f77b22c29dfe90573b
Commit Graph
24982 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub 1622d03ecc Merge pull request #14545 from BerriAI/litellm_ui_qa_09_13_2025_p1 
Litellm UI qa 09 13 2025 p1 - fix end user filtering + fix load mcp tool call error + prevent setting max user budget on scroll in edit user settings
 2025-09-13 18:48:43 -07:00
Krrish Dholakia fe546b936a fix(fetch_mcp_tools.tsx): fix load mcp tools 2025-09-13 18:42:42 -07:00
Ishaan JaffandGitHub f37dd6bb95 Litellm 1.77.2 stable notes (#14544) 
* fix release notes instructions

* docs v1

* fix doc

* fix highlights

* docs fix

* docs fix
 2025-09-13 18:41:34 -07:00
Krrish Dholakia 84f934bf36 fix(user_edit_view.tsx): use shared component to prevent accidental setting of edit user budget 2025-09-13 18:20:07 -07:00
Krrish Dholakia bb5e71447d fix(spend_management_endpoints.py): add end user filtering 2025-09-13 18:15:34 -07:00
Boopesh ShanmugamandGitHub 95da14cb96 Docs update on user header mapping (#14527) 2025-09-13 16:58:10 -07:00
Ishaan JaffandGitHub 6172145014 fix: org budget update fix (#14541) 2025-09-13 16:34:26 -07:00
Krrish Dholakia b6bca6369f fix(constants.py): make default num workers 1 2025-09-13 13:57:58 -07:00
Ishaan Jaff 9110af37d0 bump: version 1.77.1 → 1.77.2 2025-09-13 13:55:30 -07:00
Krrish Dholakia dc4b09e26e build(ui/): new ui build 2025-09-13 13:48:27 -07:00
Krish DholakiaandGitHub 6efc898407 Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1 
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
 2025-09-13 13:39:28 -07:00
Ishaan Jaff 6c27e5ce43 fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY v1.77.1-nightly 2025-09-13 12:11:33 -07:00
Ishaan Jaff 252ec8e1ae test_normal_router_call_tpm_v3 2025-09-13 12:04:56 -07:00
Alexsander HamirandGitHub 44d209622b fix: remove dynamic creation of static value (#14538) 2025-09-13 11:58:38 -07:00
Krrish Dholakia 8443000ca4 fix(main.py): route vllm calls via the openai sdk route 
consistent with other openai-like implementations
 2025-09-13 11:49:05 -07:00
Ishaan Jaff 26dafdc493 test fix: note this does not play nice with circleCI, it passes on local 2025-09-13 11:37:19 -07:00
Ishaan Jaff ea280e1a6e _transform_messages: google ai studio 2025-09-13 11:31:19 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 		d89c7f0eb7 build(deps): bump hono from 4.6.5 to 4.9.7 in /litellm-js/spend-logs (#14513) 
Bumps [hono](https://github.com/honojs/hono) from 4.6.5 to 4.9.7.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.6.5...v4.9.7)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.9.7
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-09-13 11:10:37 -07:00
Krrish Dholakia a8e2d24d3a fix: fix import 2025-09-13 10:12:32 -07:00
Krish DholakiaandGitHub 269515e525 Merge branch 'main' into litellm_dev_09_12_2025_p1 2025-09-13 10:10:30 -07:00
Ishaan Jaff ec32a0a7d7 fix: get_base_completion_call_args 2025-09-13 09:59:08 -07:00
Krrish Dholakia 9ee9745781 docs(vllm.md): document new endpoint 2025-09-13 09:46:39 -07:00
Ishaan Jaff 69e451458c test_logging_opentelemetry_context_propagation 2025-09-13 09:44:36 -07:00
Krish DholakiaandGitHub 38efd358eb Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode 
Noma non blocking monitor mode & anonymize input support
 2025-09-13 09:41:41 -07:00
Krish DholakiaandGitHub 550feffeb9 Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502 
fix(lm_studio): resolve illegal Bearer header value issue
 2025-09-13 09:40:30 -07:00
Krish DholakiaandGitHub a6ba744085 Merge pull request #14529 from BerriAI/litellm_contributor_prs_09_12_2025_p1 
Fixed Log Tab Key Alias
 2025-09-13 09:39:28 -07:00
Krish DholakiaandGitHub ad9515a81e Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1 2025-09-13 09:38:43 -07:00
Krish DholakiaandGitHub de8cf40ffa Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3 
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
 2025-09-12 19:56:53 -07:00
Krish DholakiaandGitHub 663dbc6080 Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2 
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
 2025-09-12 19:51:44 -07:00
Ishaan Jaff 8b3b943557 docs fix 2025-09-12 19:51:14 -07:00
Krish DholakiaandGitHub e254d9013b Merge pull request #14469 from sashank5644/litellm_log_key_alias_filtering 
Fixed Log Tab Key Alias filtering inaccurately for failed logs
 2025-09-12 19:46:17 -07:00
Krrish Dholakia 05e3e3685b docs(forward_client_headers.md): document new forwarding client headers to llm api feature 2025-09-12 19:38:07 -07:00
Ishaan JaffandGitHub 93af8fd6ba [QA] E2E - Testing for bedrock batches api (#14525) 
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0

* test_bedrock_batches_api

* fix

* fix import

* test_bedrock_batches_api
 2025-09-12 19:31:19 -07:00
Ishaan Jaff 93d6e9bf49 pip install "google-genai==1.22.0" 2025-09-12 19:30:47 -07:00
Ishaan JaffandGitHub 20c390dc71 [Docs] - Bedrock Batches API (#14526) 
* docs bedrock batch

* docs fix

* docs bedrock batches

* fix Create Batch Request

* docs fix
 2025-09-12 19:08:13 -07:00
Krrish Dholakia 6596c24d5c fix(litellm_pre_call_utils.py): add wildcard model support for forwardable model group headers 2025-09-12 18:45:24 -07:00
Ishaan JaffandGitHub 075a089d82 [Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests (#14522) 
* use is_batch_jsonl_file

* fix valid_content_type

* fix transform_create_file_request

* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content

* test_transform_openai_jsonl_content_to_bedrock_jsonl_content

* fix mypy linting errors

* fix BEDROCK_BATCH_MODEL

* fix working sample

* fix comment

* fix model list

* fix: use with managed batches

* refactor
 2025-09-12 18:32:57 -07:00
Krrish Dholakia 7a5e5a12da fix: fix linting errors 2025-09-12 18:03:50 -07:00
Krrish Dholakia bdd960c451 docs(admin_ui_sso.md): clarify sso usage on docs 2025-09-12 18:03:03 -07:00
Krrish Dholakia 8ec02a5bdc test: add unit tests for ollama chat request transformation 2025-09-12 17:59:59 -07:00
Krrish Dholakia 461e181450 fix(ollama/chat): support images 
Fixes https://github.com/BerriAI/litellm/issues/14217
 2025-09-12 17:49:42 -07:00
Krrish Dholakia dd663f80ce feat(ollama/chat): ensure content is str - even when input is list[str] 
Fixes https://github.com/BerriAI/litellm/issues/14217
 2025-09-12 17:41:25 -07:00
Arseny BoykovandGitHub f4318bccd3 [Performance] Use _PROXY_MaxParallelRequestsHandler_v3 by default again (#14450) 
* Use _PROXY_MaxParallelRequestsHandler_v3 by default (#14352)

(cherry picked from commit f3fa45cf8fbd5f5cce2f45a7312776d5005fb08e)
(cherry picked from commit 5b680bb4a3)

* Use random api_key for parallel requests test

* Fix off-by-one error in parallel request rate limit

The rate limiter was incorrectly rejecting requests when the limit was met, but not exceeded. The check in `is_cache_list_over_limit` was `int(counter_value) + 1 > current_limit`, which caused the first request to be rejected if the limit was 1.

This commit removes the `+ 1`, changing the logic to `int(counter_value) > current_limit`. The check now correctly allows requests up to the specified parallel limit.

* Test actual parallel requests

* Ensure rate limiting works correctly for multiple users

* Add sequential rate-limit test

* Revert random key usage
 2025-09-12 17:33:55 -07:00
Krrish Dholakia 82091de393 feat(hosted_vllm/): transcription endpoint support 
Closes https://github.com/BerriAI/litellm/issues/361#issuecomment-3244548055
 2025-09-12 17:15:14 -07:00
Krrish Dholakia 1bbbacea00 fix(key_management_endpoints.py): correctly raise an error when tags set on /key/update by non-premium user 
Closes https://github.com/BerriAI/litellm/issues/14366
 2025-09-12 15:50:29 -07:00
Ishaan JaffandGitHub e87e50328e [Feat] Bedrock Batches - Working e2e flow to upload file + create batch (#14518) 
* fix: bedrock batches transform

* fix: upload_url

* fixes for model name

* fix upload_url

* fix bedrock batch test

* test_mock_bedrock_file_url_mapping
 2025-09-12 15:37:09 -07:00
Tim Elfrink b84785b5b7 fix(lm_studio): resolve illegal Bearer header value issue 
- Change default API key from space ' ' to 'fake-api-key'
- Fixes httpcore.LocalProtocolError: Illegal header value b'Bearer  '
- Maintains compatibility with explicit API keys and environment variables
- Add comprehensive tests for provider info retrieval

Fixes #14502
 2025-09-12 22:41:30 +02:00
Ishaan JaffandGitHub 18372f9ebe Revert "fix vertex ai file upload" (#14501) 2025-09-12 12:02:24 -07:00
SameerliteGitHubIshaan Jaff
 		fa175e8d90 Fix gemini cli error (#14417) 
* Fix gemini cli error

* Added better handling

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-09-12 11:56:51 -07:00
Sameer KankuteGitHubsameer@berri.ai <sameer@berri.ai>
 		1a123b2cd5 Litellm gemini cli bug fix (#14451) 
* Fix gemini cli error

* Add reasoning request support

* Added better handling

* remove other PR code

* refactored code for better structure following

---------

Co-authored-by: sameer@berri.ai <sameer@berri.ai>
 2025-09-12 11:55:26 -07:00