tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-11 08:22:40 +00:00
Code Issues Packages Projects Releases Wiki Activity
25,133 Commits 2,072 Branches 1,425 Tags
c10d78aede2d164fcb2c78dc938560d2a4d9ecd8
Commit Graph
25133 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuta Saito c10d78aede fix: hide spec_version on MCP server views 2025-09-19 07:06:15 +09:00
Yuta Saito 654f1d3290 fix: stop including spec_version in MCP server registration inserts 2025-09-19 07:06:15 +09:00
Yuta Saito 6c291093e9 fix: remove adding Mcp-Protocol-Version header (#14069) 
The Mcp-Protocol-Version header is already handled in the MCP Python SDK, so the explicit addition on LiteLLM Proxy was redundant.
 2025-09-19 07:05:20 +09:00
Ishaan JaffandGitHub c6e37bb0bb fix: BadRequestError cohere (#14691) 2025-09-18 12:32:54 -07:00
Ishaan Jaffer e733b619db fix: test_user_email_in_all_required_metrics 2025-09-18 11:23:13 -07:00
Sameer KankuteandGitHub 36bedc69ff Add TwelveLabs marengo model (#14674) 2025-09-18 11:21:35 -07:00
Sameer KankuteandGitHub d213a2e066 correct the gaurdcontent name (#14684) 
* correct the gaurdcontent name

* correct the gaurdcontent name

* fix model required error in test

* Add correct model
 2025-09-18 11:00:19 -07:00
Ishaan Jaffer e0bbc3f46b fix: test_cohere_request_body_with_allowed_params 2025-09-18 10:56:45 -07:00
Ishaan Jaffer 8296bfb866 fix: test metrics 2025-09-18 10:25:22 -07:00
Ishaan Jaffer c6afa904bb fix: test_completion_with_no_model 2025-09-18 10:17:09 -07:00
Ishaan Jaffer 1e1d174733 fix: test_completion_with_no_model 2025-09-18 10:13:32 -07:00
Ishaan Jaffer 706b9214c0 fix: test_init_kwargs_for_pass_through_endpoint_basic 2025-09-18 07:59:05 -07:00
Ishaan Jaffer 3018c66867 fix: test_awesome_otel_with_message_logging_off 2025-09-18 07:49:39 -07:00
Ishaan Jaffer 09d63a00e2 fix: cohere generate api is deprecated 2025-09-18 07:40:28 -07:00
Ishaan Jaffer da95e208da fix: BedrockCountTokensHandler 2025-09-18 07:32:33 -07:00
Ishaan Jaffer 7b5dd5c7d1 fix: cohere generate api is deprecated 2025-09-18 07:29:11 -07:00
Ishaan JaffandGitHub 759bb6cff5 fix: cohere generate api is deprecated (#14676) 2025-09-18 07:27:51 -07:00
Krish DholakiaandGitHub bfaab8ad7e Merge pull request #14557 from timelfrink/fix/issue-14478-bedrock-count-tokens-endpoint 
Implement AWS Bedrock CountTokens API support
 2025-09-17 23:51:06 -07:00
Krish DholakiaandGitHub ff36dfdc76 Merge pull request #14637 from akraines/feature/middle-truncate-spend-logs 
feat: implement middle-truncation for spend log payloads
 2025-09-17 23:47:04 -07:00
Krish DholakiaandGitHub e7bc700b20 Merge pull request #14640 from Sameerlite/litellm_gardrail_default_latest_message 
[Feat]Add last message as default in gaurdrail
 2025-09-17 23:42:40 -07:00
Tim Elfrink 7538fc0def Fix mypy type annotations in transformation.py 
- Add explicit type annotation for transformed_message dict
- Resolves mypy errors while maintaining functionality
- All tests continue to pass
 2025-09-18 08:34:05 +02:00
Tim Elfrink c234b13275 Apply code formatting and linting fixes 
- Apply Black formatting to all Bedrock CountTokens files
- Clean up imports and remove unused variables in tests
- Fix indentation and simplify test structure
- Fix pyright type error with type ignore annotation
- All tests continue to pass after cleanup
 2025-09-18 08:28:17 +02:00
Tim Elfrink e74ac35b5d Add comprehensive tests for Bedrock CountTokens functionality 
- Add endpoint integration test in test_proxy_token_counter.py
- Add unit tests for transformation logic in bedrock/count_tokens/
- Test model extraction from request body vs endpoint path
- Test input format detection (converse vs invokeModel)
- Test request transformation from Anthropic to Bedrock format
- All tests follow existing codebase patterns and pass successfully
 2025-09-18 08:16:56 +02:00
Sameerlite edf95966c9 Handle consecutive user messages 2025-09-18 10:35:25 +05:30
Alexsander HamirandGitHub 8d96626044 fix: iscoroutine removed from hot path +50 RPS (#14649) 
* fix: iscoroutine removed from hot path

* fix: replace all instances & separate concerns

1. Replaced all instances of iscoroutine with is_async_callable
2. Place the coroutine checker in its own file

* fix: PR comment changes

* fix: missing config setting declaration

* fix: revert non-performance related changes

* fix: revert to initial implementation

* fix: remove dead const
 2025-09-17 19:01:43 -07:00
Krrish Dholakia 00d8dedd16 test: update test 2025-09-17 17:44:14 -07:00
Krish DholakiaandGitHub 44e0c730b9 Merge pull request #14653 from ARajan1084/in-memory-guardrail-fix 
fix: In Memory Guardrail fails to update
 2025-09-17 17:42:23 -07:00
= 268b984cb6 added test for updating in memory guardrails 2025-09-17 17:16:49 -07:00
Mubashir OsmaniGitHubIshaan Jaff
 		8b804303ed fix: ci/cd tests + lint errors (#14646) 
* fix: lint errors + tests

* fixed ci tests

* fixed tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-09-17 17:06:43 -07:00
Ishaan Jaffer e2be7e0b1f docs fix posthog 2025-09-17 17:02:23 -07:00
Krish DholakiaandGitHub f51003538a Merge pull request #14650 from BerriAI/litellm_dev_09_17_2025_p1 
Bedrock Guardrails - support setting bedrock runtime endpoint + Protect `/health/test_connect` to prevent users without model creation permissions from calling it
 2025-09-17 16:55:53 -07:00
Krrish Dholakia 1954bbffc0 test: fix test on ci/cd 2025-09-17 16:53:07 -07:00
= 66202d0ab7 updates in memory custom guardrail liteLLM params 2025-09-17 16:28:05 -07:00
Krish DholakiaandGitHub 895c41efa3 Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1 
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
 2025-09-17 15:43:04 -07:00
Krrish Dholakia d96e397de5 fix(_health_endpoints.py): protect /health/test_connection - only allow users who are allowed to create models, to call this endpoint 
Closes LIT-989
 2025-09-17 15:28:35 -07:00
Krrish Dholakia 530662d735 test: add unit testing 2025-09-17 14:54:44 -07:00
Krrish Dholakia 1ada663959 fix(bedrock_guardrails.py): respect bedrock runtime endpoint when using guardrails 
Closes LIT-983
 2025-09-17 14:41:40 -07:00
Sameer KankuteandGitHub 69c01488bd remove not needed names (#14641) 2025-09-17 14:26:48 -07:00
Krrish Dholakia 08ba38adeb test: update unit test 2025-09-17 14:23:13 -07:00
Ishaan JaffandGitHub 06f3991ed0 bump aiohttp==3.12.14 (#14638) 2025-09-17 09:44:39 -07:00
Sameerlite 1371abf880 add last message as default in gaurdrail 2025-09-17 21:08:19 +05:30
Carlos MarchalandGitHub e168161e64 Feat/add posthog observability (#14610) 
* feat: add posthog observability

* docs: add posthog logging docs

* docs: posthog integration in proxy mode
 2025-09-17 08:24:04 -07:00
Akiva Kraines 115a3e9ded feat: implement middle-truncation for spend log payloads 
- Change truncation strategy from head-only to middle-truncation (35% start, 65% end)
- Preserve both beginning and end of long strings for better debugging context
- Apply same sanitization to response payloads when store_prompts_in_spend_logs is enabled
- Increase default MAX_STRING_LENGTH_PROMPT_IN_DB from 1000 to 2048 characters
- Update tests to verify new truncation behavior with 35%-65% split

This provides better diagnostic value by keeping the more important end context
while still maintaining storage limits.
 2025-09-17 16:30:25 +03:00
Krish DholakiaandGitHub a74fda1159 Merge pull request #14625 from timelfrink/fix/mdx-compilation-error-compactifai 
Fix: MDX compilation error in CompactifAI documentation
 2025-09-16 23:06:50 -07:00
Krish DholakiaandGitHub bf0dd4a284 Merge pull request #14418 from iabhi4/deep-copy-issue 
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
 2025-09-16 22:55:31 -07:00
Tim Elfrink 79d1992de0 Fix: MDX compilation error in CompactifAI documentation 
- Replace (<5%) with (under 5%) in two locations to fix JSX parsing
- Resolves webpack build failure in Docusaurus documentation
- Maintains same meaning while avoiding MDX syntax conflicts

Fixes #14624
 2025-09-17 07:50:38 +02:00
Krish DholakiaandGitHub ef14270dec Merge pull request #14448 from vvidovic/propagate_metadata_to_vertexai_labels_docs 
Describing the `labels` field use in the Vertex AI
 2025-09-16 22:46:28 -07:00
Krish DholakiaandGitHub 2563c0ab2d Merge pull request #14534 from hula-la/fix/response-api-bugfixes 
fix: improve response api handling and cold storage configuration
 2025-09-16 22:46:03 -07:00
Krish DholakiaandGitHub fcf84027e8 Merge pull request #14555 from mubashir1osmani/dd_spend_metric 
DataDog shows spend metrics
 2025-09-16 22:44:47 -07:00
Krish DholakiaandGitHub 635dc72211 Merge pull request #14604 from Sameerlite/litellm_gemini_api_base_update 
Litellm gemini api base update
 2025-09-16 22:38:44 -07:00