tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-20 06:23:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
25,109 Commits 2,072 Branches 1,425 Tags
e7bc700b203b032108c8ea7f967d88d74497c697
Commit Graph
25109 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub e7bc700b20 Merge pull request #14640 from Sameerlite/litellm_gardrail_default_latest_message 
[Feat]Add last message as default in gaurdrail
 2025-09-17 23:42:40 -07:00
Sameerlite edf95966c9 Handle consecutive user messages 2025-09-18 10:35:25 +05:30
Alexsander HamirandGitHub 8d96626044 fix: iscoroutine removed from hot path +50 RPS (#14649) 
* fix: iscoroutine removed from hot path

* fix: replace all instances & separate concerns

1. Replaced all instances of iscoroutine with is_async_callable
2. Place the coroutine checker in its own file

* fix: PR comment changes

* fix: missing config setting declaration

* fix: revert non-performance related changes

* fix: revert to initial implementation

* fix: remove dead const
 2025-09-17 19:01:43 -07:00
Krrish Dholakia 00d8dedd16 test: update test 2025-09-17 17:44:14 -07:00
Krish DholakiaandGitHub 44e0c730b9 Merge pull request #14653 from ARajan1084/in-memory-guardrail-fix 
fix: In Memory Guardrail fails to update
 2025-09-17 17:42:23 -07:00
= 268b984cb6 added test for updating in memory guardrails 2025-09-17 17:16:49 -07:00
Mubashir OsmaniGitHubIshaan Jaff
 		8b804303ed fix: ci/cd tests + lint errors (#14646) 
* fix: lint errors + tests

* fixed ci tests

* fixed tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-09-17 17:06:43 -07:00
Ishaan Jaffer e2be7e0b1f docs fix posthog 2025-09-17 17:02:23 -07:00
Krish DholakiaandGitHub f51003538a Merge pull request #14650 from BerriAI/litellm_dev_09_17_2025_p1 
Bedrock Guardrails - support setting bedrock runtime endpoint + Protect `/health/test_connect` to prevent users without model creation permissions from calling it
 2025-09-17 16:55:53 -07:00
Krrish Dholakia 1954bbffc0 test: fix test on ci/cd 2025-09-17 16:53:07 -07:00
= 66202d0ab7 updates in memory custom guardrail liteLLM params 2025-09-17 16:28:05 -07:00
Krish DholakiaandGitHub 895c41efa3 Merge pull request #14619 from BerriAI/litellm_dev_09_16_2025_p1 
UI - allow team member to view service account keys they create + Anthropic - include cache creation tokens in prompt token total (separate out during cost tracking)
 2025-09-17 15:43:04 -07:00
Krrish Dholakia d96e397de5 fix(_health_endpoints.py): protect /health/test_connection - only allow users who are allowed to create models, to call this endpoint 
Closes LIT-989
 2025-09-17 15:28:35 -07:00
Krrish Dholakia 530662d735 test: add unit testing 2025-09-17 14:54:44 -07:00
Krrish Dholakia 1ada663959 fix(bedrock_guardrails.py): respect bedrock runtime endpoint when using guardrails 
Closes LIT-983
 2025-09-17 14:41:40 -07:00
Sameer KankuteandGitHub 69c01488bd remove not needed names (#14641) 2025-09-17 14:26:48 -07:00
Krrish Dholakia 08ba38adeb test: update unit test 2025-09-17 14:23:13 -07:00
Ishaan JaffandGitHub 06f3991ed0 bump aiohttp==3.12.14 (#14638) 2025-09-17 09:44:39 -07:00
Sameerlite 1371abf880 add last message as default in gaurdrail 2025-09-17 21:08:19 +05:30
Carlos MarchalandGitHub e168161e64 Feat/add posthog observability (#14610) 
* feat: add posthog observability

* docs: add posthog logging docs

* docs: posthog integration in proxy mode
 2025-09-17 08:24:04 -07:00
Krish DholakiaandGitHub a74fda1159 Merge pull request #14625 from timelfrink/fix/mdx-compilation-error-compactifai 
Fix: MDX compilation error in CompactifAI documentation
 2025-09-16 23:06:50 -07:00
Krish DholakiaandGitHub bf0dd4a284 Merge pull request #14418 from iabhi4/deep-copy-issue 
fix: avoid deepcopy crash with non-pickleables in Gemini/Vertex
 2025-09-16 22:55:31 -07:00
Tim Elfrink 79d1992de0 Fix: MDX compilation error in CompactifAI documentation 
- Replace (<5%) with (under 5%) in two locations to fix JSX parsing
- Resolves webpack build failure in Docusaurus documentation
- Maintains same meaning while avoiding MDX syntax conflicts

Fixes #14624
 2025-09-17 07:50:38 +02:00
Krish DholakiaandGitHub ef14270dec Merge pull request #14448 from vvidovic/propagate_metadata_to_vertexai_labels_docs 
Describing the `labels` field use in the Vertex AI
 2025-09-16 22:46:28 -07:00
Krish DholakiaandGitHub 2563c0ab2d Merge pull request #14534 from hula-la/fix/response-api-bugfixes 
fix: improve response api handling and cold storage configuration
 2025-09-16 22:46:03 -07:00
Krish DholakiaandGitHub fcf84027e8 Merge pull request #14555 from mubashir1osmani/dd_spend_metric 
DataDog shows spend metrics
 2025-09-16 22:44:47 -07:00
Krish DholakiaandGitHub 635dc72211 Merge pull request #14604 from Sameerlite/litellm_gemini_api_base_update 
Litellm gemini api base update
 2025-09-16 22:38:44 -07:00
Krish DholakiaandGitHub 701b4fffee Merge pull request #14600 from mubashir1osmani/fix_all_docs 
docs: helicone integration and mcp
 2025-09-16 22:37:38 -07:00
Krish DholakiaandGitHub 92c82a682e Merge pull request #14613 from ronaldpereira/patch-1 
Fix error message for missing OCI parameters
 2025-09-16 22:36:00 -07:00
Krish DholakiaandGitHub 6bccdcd530 Merge pull request #14620 from BerriAI/litellm_dev_09_16_2025_p2 
(feat) Anthropic - document pricing for cache creation tokens above 1hr
 2025-09-16 22:33:11 -07:00
Krish DholakiaandGitHub cd53f25427 Merge pull request #14622 from ARajan1084/guardrail-key-configuration-fix 
Fix: 14473: Guardrail view, edit, and delete behavior
 2025-09-16 22:32:12 -07:00
Krrish Dholakia 8273630e08 test: update tests 2025-09-16 22:30:40 -07:00
Mubashir OsmaniandGitHub 0fde408e35 added langfuse logging for responses api (#14597) 
* added langfuse logging for responses api

* tests added
 2025-09-16 21:43:19 -07:00
Oleksandr TereshchenkoandGitHub f507bf8881 Fix AttributeError: NoneType object has no attribute 'get' (#14609) 2025-09-16 21:38:01 -07:00
mubashir1osmani 439577fd35 fixed lint errors 2025-09-17 00:31:29 -04:00
mubashir1osmani e56b11cb54 added tests 2025-09-17 00:19:03 -04:00
mubashir1osmani fc7de7a1c5 added user_api_key_spend 2025-09-17 00:10:02 -04:00
= 626c48b783 removed problematic tooltips; used generic GuardrailSelector component 2025-09-16 19:42:53 -07:00
Krrish Dholakia 0e747aaaf1 test: fix test 2025-09-16 19:20:12 -07:00
Ishaan JaffandGitHub 93524cf19b [Feat] Batches - Add bedrock retrieve endpoint support (#14618) 
* feat: add bedrock retrieve endpoint

* feat: feat: add bedrock retrieve endpoint

* test: batches mocked transform

* ruff fix

* refactor

* fix transform

* fix: parse_timestamp
 2025-09-16 19:19:02 -07:00
Krrish Dholakia 22d3e492f9 fix(test_utils.py): fix test 2025-09-16 19:17:44 -07:00
Krrish Dholakia c1a33dcc5f fix(types/utils.py): add cache_creation_input_token_cost_above_1hr to modelinfobase 2025-09-16 19:15:26 -07:00
Krrish Dholakia e735808614 test(test_utils.py): fix cache creation tokens 2025-09-16 19:03:16 -07:00
Krrish Dholakia 97cc5f55d6 build(model_prices_and_context_window.json): add claude-3-5 haiku, claude-3-5 sonnet, claude-opus 3, claude-haiku 3 "cache_creation_input_token_cost_above_1hr" pricing 2025-09-16 18:58:49 -07:00
Krrish Dholakia 3188ae9281 build(model_prices_and_context_window.json): add claude-opus-4, claude-3-7-sonnet, claude-sonnet-4 "cache_creation_input_token_cost_above_1hr" pricing 2025-09-16 18:56:24 -07:00
Krrish Dholakia a2bfd3e476 build(model_prices_and_context_window.json): add claude-opus-4-1 "cache_creation_input_token_cost_above_1hr" pricing 2025-09-16 18:53:56 -07:00
Krrish Dholakia 0fa11c3c25 build(model_prices_and_context_window.json): add "cache_creation_input_token_cost_above_1hr" to all claude-3-5-sonnet models 2025-09-16 18:52:37 -07:00
Krrish Dholakia 1c855385c9 build(model_cost): add cache_creation_input_token_cost_above_1hr pricing 2025-09-16 18:43:57 -07:00
Krrish Dholakia 0341e7fc09 fix: fix test 2025-09-16 18:34:24 -07:00
Krrish Dholakia e488312873 fix(utils.py): log cache_creation_tokens in prompt token details 
Closes LIT-907
 2025-09-16 18:24:10 -07:00