5eff9f6999
added tooltip for guardrail failure state
2025-09-18 19:11:55 -07:00
5b080e20c4
removes HTTP exception for faulty guardrail
2025-09-18 18:57:15 -07:00
f387803655
Merge pull request #14658 from ARajan1084/bedrock-custom-guardrail-fix
...
fix: check for AWS exceptions despite a 200 response
2025-09-18 18:34:32 -07:00
3671c6a97f
Merge pull request #14690 from ARajan1084/bedrock_guardrail_logging_fix
...
fix: Amazon Bedrock incorrect guardrailResponse bug
2025-09-18 18:33:23 -07:00
661a42b626
Merge pull request #14698 from BerriAI/litellm_contributor_prs_09_18_2025_p1
...
Litellm contributor prs 09 18 2025 p1
2025-09-18 18:32:51 -07:00
60800698f2
feature: generic object pool ( #14702 )
...
* add: generic object pool & tests
Introduced a reusable object pool that can be applied across the codebase.
Note: memory growth is managed via eviction settings—using a hard cap could
reduce performance, so eviction is the preferred safeguard.
* fix: simpler tests
2025-09-18 18:32:45 -07:00
7b53edec7e
Merge pull request #14701 from ARajan1084/bedrock-guardrail-view
...
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 18:02:53 -07:00
7cfdc6069a
upgraded build script to node 20
2025-09-18 18:01:47 -07:00
114d077cc9
fix: model cost map check
2025-09-18 17:52:56 -07:00
ccb817d16c
Merge pull request #14699 from ARajan1084/bedrock-guardrail-view
...
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 17:52:19 -07:00
90bd1927e2
Update config.yml
2025-09-18 17:50:55 -07:00
61d1fabb6e
upgraded vitest
2025-09-18 17:39:53 -07:00
4f89675267
upgraded to node 20
2025-09-18 17:38:56 -07:00
c1a967992f
fix: model cost map check
2025-09-18 17:37:09 -07:00
4f468e9563
Update bedrock_guardrails.py
2025-09-18 17:27:40 -07:00
12fed102ba
Update bedrock_guardrails.py
2025-09-18 17:25:31 -07:00
0626affa11
fix: model cost map check
2025-09-18 17:25:28 -07:00
c7af9d1b7e
Merge pull request #14696 from ARajan1084/bedrock-guardrail-view
...
NEW Amazon Bedrock Guardrail Info View in Logs
2025-09-18 17:22:17 -07:00
59409429d4
fix: reduced __inits__ overhead in 7% ( #14689 )
...
* fix: avoid redundant __init__ calls on hot path
Previously, imports on the request hot path caused __init__ to run
excessively for every request. This change ensures initialization
happens once, reducing cpu overhead.
* fix: remove redundant __init__ import
The current implementation no longer requires an import at the top of the function.
* fix: placed on core utils for future reuse
* test: add coverage & remove inline import
A general import-checking tool across all endpoints would be a large PR.
This commit focuses on a smaller, targeted fix for the discussed case.
* added import check to CI
2025-09-18 17:18:05 -07:00
4c983f985a
[Feat] Add Bedrock Twelve Labs embedding provider support ( #14697 )
...
* fix: add 12 labs to bedrock embedding
* fix: get_bedrock_embedding_provider
* test: test_text_embedding
* fix: 12 labs embedding transform
* fix: refactor 12 labs transform logic
* fix: test_e2e_bedrock_embedding
* fix: test_e2e_bedrock_embedding
* feat: add bedrock twelvelabs pricing
* DOCS: docs bedrock embedding
* DOCS: 12 labs bedrock overview
* fix: bedrock embeddings 12 labs
2025-09-18 17:16:45 -07:00
77e4008e7b
lint fix
2025-09-18 17:13:55 -07:00
f80660acd9
vitests for GuardrailViewer components
2025-09-18 16:57:22 -07:00
2bbcf5a851
Update bedrock_guardrails.py
2025-09-18 16:05:30 -07:00
ec61a7152a
Support for is_streamed_request widh datadog ( #14673 )
2025-09-18 15:55:16 -07:00
a3f0a3c05f
Update test_bedrock_guardrails.py
2025-09-18 15:51:42 -07:00
911918474a
removed duplicate code
2025-09-18 15:49:16 -07:00
917c8bb43c
Update test_bedrock_guardrails.py
2025-09-18 15:42:41 -07:00
a86b9a1808
check for AWS exceptions despite a 200 response
2025-09-18 15:42:36 -07:00
a7a6381926
fix: flaky passthrough tests ( #14692 )
...
* fix: flaky passthrough tests
* Revert "fix: flaky passthrough tests"
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.
* fix: serialize prisma objects
2025-09-18 15:35:14 -07:00
78cb8c71fd
prelim changes for new Bedrock guardrail info view
2025-09-18 15:09:10 -07:00
c6e37bb0bb
fix: BadRequestError cohere ( #14691 )
2025-09-18 12:32:54 -07:00
c1963f7f02
removed wrapper which overwrote the guardrailResponse value incorrectly
2025-09-18 12:05:38 -07:00
e733b619db
fix: test_user_email_in_all_required_metrics
2025-09-18 11:23:13 -07:00
36bedc69ff
Add TwelveLabs marengo model ( #14674 )
2025-09-18 11:21:35 -07:00
d213a2e066
correct the gaurdcontent name ( #14684 )
...
* correct the gaurdcontent name
* correct the gaurdcontent name
* fix model required error in test
* Add correct model
2025-09-18 11:00:19 -07:00
e0bbc3f46b
fix: test_cohere_request_body_with_allowed_params
2025-09-18 10:56:45 -07:00
8296bfb866
fix: test metrics
2025-09-18 10:25:22 -07:00
c6afa904bb
fix: test_completion_with_no_model
2025-09-18 10:17:09 -07:00
1e1d174733
fix: test_completion_with_no_model
2025-09-18 10:13:32 -07:00
706b9214c0
fix: test_init_kwargs_for_pass_through_endpoint_basic
2025-09-18 07:59:05 -07:00
3018c66867
fix: test_awesome_otel_with_message_logging_off
2025-09-18 07:49:39 -07:00
09d63a00e2
fix: cohere generate api is deprecated
2025-09-18 07:40:28 -07:00
da95e208da
fix: BedrockCountTokensHandler
2025-09-18 07:32:33 -07:00
7b5dd5c7d1
fix: cohere generate api is deprecated
2025-09-18 07:29:11 -07:00
759bb6cff5
fix: cohere generate api is deprecated ( #14676 )
2025-09-18 07:27:51 -07:00
bfaab8ad7e
Merge pull request #14557 from timelfrink/fix/issue-14478-bedrock-count-tokens-endpoint
...
Implement AWS Bedrock CountTokens API support
2025-09-17 23:51:06 -07:00
ff36dfdc76
Merge pull request #14637 from akraines/feature/middle-truncate-spend-logs
...
feat: implement middle-truncation for spend log payloads
2025-09-17 23:47:04 -07:00
e7bc700b20
Merge pull request #14640 from Sameerlite/litellm_gardrail_default_latest_message
...
[Feat]Add last message as default in gaurdrail
2025-09-17 23:42:40 -07:00
7538fc0def
Fix mypy type annotations in transformation.py
...
- Add explicit type annotation for transformed_message dict
- Resolves mypy errors while maintaining functionality
- All tests continue to pass
2025-09-18 08:34:05 +02:00
c234b13275
Apply code formatting and linting fixes
...
- Apply Black formatting to all Bedrock CountTokens files
- Clean up imports and remove unused variables in tests
- Fix indentation and simplify test structure
- Fix pyright type error with type ignore annotation
- All tests continue to pass after cleanup
2025-09-18 08:28:17 +02:00
=