mirror of
https://github.com/tiennm99/litellm.git
synced 2026-07-10 23:06:52 +00:00
5d326386fb
Add support for the Bedrock Converse API serviceTier parameter to allow specifying processing tier (priority, default, or flex). Changes: - Add ServiceTierBlock type in litellm/types/llms/bedrock.py - Add serviceTier to CommonRequestObject - Add serviceTier to get_config_blocks() in AmazonConverseConfig - Add comprehensive tests for serviceTier functionality - Add documentation for serviceTier usage This allows users to configure service tier via: - litellm_params in proxy config - optional_params in SDK calls
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/test_litellm
This folder can only run mock tests.