mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-02 06:22:48 +00:00
mateo-berri
e1d32fe4d1
The reference corpus (cases, recorded fixtures, canonical-JSON snapshots for both bedrock chat routes) is copied verbatim from the translation characterization branch; each request row asserts snapshot == v1-at-HEAD (drift guard) == v2 (byte-equal). Responses and streams run full cycles against v1's transform_response and the real stream decoders inside CustomStreamWrapper at the parsed-event seam, with the corpus's fastuuid/time freeze. A quirk corpus pins bedrock-only behaviors against v1 in-process: claude-4.5 cache ttl and parallel tool config, bedrock tool-name normalization, thinking budget clamp, json_schema-with-effort dropping the forced choice, tool_choice none gates, and the explained fallbacks (pdf/file parts, non-Claude models, invoke response_format x reasoning). Seam tests drive litellm.completion() through respx-intercepted SigV4 calls for both routes. DIFFERENTIAL_REPORT.md gains the bedrock sections: 126 rows, 0 divergent.
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/test_litellm
This folder can only run mock tests.