kejunleng 4e32479e7d feat(dashscope): preserve cache_control for explicit prompt caching (#25331) ...

DashScope inherits OpenAIGPTConfig which strips cache_control from
messages and tools by default. Override remove_cache_control_flag_from_messages_and_tools()
to preserve cache_control, following the same pattern used by ZAI, MiniMax, and Databricks.

Verified through 10-round multi-turn conversation tests:
- Explicit caching works correctly: cached_tokens grows each round from R4 onwards,
  with cache_creation_tokens reported on first cache build.
- Implicit caching is not affected: models that rely on implicit prefix-matching caching
  produce identical cached_tokens with and without this change, confirmed by comparing
  results against both the reverted codebase and direct API calls bypassing litellm.
- No errors or regressions observed on any model, including those that do not support
  explicit caching — the DashScope API silently ignores unrecognized cache_control fields.

Fixes #25330

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-08 21:32:04 -07:00

..

test_dashscope_chat_transformation.py

feat(dashscope): preserve cache_control for explicit prompt caching (#25331)

2026-04-08 21:32:04 -07:00

test_dashscope_cost_calculator.py

feat: support dashscope tiered pricing

2025-11-03 20:27:25 -08:00