Cesar Garcia 491f57a349 feat: Add support for reasoning_effort="none" for Gemini models (#16548) ...

Implements support for reasoning_effort="none" parameter for Gemini models,
providing significant cost savings (up to 96% cheaper) by disabling thinking
budget while maintaining response quality.

Changes:
- Added "supports_reasoning": true to gemini-2.0-flash-thinking-exp-01-21 in model config
- Implemented mapping for reasoning_effort="none" to thinkingConfig {thinkingBudget: 0, includeThoughts: false}
- Added unit test to verify the mapping works correctly

Performance impact:
- Without reasoning_effort: ~313 tokens
- With reasoning_effort="none": ~12 tokens (96% cheaper)

Closes #16420

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

2025-11-12 19:41:07 -08:00

..

my-website

feat: Add support for reasoning_effort="none" for Gemini models (#16548)

2025-11-12 19:41:07 -08:00