From 2bb69e43154d164e9ad688c516dffbd06d161560 Mon Sep 17 00:00:00 2001 From: Ishaan Jaff Date: Sat, 15 Mar 2025 10:19:00 -0700 Subject: [PATCH] docs prompt caching --- docs/my-website/docs/completion/prompt_caching.md | 8 +++++++- docs/my-website/release_notes/v1.63.11-stable/index.md | 4 ++-- 2 files changed, 9 insertions(+), 3 deletions(-) diff --git a/docs/my-website/docs/completion/prompt_caching.md b/docs/my-website/docs/completion/prompt_caching.md index 5c795778ef..6fbf89bd6d 100644 --- a/docs/my-website/docs/completion/prompt_caching.md +++ b/docs/my-website/docs/completion/prompt_caching.md @@ -3,7 +3,13 @@ import TabItem from '@theme/TabItem'; # Prompt Caching -For OpenAI + Anthropic + Deepseek, LiteLLM follows the OpenAI prompt caching usage object format: +Supported Providers: +- OpenAI (`deepseek/`) +- Anthropic API (`anthropic/`) +- Bedrock (`bedrock/`, `bedrock/invoke/`, `bedrock/converse`) ([All models bedrock supports prompt caching on](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html)) +- Deepseek API (`deepseek/`) + +For the supported providers, LiteLLM follows the OpenAI prompt caching usage object format: ```bash "usage": { diff --git a/docs/my-website/release_notes/v1.63.11-stable/index.md b/docs/my-website/release_notes/v1.63.11-stable/index.md index 91579af815..e8a46f9aa7 100644 --- a/docs/my-website/release_notes/v1.63.11-stable/index.md +++ b/docs/my-website/release_notes/v1.63.11-stable/index.md @@ -55,8 +55,8 @@ Here's a Demo Instance to test changes: 3. **New models** -- Support OpenRouter `reasoning_content` on streaming **MISSING DOC** -- Support Bedrock converse cache token tracking **MISSING DOC** +- Support OpenRouter `reasoning_content` on streaming [Get Started](https://docs.litellm.ai/docs/reasoning_content) +- Support Bedrock converse cache token tracking [Get Started](https://docs.litellm.ai/docs/completion/prompt_caching) 4. **Bug Fixes** - Fix Bedrock chunk parsing [PR](https://github.com/BerriAI/litellm/pull/9166)