tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-18 02:23:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs prompt caching

Browse Source
This commit is contained in:
Ishaan Jaff
2025-03-15 10:19:00 -07:00
parent 571a09975a
commit 2bb69e4315
2 changed files with 9 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/completion/prompt_caching.md
+7 -1
View File
@@ -3,7 +3,13 @@ import TabItem from '@theme/TabItem';
# Prompt Caching
For OpenAI + Anthropic + Deepseek, LiteLLM follows the OpenAI prompt caching usage object format:
Supported Providers:
- OpenAI (`deepseek/`)
- Anthropic API (`anthropic/`)
- Bedrock (`bedrock/`, `bedrock/invoke/`, `bedrock/converse`) ([All models bedrock supports prompt caching on](https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html))
- Deepseek API (`deepseek/`)
For the supported providers, LiteLLM follows the OpenAI prompt caching usage object format:
```bash
"usage": {
docs/my-website/release_notes/v1.63.11-stable/index.md
+2 -2
View File
@@ -55,8 +55,8 @@ Here's a Demo Instance to test changes:
3. **New models**
- Support OpenRouter `reasoning_content` on streaming **MISSING DOC**
- Support Bedrock converse cache token tracking **MISSING DOC**
- Support OpenRouter `reasoning_content` on streaming [Get Started](https://docs.litellm.ai/docs/reasoning_content)
- Support Bedrock converse cache token tracking [Get Started](https://docs.litellm.ai/docs/completion/prompt_caching)
4. **Bug Fixes**
- Fix Bedrock chunk parsing [PR](https://github.com/BerriAI/litellm/pull/9166)