From 297c2a0bf4eec3596214acf4abe56dff04ccc6ff Mon Sep 17 00:00:00 2001 From: Boxuan Li Date: Thu, 30 Oct 2025 20:13:13 -0700 Subject: [PATCH] prompt_caching.md: Fix wrong prompt_tokens definition (#16044) --- docs/my-website/docs/completion/prompt_caching.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/my-website/docs/completion/prompt_caching.md b/docs/my-website/docs/completion/prompt_caching.md index c8adf4bccc..630c9e58d2 100644 --- a/docs/my-website/docs/completion/prompt_caching.md +++ b/docs/my-website/docs/completion/prompt_caching.md @@ -27,7 +27,7 @@ For the supported providers, LiteLLM follows the OpenAI prompt caching usage obj } ``` -- `prompt_tokens`: These are the non-cached prompt tokens (same as Anthropic, equivalent to Deepseek `prompt_cache_miss_tokens`). +- `prompt_tokens`: These are all prompt tokens including cache-miss and cache-hit input tokens. - `completion_tokens`: These are the output tokens generated by the model. - `total_tokens`: Sum of prompt_tokens + completion_tokens. - `prompt_tokens_details`: Object containing cached_tokens.