From be44735de4c53087cffab6400a0075cf6aa9632a Mon Sep 17 00:00:00 2001 From: Teddy Amkie Date: Thu, 25 Sep 2025 15:45:13 -0700 Subject: [PATCH] Update docs to reflect session management for all models (#14914) Co-authored-by: Cursor Agent --- docs/my-website/docs/response_api.md | 4 ++-- docs/my-website/release_notes/v1.67.4-stable/index.md | 2 +- docs/my-website/static/llms-full.txt | 8 ++++---- 3 files changed, 7 insertions(+), 7 deletions(-) diff --git a/docs/my-website/docs/response_api.md b/docs/my-website/docs/response_api.md index 94d7c73be0..3e9d6683c2 100644 --- a/docs/my-website/docs/response_api.md +++ b/docs/my-website/docs/response_api.md @@ -795,9 +795,9 @@ curl http://localhost:4000/v1/responses \ -## Session Management - Non-OpenAI Models +## Session Management -LiteLLM Proxy supports session management for non-OpenAI models. This allows you to store and fetch conversation history (state) in LiteLLM Proxy. +LiteLLM Proxy supports session management for all supported models. This allows you to store and fetch conversation history (state) in LiteLLM Proxy. #### Usage diff --git a/docs/my-website/release_notes/v1.67.4-stable/index.md b/docs/my-website/release_notes/v1.67.4-stable/index.md index 6750ced47c..93a27155d2 100644 --- a/docs/my-website/release_notes/v1.67.4-stable/index.md +++ b/docs/my-website/release_notes/v1.67.4-stable/index.md @@ -106,7 +106,7 @@ This release allow you to group requests to LiteLLM proxy into a session. If you 1. Added support for max_completion_tokens parameter [Get Started](https://docs.litellm.ai/docs/providers/sagemaker), [PR](https://github.com/BerriAI/litellm/pull/10300) - **Responses API** 1. Added support for GET and DELETE operations - `/v1/responses/{response_id}` [Get Started](../../docs/response_api) - 2. Added session management support for non-OpenAI models [PR](https://github.com/BerriAI/litellm/pull/10321) + 2. Added session management support for all supported models [PR](https://github.com/BerriAI/litellm/pull/10321) 3. Added routing affinity to maintain model consistency within sessions [Get Started](https://docs.litellm.ai/docs/response_api#load-balancing-with-routing-affinity), [PR](https://github.com/BerriAI/litellm/pull/10193) diff --git a/docs/my-website/static/llms-full.txt b/docs/my-website/static/llms-full.txt index c64d417096..203dfd12ba 100644 --- a/docs/my-website/static/llms-full.txt +++ b/docs/my-website/static/llms-full.txt @@ -1699,7 +1699,7 @@ This release allow you to group requests to LiteLLM proxy into a session. If you 1. Added support for max\_completion\_tokens parameter [Get Started](https://docs.litellm.ai/docs/providers/sagemaker), [PR](https://github.com/BerriAI/litellm/pull/10300) - **Responses API** 1. Added support for GET and DELETE operations - `/v1/responses/{response_id}` [Get Started](https://docs.litellm.ai/docs/response_api) -2. Added session management support for non-OpenAI models [PR](https://github.com/BerriAI/litellm/pull/10321) +2. Added session management support for all supported models [PR](https://github.com/BerriAI/litellm/pull/10321) 3. Added routing affinity to maintain model consistency within sessions [Get Started](https://docs.litellm.ai/docs/response_api#load-balancing-with-routing-affinity), [PR](https://github.com/BerriAI/litellm/pull/10193) ## Spend Tracking Improvements [​](https://docs.litellm.ai/release_notes\#spend-tracking-improvements "Direct link to Spend Tracking Improvements") @@ -7736,7 +7736,7 @@ This release allow you to group requests to LiteLLM proxy into a session. If you 1. Added support for max\_completion\_tokens parameter [Get Started](https://docs.litellm.ai/docs/providers/sagemaker), [PR](https://github.com/BerriAI/litellm/pull/10300) - **Responses API** 1. Added support for GET and DELETE operations - `/v1/responses/{response_id}` [Get Started](https://docs.litellm.ai/docs/response_api) -2. Added session management support for non-OpenAI models [PR](https://github.com/BerriAI/litellm/pull/10321) +2. Added session management support for all supported models [PR](https://github.com/BerriAI/litellm/pull/10321) 3. Added routing affinity to maintain model consistency within sessions [Get Started](https://docs.litellm.ai/docs/response_api#load-balancing-with-routing-affinity), [PR](https://github.com/BerriAI/litellm/pull/10193) ## Spend Tracking Improvements [​](https://docs.litellm.ai/release_notes/tags/responses-api\#spend-tracking-improvements "Direct link to Spend Tracking Improvements") @@ -8295,7 +8295,7 @@ This release allow you to group requests to LiteLLM proxy into a session. If you 1. Added support for max\_completion\_tokens parameter [Get Started](https://docs.litellm.ai/docs/providers/sagemaker), [PR](https://github.com/BerriAI/litellm/pull/10300) - **Responses API** 1. Added support for GET and DELETE operations - `/v1/responses/{response_id}` [Get Started](https://docs.litellm.ai/docs/response_api) -2. Added session management support for non-OpenAI models [PR](https://github.com/BerriAI/litellm/pull/10321) +2. Added session management support for all supported models [PR](https://github.com/BerriAI/litellm/pull/10321) 3. Added routing affinity to maintain model consistency within sessions [Get Started](https://docs.litellm.ai/docs/response_api#load-balancing-with-routing-affinity), [PR](https://github.com/BerriAI/litellm/pull/10193) ## Spend Tracking Improvements [​](https://docs.litellm.ai/release_notes/tags/security\#spend-tracking-improvements "Direct link to Spend Tracking Improvements") @@ -8821,7 +8821,7 @@ This release allow you to group requests to LiteLLM proxy into a session. If you 1. Added support for max\_completion\_tokens parameter [Get Started](https://docs.litellm.ai/docs/providers/sagemaker), [PR](https://github.com/BerriAI/litellm/pull/10300) - **Responses API** 1. Added support for GET and DELETE operations - `/v1/responses/{response_id}` [Get Started](https://docs.litellm.ai/docs/response_api) -2. Added session management support for non-OpenAI models [PR](https://github.com/BerriAI/litellm/pull/10321) +2. Added session management support for all supported models [PR](https://github.com/BerriAI/litellm/pull/10321) 3. Added routing affinity to maintain model consistency within sessions [Get Started](https://docs.litellm.ai/docs/response_api#load-balancing-with-routing-affinity), [PR](https://github.com/BerriAI/litellm/pull/10193) ## Spend Tracking Improvements [​](https://docs.litellm.ai/release_notes/tags/session-management\#spend-tracking-improvements "Direct link to Spend Tracking Improvements")