From 2c778798224c1fbcdecd24065934f14e4e33ef50 Mon Sep 17 00:00:00 2001 From: ishaan-jaff Date: Mon, 2 Oct 2023 09:04:34 -0700 Subject: [PATCH] add petals streaming to docs --- docs/my-website/docs/providers/petals.md | 14 ++++++++++++++ 1 file changed, 14 insertions(+) diff --git a/docs/my-website/docs/providers/petals.md b/docs/my-website/docs/providers/petals.md index c73fa6206f..b5dd1705b4 100644 --- a/docs/my-website/docs/providers/petals.md +++ b/docs/my-website/docs/providers/petals.md @@ -25,6 +25,20 @@ response = completion( print(response) ``` +## Usage with Streaming + +```python +response = completion( + model="petals/petals-team/StableBeluga2", + messages=[{ "content": "Hello, how are you?","role": "user"}], + stream=True +) + +print(response) +for chunk in response: + print(chunk) +``` + ### Model Details | Model Name | Function Call |