tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-28 10:20:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

doc cleanup

Browse Source
This commit is contained in:
Krrish Dholakia
2023-09-11 16:41:49 -07:00
parent 54c9fb7f9e
commit f23b3d6ed1
1 changed files with 0 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/my-website/docs/completion/mock_requests.md
-6
View File
@@ -20,12 +20,9 @@ mock_completion(model=model, messages=messages)
model = "gpt-3.5-turbo"
messages = [{"role": "user", "content": "Hey, I'm a mock request"}]
response = litellm.mock_completion(model=model, messages=messages, stream=True)
complete_response = ""
for chunk in response:
print(chunk) # {'choices': [{'delta': {'role': 'assistant', 'content': 'Thi'}, 'finish_reason': None}]}
complete_response += chunk["choices"][0]["delta"]["content"]
if complete_response == "":
raise Exception("Empty response received")
```
## set mock response
@@ -35,12 +32,9 @@ You can also customize the mock response text returned. By default it's set to -
model = "gpt-3.5-turbo"
messages = [{"role": "user", "content": "Hey, I'm a mock request"}]
response = litellm.mock_completion(model=model, messages=messages, mock_response="My custom mock response", stream=True)
complete_response = ""
for chunk in response:
print(chunk) # {'choices': [{'delta': {'role': 'assistant', 'content': 'My '}, 'finish_reason': None}]}
complete_response += chunk["choices"][0]["delta"]["content"]
if complete_response == "":
raise Exception("Empty response received")
```
## (Non-streaming) Mock Response Object