tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-22 08:24:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Ishaan Jaff
2023-10-02 12:14:27 -07:00
committed by GitHub
parent 8acad78fb3
commit ade1e6e5c0
1 changed files with 2 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -9
View File
@@ -78,21 +78,14 @@ LiteLLM supports caching `completion()` and `embedding()` calls for all LLMs
```python
import litellm
from litellm.caching import Cache
litellm.cache = Cache(type="hosted") # init cache to use api.litellm.ai
litellm.cache = Cache() # init cache to use api.litellm.ai
# Make completion calls
# stores this response in cache
response1 = litellm.completion(
model="gpt-3.5-turbo",
messages=[{"role": "user", "content": "Tell me a joke."}]
caching=True
)
response2 = litellm.completion(
model="gpt-3.5-turbo",
messages=[{"role": "user", "content": "Tell me a joke."}],
caching=True
)
# response1 == response2, response 1 is cached
```
## OpenAI Proxy Server ([Docs](https://docs.litellm.ai/docs/proxy_server))