Files
litellm/docs
Ajeet D'SouzaandGitHub 0533f77138 docs: add time.sleep() between streaming calls
LiteLLM's cache appears to be updated in the background. Without this `time.sleep()` call, both responses take `0.8s` to return, but after adding it, the second response returns in `0.006s`.
2024-08-28 17:59:07 +05:30
..