Krrish Dholakia 35cf6ef0a1 batch completions for vllm now works too

2023-09-06 19:26:19 -07:00

..

__pycache__

batch completions for vllm now works too

2023-09-06 19:26:19 -07:00

integrations

update streaming docs to show it working for async completion calls

2023-09-05 09:18:37 -07:00

llms

batch completions for vllm now works too

2023-09-06 19:26:19 -07:00

tests

batch completions for vllm now works too

2023-09-06 19:26:19 -07:00

__init__.py

adding support for vllm

2023-09-06 18:07:44 -07:00

_version.py

formatting improvements

2023-08-28 09:20:50 -07:00

.DS_Store

version 0.1.2

2023-07-31 08:48:49 -07:00

caching.py

fix redis caching

2023-08-28 22:10:15 -07:00

config.json

new config.json

2023-09-01 14:16:12 -07:00

exceptions.py

fix linting issues

2023-09-06 10:41:52 -07:00

gpt_cache.py

fix caching

2023-08-28 14:53:41 -07:00

main.py

batch completions for vllm now works too

2023-09-06 19:26:19 -07:00

testing.py

use api_base instead of custom_api_base

2023-09-02 17:11:30 -07:00

timeout.py

fix timeouts + tests + bump v

2023-09-05 17:17:58 -07:00

utils.py

allow users to pass custom timing for replicate

2023-09-06 18:32:40 -07:00