Commit Graph

1046 Commits

Author SHA1 Message Date
Krrish Dholakia 35cf6ef0a1 batch completions for vllm now works too 2023-09-06 19:26:19 -07:00
Krish Dholakia 4a263f6ab7 Rename Local_HF_Testing.ipynb to VLLM_Model_Testing.ipynb 2023-09-06 19:25:43 -07:00
Krish Dholakia 7b1c174547 Add files via upload 2023-09-06 19:25:16 -07:00
ishaan-jaff 2706175d22 add completion costs notebook 2023-09-06 18:43:09 -07:00
ishaan-jaff 2880a7b6b4 allow users to pass custom timing for replicate 2023-09-06 18:32:40 -07:00
ishaan-jaff fc7ad0c245 bump v 2023-09-06 18:14:58 -07:00
ishaan-jaff 8b3b682000 add replicate pricing 2023-09-06 18:14:34 -07:00
Krrish Dholakia 4cfcabd919 adding support for vllm 2023-09-06 18:07:44 -07:00
ishaan-jaff 9abefa18b8 add max_tokens.json back to community resources 2023-09-06 17:31:49 -07:00
ishaan-jaff a948e3ac89 docs update 2023-09-06 17:21:55 -07:00
ishaan-jaff bd77d5ac21 docs update 2023-09-06 17:16:24 -07:00
ishaan-jaff 1ba6b6761b show pricing for tg ai completion 2023-09-06 17:10:49 -07:00
ishaan-jaff 04f8b20651 fix linting errors @krrishdholakia 2023-09-06 16:38:42 -07:00
ishaan-jaff c5151aa573 move model_prices to root github 2023-09-06 16:31:44 -07:00
ishaan-jaff bab27634a8 rename max_tokens.json 2023-09-06 16:28:17 -07:00
ishaan-jaff fbd67bc24c add experimental together_computer cost calc 2023-09-06 16:08:44 -07:00
ishaan-jaff 1847c03c94 update max_tokens.json 2023-09-06 14:34:28 -07:00
ishaan-jaff 7b5dbd2b61 add open in colab button 2023-09-06 13:20:17 -07:00
ishaan-jaff e20df68413 add LiteLLM_batch_completions cookbook 2023-09-06 13:17:49 -07:00
Krrish Dholakia 0ace48d719 update custom prompt template function 2023-09-06 13:14:36 -07:00
ishaan-jaff 8440791e04 add batch_completions to docs 2023-09-06 13:08:28 -07:00
ishaan-jaff 2b424c8a3e docs 2023-09-06 12:40:52 -07:00
ishaan-jaff 842d6fa4df docs update 2023-09-06 12:38:46 -07:00
ishaan-jaff bee1c02d9d docs replicate 2023-09-06 12:38:06 -07:00
ishaan-jaff 4cf6900eae fix replicate docs 2023-09-06 12:35:50 -07:00
ishaan-jaff 951554d015 docs update replicate 2023-09-06 12:33:34 -07:00
ishaan-jaff 7ea4fe8528 replicate LLMs docs 2023-09-06 12:32:13 -07:00
ishaan-jaff dc0c084813 improve replicate usage 2023-09-06 12:29:34 -07:00
Krrish Dholakia 1bf4bfa85f bump version 2023-09-06 12:07:47 -07:00
Krrish Dholakia 4bcfa71e11 commenting out flaky circle ci test 2023-09-06 12:07:47 -07:00
ishaan-jaff 601a6a4a92 better documentation on __init__ 2023-09-06 11:31:52 -07:00
Krrish Dholakia 421343b7b8 bump version 2023-09-06 11:30:40 -07:00
Krrish Dholakia 91d2a57970 update linting 2023-09-06 11:30:40 -07:00
ishaan-jaff cfe35580e2 add support for flant5 2023-09-06 11:28:43 -07:00
Krrish Dholakia 44f71aa321 logging replicate response logs 2023-09-06 11:28:40 -07:00
ishaan-jaff 1da6026622 add flan + vicuna + fix replicate errors 2023-09-06 11:23:58 -07:00
Krrish Dholakia 48ee4a08ac updates 2023-09-06 11:21:48 -07:00
ishaan-jaff af60b2ba77 add vicuna translation 2023-09-06 11:14:24 -07:00
Krrish Dholakia afcd6b28cc bump version 2023-09-06 11:05:11 -07:00
ishaan-jaff 0ddda7c035 send optional_params for llama2-70b chat replicate 2023-09-06 11:01:39 -07:00
Krrish Dholakia d236d68fa4 fix linting issues 2023-09-06 10:41:52 -07:00
ishaan-jaff d4c4a138ca add replicate support for max_tokens 2023-09-06 10:38:21 -07:00
Krrish Dholakia ef43141554 updates to exception mapping 2023-09-06 10:36:22 -07:00
ishaan-jaff d0b16892e0 fix replicate supported llms 2023-09-06 10:28:03 -07:00
ishaan-jaff bc9b629726 add Replicate Error class 2023-09-06 10:25:40 -07:00
ishaan-jaff 1c61b7b229 add replicate streaming 2023-09-06 10:23:13 -07:00
ishaan-jaff c45b132675 use replicate http requests instead 2023-09-06 09:43:05 -07:00
Krrish Dholakia 3d6836417e adding prompt template for falcon 180b 2023-09-06 08:44:13 -07:00
Krrish Dholakia b4a9699138 update docs on together ai 2023-09-06 08:26:05 -07:00
ishaan-jaff cc4be8dd73 docs 2023-09-05 17:27:05 -07:00