Commit Graph
4131 Commits
Author SHA1 Message Date
Krrish Dholakia 1addaecf48 docs(aws_sagemaker.md): add hf_model_name to sagemaker docs 2023-12-05 16:58:19 -08:00
ishaan-jaff 703a575a5d (test) call 1 deployment on router 2023-12-05 16:56:38 -08:00
ishaan-jaff bb6a1968b3 (fix) router - allow user to call 1 deployment 2023-12-05 16:56:38 -08:00
Krrish Dholakia ff949490de docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia 88845dddb1 fix(sagemaker.py): bring back llama2 templating for sagemaker 2023-12-05 16:42:19 -08:00
Krrish Dholakia 54d8a9df3f fix(sagemaker.py): enable passing hf model name for prompt template 2023-12-05 16:31:59 -08:00
Krrish Dholakia a38504ff1b fix(sagemaker.py): fix meta llama model name for sagemaker custom deployment 2023-12-05 16:23:03 -08:00
Krrish Dholakia 3c60682eb4 fix(sagemaker.py): accept all amazon neuron llama2 models 2023-12-05 16:19:28 -08:00
Krrish Dholakia 01fc7f1931 fix(sagemaker.py): add support for amazon neuron llama models 2023-12-05 16:18:20 -08:00
ishaan-jaff d2dab362df (fix) proxy debugging display Init API key 2023-12-05 16:08:17 -08:00
Krrish Dholakia b4c78c7b9e fix(utils.py): support sagemaker llama2 custom endpoints 2023-12-05 16:05:15 -08:00
ishaan-jaff 09c2c1610d bump: version 1.10.8 → 1.10.9 2023-12-05 15:37:39 -08:00
ishaan-jaff c4bda13820 (fix) sagemaker Llama-2 70b 2023-12-05 15:32:17 -08:00
Krrish Dholakia 68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
Krrish Dholakia 4d7ff1b33b fix(proxy_server.py): don't override exceptions if they're of type httpexception 2023-12-05 14:33:28 -08:00
ishaan-jaff c717ed4d05 (test) router: test async embedding + embedding 2023-12-05 14:28:23 -08:00
ishaan-jaff 3ff57493f4 (test) router: openai async, sync, stream, no stream 2023-12-05 14:21:37 -08:00
ishaan-jaff bc70a6fba8 (test) router: add tests for azure completion, acompletion 2023-12-05 13:59:27 -08:00
ishaan-jaff 0d1b42eda5 (test) azure - test async + sync embedding 2023-12-05 13:35:05 -08:00
Krrish Dholakia d606a9cb4c refactor(router.py): linting fixes 2023-12-05 13:33:44 -08:00
ishaan-jaff 63939c0a11 (fix) linting 2023-12-05 13:30:12 -08:00
ishaan-jaff 1463cc6023 (test) router Azure regular chat completion call 2023-12-05 13:28:07 -08:00
ishaan-jaff 4e3040b357 (chore) linting fix 2023-12-05 13:23:35 -08:00
ishaan-jaff e579918dd9 (test) Router: Test Azure acompletion, stream 2023-12-05 13:22:27 -08:00
Krrish Dholakia 58ab0a3f03 fix(router.py): fix cache init 2023-12-05 12:54:27 -08:00
ishaan-jaff 5829227d86 (test) router streaming + azure 2023-12-05 12:54:00 -08:00
ishaan-jaff 3f84ab04c4 (fix) router: Azure Client Init 2023-12-05 12:54:00 -08:00
ishaan-jaff d9f083b5f8 (fix) router: remove misleading print statement 2023-12-05 12:54:00 -08:00
Krrish Dholakia 397eefabe1 test: remove local test 2023-12-05 12:45:52 -08:00
Krrish Dholakia a9b50a12c5 bump: version 1.10.7 → 1.10.8 2023-12-05 12:38:42 -08:00
Krrish Dholakia 2a02fcbffb fix(utils.py): map cohere finish reasons 2023-12-05 12:38:18 -08:00
Krrish Dholakia 55b34f969c bump: version 1.10.6 → 1.10.7 2023-12-05 12:26:44 -08:00
Krrish Dholakia ef7795add6 fix(utils.py): set text if empty string 2023-12-05 12:26:44 -08:00
ishaan-jaff d5f67a0a25 (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff 4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff 951bcfc043 (fix) router init: raise error Azure API Base not set 2023-12-05 12:20:42 -08:00
Krrish Dholakia 88c95ca259 fix(_redis.py): support additional params for redis 2023-12-05 12:16:51 -08:00
ishaan-jaff e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff 41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff a0f8bf23ab (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
ishaan-jaff f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
Krrish Dholakia ddea62fdb1 refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
ishaan-jaff a602d59645 (fix) bug in completion: _check_valid_arg 2023-12-05 10:00:54 -08:00
ishaan-jaff 33cf5a3371 bump: version 1.10.5 → 1.10.6 2023-12-05 09:36:59 -08:00
ishaan-jaff 732a049513 (fix) patch max_retries for non openai llms 2023-12-05 09:36:38 -08:00
ishaan-jaff 3bdf61f02a (test) test bedrock on router 2023-12-05 09:35:08 -08:00
ishaan-jaff 13261287ec (fix) proxy: bug non OpenAI LLMs 2023-12-05 09:05:53 -08:00
Krrish Dholakia 943bf53b0b bump: version 1.10.4 → 1.10.5 2023-12-05 07:28:21 -08:00