Krrish Dholakia
|
1addaecf48
|
docs(aws_sagemaker.md): add hf_model_name to sagemaker docs
|
2023-12-05 16:58:19 -08:00 |
|
ishaan-jaff
|
703a575a5d
|
(test) call 1 deployment on router
|
2023-12-05 16:56:38 -08:00 |
|
ishaan-jaff
|
bb6a1968b3
|
(fix) router - allow user to call 1 deployment
|
2023-12-05 16:56:38 -08:00 |
|
Krrish Dholakia
|
ff949490de
|
docs(input.md): add hf_model_name to docs
|
2023-12-05 16:56:18 -08:00 |
|
Krrish Dholakia
|
88845dddb1
|
fix(sagemaker.py): bring back llama2 templating for sagemaker
|
2023-12-05 16:42:19 -08:00 |
|
Krrish Dholakia
|
54d8a9df3f
|
fix(sagemaker.py): enable passing hf model name for prompt template
|
2023-12-05 16:31:59 -08:00 |
|
Krrish Dholakia
|
a38504ff1b
|
fix(sagemaker.py): fix meta llama model name for sagemaker custom deployment
|
2023-12-05 16:23:03 -08:00 |
|
Krrish Dholakia
|
3c60682eb4
|
fix(sagemaker.py): accept all amazon neuron llama2 models
|
2023-12-05 16:19:28 -08:00 |
|
Krrish Dholakia
|
01fc7f1931
|
fix(sagemaker.py): add support for amazon neuron llama models
|
2023-12-05 16:18:20 -08:00 |
|
ishaan-jaff
|
d2dab362df
|
(fix) proxy debugging display Init API key
|
2023-12-05 16:08:17 -08:00 |
|
Krrish Dholakia
|
b4c78c7b9e
|
fix(utils.py): support sagemaker llama2 custom endpoints
|
2023-12-05 16:05:15 -08:00 |
|
ishaan-jaff
|
09c2c1610d
|
bump: version 1.10.8 → 1.10.9
|
2023-12-05 15:37:39 -08:00 |
|
ishaan-jaff
|
c4bda13820
|
(fix) sagemaker Llama-2 70b
|
2023-12-05 15:32:17 -08:00 |
|
Krrish Dholakia
|
68ca2a28d4
|
docs: adds redis url to router + proxy docs
|
2023-12-05 15:08:00 -08:00 |
|
Krrish Dholakia
|
4d7ff1b33b
|
fix(proxy_server.py): don't override exceptions if they're of type httpexception
|
2023-12-05 14:33:28 -08:00 |
|
ishaan-jaff
|
c717ed4d05
|
(test) router: test async embedding + embedding
|
2023-12-05 14:28:23 -08:00 |
|
ishaan-jaff
|
3ff57493f4
|
(test) router: openai async, sync, stream, no stream
|
2023-12-05 14:21:37 -08:00 |
|
ishaan-jaff
|
bc70a6fba8
|
(test) router: add tests for azure completion, acompletion
|
2023-12-05 13:59:27 -08:00 |
|
ishaan-jaff
|
0d1b42eda5
|
(test) azure - test async + sync embedding
|
2023-12-05 13:35:05 -08:00 |
|
Krrish Dholakia
|
d606a9cb4c
|
refactor(router.py): linting fixes
|
2023-12-05 13:33:44 -08:00 |
|
ishaan-jaff
|
63939c0a11
|
(fix) linting
|
2023-12-05 13:30:12 -08:00 |
|
ishaan-jaff
|
1463cc6023
|
(test) router Azure regular chat completion call
|
2023-12-05 13:28:07 -08:00 |
|
ishaan-jaff
|
4e3040b357
|
(chore) linting fix
|
2023-12-05 13:23:35 -08:00 |
|
ishaan-jaff
|
e579918dd9
|
(test) Router: Test Azure acompletion, stream
|
2023-12-05 13:22:27 -08:00 |
|
Krrish Dholakia
|
58ab0a3f03
|
fix(router.py): fix cache init
|
2023-12-05 12:54:27 -08:00 |
|
ishaan-jaff
|
5829227d86
|
(test) router streaming + azure
|
2023-12-05 12:54:00 -08:00 |
|
ishaan-jaff
|
3f84ab04c4
|
(fix) router: Azure Client Init
|
2023-12-05 12:54:00 -08:00 |
|
ishaan-jaff
|
d9f083b5f8
|
(fix) router: remove misleading print statement
|
2023-12-05 12:54:00 -08:00 |
|
Krrish Dholakia
|
397eefabe1
|
test: remove local test
|
2023-12-05 12:45:52 -08:00 |
|
Krrish Dholakia
|
a9b50a12c5
|
bump: version 1.10.7 → 1.10.8
|
2023-12-05 12:38:42 -08:00 |
|
Krrish Dholakia
|
2a02fcbffb
|
fix(utils.py): map cohere finish reasons
|
2023-12-05 12:38:18 -08:00 |
|
Krrish Dholakia
|
55b34f969c
|
bump: version 1.10.6 → 1.10.7
|
2023-12-05 12:26:44 -08:00 |
|
Krrish Dholakia
|
ef7795add6
|
fix(utils.py): set text if empty string
|
2023-12-05 12:26:44 -08:00 |
|
ishaan-jaff
|
d5f67a0a25
|
(docs) proxy + langchain
|
2023-12-05 12:20:42 -08:00 |
|
ishaan-jaff
|
4f9f53f7dc
|
(docs) proxy: config example with langchain
|
2023-12-05 12:20:42 -08:00 |
|
ishaan-jaff
|
951bcfc043
|
(fix) router init: raise error Azure API Base not set
|
2023-12-05 12:20:42 -08:00 |
|
Krrish Dholakia
|
88c95ca259
|
fix(_redis.py): support additional params for redis
|
2023-12-05 12:16:51 -08:00 |
|
ishaan-jaff
|
e615f2670a
|
(docs) proxy + configs
|
2023-12-05 12:02:35 -08:00 |
|
ishaan-jaff
|
a85a9d7e00
|
(docs) using proxy with curl, OpenAI, langchain
|
2023-12-05 11:55:02 -08:00 |
|
ishaan-jaff
|
41075dc977
|
(docs) litellm proxy + langchain
|
2023-12-05 11:46:42 -08:00 |
|
ishaan-jaff
|
a0f8bf23ab
|
(test) proxy: langchain compatible
|
2023-12-05 11:45:35 -08:00 |
|
ishaan-jaff
|
f0c704f3c2
|
(docs) add example on using proxy with OpenAI
|
2023-12-05 11:45:35 -08:00 |
|
Krrish Dholakia
|
ddea62fdb1
|
refactor(proxy_server.py): clean up print statements in proxy server
|
2023-12-05 11:14:16 -08:00 |
|
Krrish Dholakia
|
b46c73a46e
|
fix: fix proxy testing
|
2023-12-05 11:13:09 -08:00 |
|
ishaan-jaff
|
a602d59645
|
(fix) bug in completion: _check_valid_arg
|
2023-12-05 10:00:54 -08:00 |
|
ishaan-jaff
|
33cf5a3371
|
bump: version 1.10.5 → 1.10.6
|
2023-12-05 09:36:59 -08:00 |
|
ishaan-jaff
|
732a049513
|
(fix) patch max_retries for non openai llms
|
2023-12-05 09:36:38 -08:00 |
|
ishaan-jaff
|
3bdf61f02a
|
(test) test bedrock on router
|
2023-12-05 09:35:08 -08:00 |
|
ishaan-jaff
|
13261287ec
|
(fix) proxy: bug non OpenAI LLMs
|
2023-12-05 09:05:53 -08:00 |
|
Krrish Dholakia
|
943bf53b0b
|
bump: version 1.10.4 → 1.10.5
|
2023-12-05 07:28:21 -08:00 |
|