Commit Graph
3756 Commits
Author SHA1 Message Date
ishaan-jaff 3ca4487e77 (feat) proxy set num_retries=3 2023-11-27 19:33:59 -08:00
Krrish Dholakia 60a4906505 bump: version 1.7.7 → 1.7.8 2023-11-27 19:11:48 -08:00
Krrish Dholakia be9fa06da6 fix(main.py): fix linting errors 2023-11-27 19:11:38 -08:00
Krrish Dholakia e8331a4647 fix(utils.py): azure tool calling streaming 2023-11-27 19:07:38 -08:00
Krrish Dholakia 4cdd930fa2 fix(stream_chunk_builder): adding support for tool calling in completion counting 2023-11-27 18:39:47 -08:00
ishaan-jaff 40d9e8ab23 (test) load test 2023-11-27 18:08:47 -08:00
ishaan-jaff 50733363ee (feat) use api_base, api_key as model 2023-11-27 18:08:47 -08:00
ishaan-jaff 9cef551623 (feat) raise APIConnectionError error for Azure +OpenAI 2023-11-27 18:08:47 -08:00
Krrish Dholakia 04f745e314 fix(router.py): speed improvements to the router 2023-11-27 17:35:26 -08:00
ishaan-jaff 8560794963 (test) load test router 2023-11-27 16:37:57 -08:00
ishaan-jaff 18d9222945 (test) litellm using uuid for model name 2023-11-27 16:37:39 -08:00
ishaan-jaff 4265f9b2ef (fix) router: allow same model/name 2023-11-27 16:26:09 -08:00
ishaan-jaff ba228a9e0a (fix) proxy set litellm attributes 2023-11-27 13:39:18 -08:00
ishaan-jaff d7dd9f0307 (docs) health check proxy llms 2023-11-27 12:20:15 -08:00
ishaan-jaff 5e2c13fb11 (test) load test proxy completion 2023-11-27 12:13:21 -08:00
ishaan-jaff 9747cc5aad (feat) --health for checking config models 2023-11-27 12:13:21 -08:00
Krrish Dholakia 56bb39e52c fix(acompletion): fix acompletion raise exception issue when custom llm provider is none 2023-11-27 11:34:48 -08:00
ishaan-jaff 37f3b1edd1 (ci/cd) run again 2023-11-27 11:12:11 -08:00
ishaan-jaff 9d259d08e7 (linting) fix 2023-11-27 10:27:51 -08:00
ishaan-jaff f54c4ee4b8 (docs) sagemaker add chat llms 2023-11-27 10:24:32 -08:00
ishaan-jaff 18ca445bc2 bump: version 1.7.6 → 1.7.7 2023-11-27 10:14:03 -08:00
ishaan-jaff a4754f9098 (test) competion 2023-11-27 10:13:46 -08:00
ishaan-jaff 26938f697e (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
ishaan-jaff 90687d51f1 (test) sagemaker add chat models 2023-11-27 10:11:56 -08:00
ishaan-jaff f7ae01da8a (feat) completion:sagemaker - support chat models 2023-11-27 10:11:10 -08:00
ishaan-jaff b732d4c394 (feat) model context json: add sagemaker 2023-11-27 09:55:53 -08:00
ishaan-jaff e407b185ee (feat) completion:sagemaker - better debugging 2023-11-27 09:08:20 -08:00
ishaan-jaff d0538e32c9 (feat) completion: sagemaker debugging - show boto3 request sent 2023-11-27 09:04:50 -08:00
Krrish Dholakia 9b5f52ae63 bump: version 1.7.5 → 1.7.6 2023-11-27 08:04:49 -08:00
Krrish Dholakia aafba24e84 fix(proxy_server.py): fix user model returned in /models 2023-11-27 08:04:49 -08:00
ishaan-jaff e9947be7b2 (fix) add timeout to __init__ litellm 2023-11-27 07:49:18 -08:00
Krrish Dholakia f6d40c2241 bump: version 1.7.4 → 1.7.5 2023-11-25 19:34:39 -08:00
Krrish Dholakia 59ba1560e5 fix(router.py): fix fallbacks 2023-11-25 19:34:20 -08:00
Krrish Dholakia cc3d7da9a0 bump: version 1.7.3 → 1.7.4 2023-11-25 18:46:57 -08:00
Krrish Dholakia fa713abfc3 fix(router.py): check for fallbacks in completion params for router 2023-11-25 18:46:45 -08:00
Krrish Dholakia 793d3ecf81 bump: version 1.7.2 → 1.7.3 2023-11-25 18:28:53 -08:00
Krrish Dholakia e4f302a8e2 fix(proxy_server.py): expose a /health endpoint 2023-11-25 18:28:47 -08:00
ishaan-jaff 2c4f52b6b1 (fix) linting 2023-11-25 15:46:07 -08:00
ishaan-jaff 0b56d584aa (test) openai exception mapping for openai.AuthenticationError 2023-11-25 15:43:46 -08:00
ishaan-jaff afaca3f819 (fix) acompletion: Raise same error as completion 2023-11-25 15:33:46 -08:00
Krrish Dholakia 770359d6db bump: version 1.7.1 → 1.7.2 v1.7.1 2023-11-25 14:58:20 -08:00
Krrish Dholakia ab0bc87427 fix(router.py): check if fallbacks is none 2023-11-25 14:58:07 -08:00
Krrish Dholakia 95579fda7d fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
Krrish Dholakia 2eb7386095 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
Krrish Dholakia e43e1e9ab1 fix(utils.py): fix linting errors 2023-11-25 14:19:14 -08:00
Krrish Dholakia ec81b393e2 fix(utils.py): fix linting erros 2023-11-25 14:14:46 -08:00
Krrish Dholakia a070bee5be fix(utils.py): fix linting issues 2023-11-25 14:11:40 -08:00
Krrish Dholakia 8970f12780 fix(utils.py): fix linting issues 2023-11-25 13:48:50 -08:00
Krrish Dholakia 6d9f7b8f9d fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
ishaan-jaff a688df79b1 (feat) proxy: make chat/completions async 2023-11-25 12:54:03 -08:00