Commit Graph
4109 Commits
Author SHA1 Message Date
ishaan-jaff 4e3040b357 (chore) linting fix 2023-12-05 13:23:35 -08:00
ishaan-jaff e579918dd9 (test) Router: Test Azure acompletion, stream 2023-12-05 13:22:27 -08:00
Krrish Dholakia 58ab0a3f03 fix(router.py): fix cache init 2023-12-05 12:54:27 -08:00
ishaan-jaff 5829227d86 (test) router streaming + azure 2023-12-05 12:54:00 -08:00
ishaan-jaff 3f84ab04c4 (fix) router: Azure Client Init 2023-12-05 12:54:00 -08:00
ishaan-jaff d9f083b5f8 (fix) router: remove misleading print statement 2023-12-05 12:54:00 -08:00
Krrish Dholakia 397eefabe1 test: remove local test 2023-12-05 12:45:52 -08:00
Krrish Dholakia a9b50a12c5 bump: version 1.10.7 → 1.10.8 2023-12-05 12:38:42 -08:00
Krrish Dholakia 2a02fcbffb fix(utils.py): map cohere finish reasons 2023-12-05 12:38:18 -08:00
Krrish Dholakia 55b34f969c bump: version 1.10.6 → 1.10.7 2023-12-05 12:26:44 -08:00
Krrish Dholakia ef7795add6 fix(utils.py): set text if empty string 2023-12-05 12:26:44 -08:00
ishaan-jaff d5f67a0a25 (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff 4f9f53f7dc (docs) proxy: config example with langchain 2023-12-05 12:20:42 -08:00
ishaan-jaff 951bcfc043 (fix) router init: raise error Azure API Base not set 2023-12-05 12:20:42 -08:00
Krrish Dholakia 88c95ca259 fix(_redis.py): support additional params for redis 2023-12-05 12:16:51 -08:00
ishaan-jaff e615f2670a (docs) proxy + configs 2023-12-05 12:02:35 -08:00
ishaan-jaff a85a9d7e00 (docs) using proxy with curl, OpenAI, langchain 2023-12-05 11:55:02 -08:00
ishaan-jaff 41075dc977 (docs) litellm proxy + langchain 2023-12-05 11:46:42 -08:00
ishaan-jaff a0f8bf23ab (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
ishaan-jaff f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
Krrish Dholakia ddea62fdb1 refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
ishaan-jaff a602d59645 (fix) bug in completion: _check_valid_arg 2023-12-05 10:00:54 -08:00
ishaan-jaff 33cf5a3371 bump: version 1.10.5 → 1.10.6 2023-12-05 09:36:59 -08:00
ishaan-jaff 732a049513 (fix) patch max_retries for non openai llms 2023-12-05 09:36:38 -08:00
ishaan-jaff 3bdf61f02a (test) test bedrock on router 2023-12-05 09:35:08 -08:00
ishaan-jaff 13261287ec (fix) proxy: bug non OpenAI LLMs 2023-12-05 09:05:53 -08:00
Krrish Dholakia 943bf53b0b bump: version 1.10.4 → 1.10.5 2023-12-05 07:28:21 -08:00
Krrish Dholakia 71e64c34cb fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses 2023-12-05 07:28:21 -08:00
Krish Dholakia 1ff8f75752 Updated config.yml 2023-12-04 21:19:32 -08:00
ishaan-jaff 9ba17657ad (feat) init redis cache with **kwargs v1.10.4 2023-12-04 20:50:08 -08:00
Krrish Dholakia 31f3187670 test: fix linting errors 2023-12-04 18:43:01 -08:00
Krrish Dholakia 030bd22078 feat(proxy_server.py): allow user to override api key auth 2023-12-04 18:32:58 -08:00
ishaan-jaff 51cddf1e97 bump: version 1.10.3 → 1.10.4 2023-12-04 18:09:25 -08:00
ishaan-jaff ac486a3c4a (docs) add example config.yaml 2023-12-04 18:08:57 -08:00
ishaan-jaff 05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff 3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
ishaan-jaff fa5b453d39 (test) init router 2023-12-04 17:31:12 -08:00
ishaan-jaff 19646091fd (feat) router: init stream, async stream, async, clients 2023-12-04 17:31:12 -08:00
ishaan-jaff 886b52d448 (test) init router clients 2023-12-04 17:31:12 -08:00
ishaan-jaff cba98cf530 (test) init router with 4 clients 2023-12-04 17:31:12 -08:00
Krrish Dholakia 7adb8f493d docs(custom_callback.md): add async callbacks to docs 2023-12-04 17:01:46 -08:00
Krrish Dholakia e0ccb281d8 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
Krish DholakiaandGitHub b90fcbdac4 Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff 1247afb7a4 (feat) router: set max_retries + timeout 2023-12-04 16:09:31 -08:00
ishaan-jaff a9905bcd0a (test) fix config 2023-12-04 16:00:04 -08:00
ishaan-jaff bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff 9b3a0c69f5 (fix) config testing 2023-12-04 15:24:46 -08:00
ishaan-jaff b7281825d3 (test) add streaming sagemaker test 2023-12-04 15:20:06 -08:00