Commit Graph

4090 Commits

Author SHA1 Message Date
ishaan-jaff f0c704f3c2 (docs) add example on using proxy with OpenAI 2023-12-05 11:45:35 -08:00
Krrish Dholakia ddea62fdb1 refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
ishaan-jaff a602d59645 (fix) bug in completion: _check_valid_arg 2023-12-05 10:00:54 -08:00
ishaan-jaff 33cf5a3371 bump: version 1.10.5 → 1.10.6 2023-12-05 09:36:59 -08:00
ishaan-jaff 732a049513 (fix) patch max_retries for non openai llms 2023-12-05 09:36:38 -08:00
ishaan-jaff 3bdf61f02a (test) test bedrock on router 2023-12-05 09:35:08 -08:00
ishaan-jaff 13261287ec (fix) proxy: bug non OpenAI LLMs 2023-12-05 09:05:53 -08:00
Krrish Dholakia 943bf53b0b bump: version 1.10.4 → 1.10.5 2023-12-05 07:28:21 -08:00
Krrish Dholakia 71e64c34cb fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses 2023-12-05 07:28:21 -08:00
Krish Dholakia 1ff8f75752 Updated config.yml 2023-12-04 21:19:32 -08:00
ishaan-jaff 9ba17657ad (feat) init redis cache with **kwargs v1.10.4 2023-12-04 20:50:08 -08:00
Krrish Dholakia 31f3187670 test: fix linting errors 2023-12-04 18:43:01 -08:00
Krrish Dholakia 030bd22078 feat(proxy_server.py): allow user to override api key auth 2023-12-04 18:32:58 -08:00
ishaan-jaff 51cddf1e97 bump: version 1.10.3 → 1.10.4 2023-12-04 18:09:25 -08:00
ishaan-jaff ac486a3c4a (docs) add example config.yaml 2023-12-04 18:08:57 -08:00
ishaan-jaff 05f585153f (docs) add health check on load balancing 2023-12-04 18:01:21 -08:00
ishaan-jaff acd1678d14 (docs) router 2023-12-04 17:51:31 -08:00
ishaan-jaff 3f541fe999 (docs) custom timeouts proxy 2023-12-04 17:37:09 -08:00
ishaan-jaff fa5b453d39 (test) init router 2023-12-04 17:31:12 -08:00
ishaan-jaff 19646091fd (feat) router: init stream, async stream, async, clients 2023-12-04 17:31:12 -08:00
ishaan-jaff 886b52d448 (test) init router clients 2023-12-04 17:31:12 -08:00
ishaan-jaff cba98cf530 (test) init router with 4 clients 2023-12-04 17:31:12 -08:00
Krrish Dholakia 7adb8f493d docs(custom_callback.md): add async callbacks to docs 2023-12-04 17:01:46 -08:00
Krrish Dholakia e0ccb281d8 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
Krish Dholakia b90fcbdac4 Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt
fix system prompts for replicate
2023-12-04 16:39:44 -08:00
ishaan-jaff 1247afb7a4 (feat) router: set max_retries + timeout 2023-12-04 16:09:31 -08:00
ishaan-jaff a9905bcd0a (test) fix config 2023-12-04 16:00:04 -08:00
ishaan-jaff bbdfd143b8 (docs) input 2023-12-04 15:47:27 -08:00
ishaan-jaff 9b3a0c69f5 (fix) config testing 2023-12-04 15:24:46 -08:00
ishaan-jaff b7281825d3 (test) add streaming sagemaker test 2023-12-04 15:20:06 -08:00
ishaan-jaff bc691cbbcd (fix) streaming init response_obj as {} 2023-12-04 15:19:47 -08:00
ishaan-jaff 74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff 41365b6e47 (test) palm/stream 2023-12-04 15:07:07 -08:00
ishaan-jaff 3a4e512a75 (fix) palm: streaming 2023-12-04 15:06:52 -08:00
ishaan-jaff 533b93f714 (test) proxy: reading configs 2023-12-04 14:49:59 -08:00
ishaan-jaff 32ecc1a677 (feat) replicate/deployments: add POST Req view 2023-12-04 13:43:03 -08:00
ishaan-jaff 07a2035651 (chore) rm old config examples 2023-12-04 13:26:55 -08:00
ishaan-jaff 50284771b7 (test) test_reading proxy 2023-12-04 13:24:41 -08:00
Ishaan Jaff a99f471d29 Update README.md 2023-12-04 13:20:23 -08:00
ishaan-jaff de4a7b719d (test) proxy: reading config.yaml 2023-12-04 13:16:19 -08:00
Krrish Dholakia f20bdc9b79 test: fix linting errors 2023-12-04 12:45:15 -08:00
Krrish Dholakia 728b879c33 fix(utils.py): fix azure streaming bug 2023-12-04 12:38:22 -08:00
Krish Dholakia 90c13d39ac Updated config.yml 2023-12-04 12:01:22 -08:00
ishaan-jaff 6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff 333e77d161 (docs) custom logger 2023-12-04 11:44:12 -08:00
ishaan-jaff 533b5bcc44 (docs) clean up proxy logging 2023-12-04 11:37:15 -08:00
Krrish Dholakia d0d8ba46c5 test(test_proxy_server_keys.py): fix relative import 2023-12-04 11:35:43 -08:00
ishaan-jaff 15f54c3072 (docs) default config proxy 2023-12-04 11:30:53 -08:00
ishaan-jaff 85ac2b179a (docs) custom logger: proxy 2023-12-04 11:30:09 -08:00