Commit Graph
4058 Commits
Author SHA1 Message Date
ishaan-jaff bc691cbbcd (fix) streaming init response_obj as {} 2023-12-04 15:19:47 -08:00
ishaan-jaff 74d520b1b5 (docs) sagemaker - clarify max tokens 2023-12-04 15:15:39 -08:00
ishaan-jaff 41365b6e47 (test) palm/stream 2023-12-04 15:07:07 -08:00
ishaan-jaff 3a4e512a75 (fix) palm: streaming 2023-12-04 15:06:52 -08:00
ishaan-jaff 533b93f714 (test) proxy: reading configs 2023-12-04 14:49:59 -08:00
ishaan-jaff 32ecc1a677 (feat) replicate/deployments: add POST Req view 2023-12-04 13:43:03 -08:00
ishaan-jaff 07a2035651 (chore) rm old config examples 2023-12-04 13:26:55 -08:00
ishaan-jaff 50284771b7 (test) test_reading proxy 2023-12-04 13:24:41 -08:00
Ishaan JaffandGitHub a99f471d29 Update README.md 2023-12-04 13:20:23 -08:00
ishaan-jaff de4a7b719d (test) proxy: reading config.yaml 2023-12-04 13:16:19 -08:00
Krrish Dholakia f20bdc9b79 test: fix linting errors 2023-12-04 12:45:15 -08:00
Krrish Dholakia 728b879c33 fix(utils.py): fix azure streaming bug 2023-12-04 12:38:22 -08:00
Krish Dholakia 90c13d39ac Updated config.yml 2023-12-04 12:01:22 -08:00
ishaan-jaff 6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff 333e77d161 (docs) custom logger 2023-12-04 11:44:12 -08:00
ishaan-jaff 533b5bcc44 (docs) clean up proxy logging 2023-12-04 11:37:15 -08:00
Krrish Dholakia d0d8ba46c5 test(test_proxy_server_keys.py): fix relative import 2023-12-04 11:35:43 -08:00
ishaan-jaff 15f54c3072 (docs) default config proxy 2023-12-04 11:30:53 -08:00
ishaan-jaff 85ac2b179a (docs) custom logger: proxy 2023-12-04 11:30:09 -08:00
ishaan-jaff 4ef0378e6e (fix) proxy: custom callbacks 2023-12-04 11:29:26 -08:00
ishaan-jaff c5b92837c2 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
Krrish Dholakia bfe0172108 bump: version 1.10.2 → 1.10.3 2023-12-04 10:51:32 -08:00
ishaan-jaff e96a608938 (feat) proxy: set custom headers in metadata 2023-12-04 10:49:01 -08:00
ishaan-jaff ec579d4821 (chore) rename proxy: custom_callbacks 2023-12-04 10:49:01 -08:00
ishaan-jaff 9b1e02cdf1 (chore) rename: proxy-custom logger 2023-12-04 10:49:01 -08:00
Krrish Dholakia 63e55f1865 fix(proxy_server.py): fix /key/generate post endpoint 2023-12-04 10:44:13 -08:00
ishaan-jaff d7d8c5f6e6 (fix) proxy 2023-12-04 10:23:55 -08:00
ishaan-jaff ebd9404cfd (test) proxy: don't overwrite user 2023-12-04 10:19:35 -08:00
ishaan-jaff 88cec3b9ab (fix) proxy: don't overwrite user 2023-12-04 10:17:56 -08:00
ishaan-jaff f3b939e603 (fix) access user in custom logger 2023-12-04 09:50:36 -08:00
ishaan-jaff 93f5c266da (test) test completion: if 'user' passed to API 2023-12-04 09:50:36 -08:00
Krrish Dholakia 31d9762b50 fix(model_management.md): add docs on model management on proxy 2023-12-04 09:36:45 -08:00
ishaan-jaff 0d44f5e441 (feat) proxy:custom_logger 2023-12-04 09:23:55 -08:00
ishaan-jaff 6599263a85 (feat) proxy: custom callbacks 2023-12-04 09:10:12 -08:00
ishaan-jaff 65e00b438e (feat) proxy-read litellm custom callback class 2023-12-04 09:09:54 -08:00
ishaan-jaff ed8c666922 (feat) proxy: custom_logger for I/O logging 2023-12-04 08:44:20 -08:00
ishaan-jaff b1bd799be8 (feat) proxy: use custom_logger 2023-12-04 08:26:06 -08:00
ishaan-jaff f2625bca24 (docs) quick start proxy 2023-12-04 08:07:05 -08:00
Krrish Dholakia 69a4497550 fix(main.py): accept user in embedding() 2023-12-02 21:49:23 -08:00
Krrish Dholakia add4dfc528 fix(proxy_server.py): support model info augmenting for azure models 2023-12-02 21:33:54 -08:00
ishaan-jaff ecddb852a2 (fix) proxy: pydantic error / warning message 2023-12-02 21:30:35 -08:00
Krrish Dholakia 47c1aa27c7 fix(proxy_server.py): add litellm model cost map info to /model/info 2023-12-02 21:24:28 -08:00
Krrish Dholakia 3b70a6864f test: commenting out local test 2023-12-02 20:53:24 -08:00
Krrish Dholakia bb4f82066a fix(main.py): only send user if set 2023-12-02 20:36:30 -08:00
Krrish Dholakia f72dd24ab9 fix(main.py): set user to none if not passed in 2023-12-02 20:08:25 -08:00
Krrish Dholakia 6c0eec4ff4 fix(main.py): fix pydantic warning for usage dict 2023-12-02 20:02:55 -08:00
Krrish Dholakia f0d8a87c48 fix(proxy_server.py): fix user param name sent to litellm.completion 2023-12-02 19:56:22 -08:00
Krrish Dholakia 5200818af1 fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys 2023-12-02 19:55:11 -08:00
Krrish Dholakia 492c9043f6 fix: fix linting issues 2023-12-02 19:30:03 -08:00
Krrish Dholakia 6b1b1b82cf fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00