ishaan-jaff
|
bc691cbbcd
|
(fix) streaming init response_obj as {}
|
2023-12-04 15:19:47 -08:00 |
|
ishaan-jaff
|
74d520b1b5
|
(docs) sagemaker - clarify max tokens
|
2023-12-04 15:15:39 -08:00 |
|
ishaan-jaff
|
41365b6e47
|
(test) palm/stream
|
2023-12-04 15:07:07 -08:00 |
|
ishaan-jaff
|
3a4e512a75
|
(fix) palm: streaming
|
2023-12-04 15:06:52 -08:00 |
|
ishaan-jaff
|
533b93f714
|
(test) proxy: reading configs
|
2023-12-04 14:49:59 -08:00 |
|
ishaan-jaff
|
32ecc1a677
|
(feat) replicate/deployments: add POST Req view
|
2023-12-04 13:43:03 -08:00 |
|
ishaan-jaff
|
07a2035651
|
(chore) rm old config examples
|
2023-12-04 13:26:55 -08:00 |
|
ishaan-jaff
|
50284771b7
|
(test) test_reading proxy
|
2023-12-04 13:24:41 -08:00 |
|
 Ishaan JaffandGitHub
|
a99f471d29
|
Update README.md
|
2023-12-04 13:20:23 -08:00 |
|
ishaan-jaff
|
de4a7b719d
|
(test) proxy: reading config.yaml
|
2023-12-04 13:16:19 -08:00 |
|
Krrish Dholakia
|
f20bdc9b79
|
test: fix linting errors
|
2023-12-04 12:45:15 -08:00 |
|
Krrish Dholakia
|
728b879c33
|
fix(utils.py): fix azure streaming bug
|
2023-12-04 12:38:22 -08:00 |
|
Krish Dholakia
|
90c13d39ac
|
Updated config.yml
|
2023-12-04 12:01:22 -08:00 |
|
ishaan-jaff
|
6f8765125b
|
(docs) embedding: add api_base for HF
|
2023-12-04 11:57:41 -08:00 |
|
ishaan-jaff
|
333e77d161
|
(docs) custom logger
|
2023-12-04 11:44:12 -08:00 |
|
ishaan-jaff
|
533b5bcc44
|
(docs) clean up proxy logging
|
2023-12-04 11:37:15 -08:00 |
|
Krrish Dholakia
|
d0d8ba46c5
|
test(test_proxy_server_keys.py): fix relative import
|
2023-12-04 11:35:43 -08:00 |
|
ishaan-jaff
|
15f54c3072
|
(docs) default config proxy
|
2023-12-04 11:30:53 -08:00 |
|
ishaan-jaff
|
85ac2b179a
|
(docs) custom logger: proxy
|
2023-12-04 11:30:09 -08:00 |
|
ishaan-jaff
|
4ef0378e6e
|
(fix) proxy: custom callbacks
|
2023-12-04 11:29:26 -08:00 |
|
ishaan-jaff
|
c5b92837c2
|
(docs) custom callbacks proxy
|
2023-12-04 11:20:27 -08:00 |
|
Krrish Dholakia
|
bfe0172108
|
bump: version 1.10.2 → 1.10.3
|
2023-12-04 10:51:32 -08:00 |
|
ishaan-jaff
|
e96a608938
|
(feat) proxy: set custom headers in metadata
|
2023-12-04 10:49:01 -08:00 |
|
ishaan-jaff
|
ec579d4821
|
(chore) rename proxy: custom_callbacks
|
2023-12-04 10:49:01 -08:00 |
|
ishaan-jaff
|
9b1e02cdf1
|
(chore) rename: proxy-custom logger
|
2023-12-04 10:49:01 -08:00 |
|
Krrish Dholakia
|
63e55f1865
|
fix(proxy_server.py): fix /key/generate post endpoint
|
2023-12-04 10:44:13 -08:00 |
|
ishaan-jaff
|
d7d8c5f6e6
|
(fix) proxy
|
2023-12-04 10:23:55 -08:00 |
|
ishaan-jaff
|
ebd9404cfd
|
(test) proxy: don't overwrite user
|
2023-12-04 10:19:35 -08:00 |
|
ishaan-jaff
|
88cec3b9ab
|
(fix) proxy: don't overwrite user
|
2023-12-04 10:17:56 -08:00 |
|
ishaan-jaff
|
f3b939e603
|
(fix) access user in custom logger
|
2023-12-04 09:50:36 -08:00 |
|
ishaan-jaff
|
93f5c266da
|
(test) test completion: if 'user' passed to API
|
2023-12-04 09:50:36 -08:00 |
|
Krrish Dholakia
|
31d9762b50
|
fix(model_management.md): add docs on model management on proxy
|
2023-12-04 09:36:45 -08:00 |
|
ishaan-jaff
|
0d44f5e441
|
(feat) proxy:custom_logger
|
2023-12-04 09:23:55 -08:00 |
|
ishaan-jaff
|
6599263a85
|
(feat) proxy: custom callbacks
|
2023-12-04 09:10:12 -08:00 |
|
ishaan-jaff
|
65e00b438e
|
(feat) proxy-read litellm custom callback class
|
2023-12-04 09:09:54 -08:00 |
|
ishaan-jaff
|
ed8c666922
|
(feat) proxy: custom_logger for I/O logging
|
2023-12-04 08:44:20 -08:00 |
|
ishaan-jaff
|
b1bd799be8
|
(feat) proxy: use custom_logger
|
2023-12-04 08:26:06 -08:00 |
|
ishaan-jaff
|
f2625bca24
|
(docs) quick start proxy
|
2023-12-04 08:07:05 -08:00 |
|
Krrish Dholakia
|
69a4497550
|
fix(main.py): accept user in embedding()
|
2023-12-02 21:49:23 -08:00 |
|
Krrish Dholakia
|
add4dfc528
|
fix(proxy_server.py): support model info augmenting for azure models
|
2023-12-02 21:33:54 -08:00 |
|
ishaan-jaff
|
ecddb852a2
|
(fix) proxy: pydantic error / warning message
|
2023-12-02 21:30:35 -08:00 |
|
Krrish Dholakia
|
47c1aa27c7
|
fix(proxy_server.py): add litellm model cost map info to /model/info
|
2023-12-02 21:24:28 -08:00 |
|
Krrish Dholakia
|
3b70a6864f
|
test: commenting out local test
|
2023-12-02 20:53:24 -08:00 |
|
Krrish Dholakia
|
bb4f82066a
|
fix(main.py): only send user if set
|
2023-12-02 20:36:30 -08:00 |
|
Krrish Dholakia
|
f72dd24ab9
|
fix(main.py): set user to none if not passed in
|
2023-12-02 20:08:25 -08:00 |
|
Krrish Dholakia
|
6c0eec4ff4
|
fix(main.py): fix pydantic warning for usage dict
|
2023-12-02 20:02:55 -08:00 |
|
Krrish Dholakia
|
f0d8a87c48
|
fix(proxy_server.py): fix user param name sent to litellm.completion
|
2023-12-02 19:56:22 -08:00 |
|
Krrish Dholakia
|
5200818af1
|
fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys
|
2023-12-02 19:55:11 -08:00 |
|
Krrish Dholakia
|
492c9043f6
|
fix: fix linting issues
|
2023-12-02 19:30:03 -08:00 |
|
Krrish Dholakia
|
6b1b1b82cf
|
fix(proxy_server.py): hash keys
|
2023-12-02 19:30:03 -08:00 |
|