 ishaan-jaff
|
8bfaee9654
|
(docs) simplify caching docs
|
2024-01-03 16:20:19 +05:30 |
|
|
ishaan-jaff
|
4680a26e2e
|
(test) proxy - load test
|
2024-01-03 16:16:18 +05:30 |
|
|
ishaan-jaff
|
344e8d8508
|
(docs) s3 cache
|
2024-01-03 16:16:18 +05:30 |
|
|
Krrish Dholakia
|
d45101b652
|
fix(proxy_server.py): fix master key reset, to preserve key from env
|
2024-01-03 16:10:10 +05:30 |
|
|
Krrish Dholakia
|
40c974999e
|
fix(proxy_server.py): reject bad /model/new POST requests
|
2024-01-03 15:54:58 +05:30 |
|
|
ishaan-jaff
|
cc29860785
|
(docs) s3 Cache
|
2024-01-03 15:42:23 +05:30 |
|
|
ishaan-jaff
|
d14a41863f
|
(test) s3 cache with setting s3_bucket_name
|
2024-01-03 15:42:23 +05:30 |
|
|
ishaan-jaff
|
58ce5d44ae
|
(feat) s3 cache support all boto3 params
|
2024-01-03 15:42:23 +05:30 |
|
|
Krrish Dholakia
|
b51371952b
|
fix(proxy_server.py): handle base case for /model/info
|
2024-01-03 15:33:29 +05:30 |
|
|
Ishaan JaffandGitHub
|
92c4156ea1
|
Update README.md
|
2024-01-03 15:17:59 +05:30 |
|
|
Ishaan JaffandGitHub
|
2eeb20be46
|
Update README.md
|
2024-01-03 15:17:46 +05:30 |
|
|
Ishaan JaffandGitHub
|
c71fd26125
|
Update README.md
|
2024-01-03 15:17:24 +05:30 |
|
|
Ishaan JaffandGitHub
|
e91823218d
|
Update README.md
|
2024-01-03 15:16:50 +05:30 |
|
|
Ishaan JaffandGitHub
|
c27246e6f2
|
Update README.md
|
2024-01-03 15:15:24 +05:30 |
|
|
ishaan-jaff
|
fea0a933ae
|
(test) use s3 buckets cache
|
2024-01-03 15:13:43 +05:30 |
|
|
ishaan-jaff
|
00364da993
|
(feat) add s3 Bucket as Cache
|
2024-01-03 15:13:43 +05:30 |
|
|
Krrish Dholakia
|
14e501845f
|
fix(proxy_server.py): add support for setting master key via .env
|
2024-01-03 15:10:25 +05:30 |
|
|
Krrish Dholakia
|
ef8f1acfa4
|
refactor(proxy_server.py): more debug statements
|
2024-01-03 13:59:41 +05:30 |
|
|
Krrish Dholakia
|
6c8cc33d02
|
docs(caching.md): fix typo
|
2024-01-03 12:47:16 +05:30 |
|
|
Krrish Dholakia
|
8cee267a5b
|
fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
|
2024-01-03 12:42:43 +05:30 |
|
|
ishaan-jaff
|
8772d87947
|
bump: version 1.16.12 → 1.16.13
|
2024-01-03 12:10:22 +05:30 |
|
|
ishaan-jaff
|
2bea0c742e
|
(test) completion tokens counting + azure stream
|
2024-01-03 12:06:39 +05:30 |
|
|
ishaan-jaff
|
96cb6f3b10
|
(fix) azure+stream: count completion tokens
|
2024-01-03 12:06:39 +05:30 |
|
|
ishaan-jaff
|
f3b8d9c3ef
|
(fix) counting response tokens+streaming
|
2024-01-03 12:06:39 +05:30 |
|
|
Krrish Dholakia
|
5055aeb254
|
docs(alerting.md): add alerting thresholds to docs
|
2024-01-03 11:21:56 +05:30 |
|
|
Krrish Dholakia
|
cd98d256b5
|
fix(proxy_server.py): add alerting for responses taking too long
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-03 11:18:21 +05:30 |
|
|
Krrish Dholakia
|
0a6e4db999
|
bump: version 1.16.11 → 1.16.12
|
2024-01-03 10:12:48 +05:30 |
|
|
Krrish Dholakia
|
0d13c51615
|
fix(proxy/utils.py): fix self.alerting null case
https://github.com/BerriAI/litellm/issues/1298#issuecomment-1874798056
|
2024-01-03 10:12:21 +05:30 |
|
|
Krrish Dholakia
|
ff4eb5a5d4
|
docs(alerting.md): add slack alerting to docs
|
2024-01-02 22:47:01 +05:30 |
|
|
Krrish Dholakia
|
d17ffdbc83
|
docs(ui.md): update ui docs to for smtp server hosting
|
2024-01-02 22:30:17 +05:30 |
|
|
Krrish Dholakia
|
a778f8a00e
|
bump: version 1.16.10 → 1.16.11
|
2024-01-02 22:26:47 +05:30 |
|
|
Krrish Dholakia
|
070520d237
|
fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
|
2024-01-02 22:22:19 +05:30 |
|
|
Krish DholakiaandGitHub
|
89f314b5ee
|
Merge pull request #1300 from asedmammad/patch-1
fix(proxy_server.py) Check when '_hidden_params' is None
|
2024-01-02 21:34:09 +05:30 |
|
|
Ased MammadandGitHub
|
c39c8f70eb
|
fix(proxy_server.py) Check when '_hidden_params' is None
|
2024-01-02 19:04:51 +03:30 |
|
|
Krrish Dholakia
|
940569703e
|
feat(proxy_server.py): add slack alerting to proxy server
add alerting for calls hanging, failing and db read/writes failing
https://github.com/BerriAI/litellm/issues/1298
|
2024-01-02 17:45:18 +05:30 |
|
|
Krish DholakiaandGitHub
|
10b71b0ff1
|
Update README.md
|
2024-01-02 17:22:44 +05:30 |
|
|
ishaan-jaff
|
c27b1fc5f8
|
(feat) proxy swagger - make admin link clickable
|
2024-01-02 17:04:32 +05:30 |
|
|
ishaan-jaff
|
8186af64c7
|
(docs) xinference on proxy
|
2024-01-02 16:57:25 +05:30 |
|
|
ishaan-jaff
|
8f8ac03961
|
(docs) proxy - using xinference
|
2024-01-02 16:55:10 +05:30 |
|
|
ishaan-jaff
|
14738ec89d
|
(test) xinference on litellm router
|
2024-01-02 16:51:08 +05:30 |
|
|
Ishaan JaffandGitHub
|
5bf44e8a64
|
Update README.md - add xinference [Xorbits Inference]
|
2024-01-02 16:38:35 +05:30 |
|
|
ishaan-jaff
|
bfbed2d93d
|
(test) xinference embeddings
|
2024-01-02 15:41:51 +05:30 |
|
|
ishaan-jaff
|
fdd4e72503
|
(docs) xinference embedding
|
2024-01-02 15:39:25 +05:30 |
|
|
ishaan-jaff
|
790dcff5e0
|
(feat) add xinference as an embedding provider
|
2024-01-02 15:32:26 +05:30 |
|
|
ishaan-jaff
|
0d0ee9e108
|
(docs) passing user config
|
2024-01-02 14:43:02 +05:30 |
|
|
Krrish Dholakia
|
0fffcc1579
|
fix(utils.py): support token counting for gpt-4-vision models
|
2024-01-02 14:41:42 +05:30 |
|
|
ishaan-jaff
|
eda6ab8cdc
|
bump: version 1.16.9 → 1.16.10
|
2024-01-02 14:39:12 +05:30 |
|
|
ishaan-jaff
|
1efd1cb30f
|
(docs) passing user_config to completion
|
2024-01-02 14:19:44 +05:30 |
|
|
ishaan-jaff
|
bfae0fe935
|
(test) proxy - pass user_config
|
2024-01-02 14:15:03 +05:30 |
|
|
ishaan-jaff
|
075eb1a516
|
(types) routerConfig
|
2024-01-02 14:14:29 +05:30 |
|