Commit Graph
5215 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 2bf51d46fe Update read_pyproject_version.yml 2024-01-04 15:07:25 +05:30
Ishaan JaffandGitHub 511332cc8f Update read_pyproject_version.yml 2024-01-04 15:06:19 +05:30
Ishaan JaffandGitHub 9c24cb1468 Update ghcr_deploy.yml 2024-01-04 15:03:58 +05:30
Ishaan JaffandGitHub b52a0ce3cf Update ghcr_deploy.yml 2024-01-04 15:00:05 +05:30
ishaan-jaff 2df0377273 (ci/cd) use version from pyproject.toml 2024-01-04 14:56:57 +05:30
Krrish Dholakia 99d9a825de feat(proxy_server.py): abstract config update/writing and support persisting config in db
allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db

 https://github.com/BerriAI/litellm/issues/1322
2024-01-04 14:44:59 +05:30
ishaan-jaff 6dea0d3115 (ci/cd) read pyproject version 2024-01-04 14:40:09 +05:30
ishaan-jaff 5b3014a3b1 (ci/cd) read version from pyproject 2024-01-04 14:37:45 +05:30
ishaan-jaff 4aa90682ff (ci/cd) litellm release 2024-01-04 14:34:41 +05:30
ishaan-jaff cc873ba938 (ci/cd) new litellm release on ghcr deploys v1.16.3 2024-01-04 14:30:00 +05:30
ishaan-jaff ccf996ecaf (ci/cd) trigger new release on ghcr deploy 2024-01-04 14:22:09 +05:30
ishaan-jaff 2c88fd49a4 (ci/cd) trigger new release on docker deploys 2024-01-04 14:21:42 +05:30
ishaan-jaff 4245274934 (ci/cd) release workflow 2024-01-04 14:17:59 +05:30
Ishaan JaffandGitHub 540dc8e11b Update release2.yaml v1.15.5 1.16.12 2024-01-04 14:05:59 +05:30
Ishaan JaffandGitHub 0992dc831a Update release2.yaml 2024-01-04 13:50:52 +05:30
Ishaan JaffandGitHub a694150385 Create release2.yaml 2024-01-04 13:49:46 +05:30
Ishaan JaffandGitHub 8fce25820b Update new_release.yml 2024-01-04 13:43:56 +05:30
Ishaan JaffandGitHub 0aca4dd0b0 Update new_release.yml 2024-01-04 13:43:41 +05:30
Ishaan JaffandGitHub 7aa597afd1 Update new_release.yml 2024-01-04 13:41:44 +05:30
Ishaan JaffandGitHub 66607de725 (ci/cd) Create new_release.yml 2024-01-04 13:33:28 +05:30
ishaan-jaff c231a6e4d3 (ci/cd) run proxy test with debug=True 2024-01-04 13:01:00 +05:30
ishaan-jaff 234c057e97 (fix) azure+cf gateway, health check 2024-01-04 12:34:07 +05:30
Krrish Dholakia b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia 4946b1ef6d docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia 0f7d03f761 fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff 54653f9a4a (test) proxy + s3 caching 2024-01-04 11:11:08 +05:30
ishaan-jaff aa757d19f5 (test) router - init clients - azure cloudflare, openai etc 2024-01-04 10:55:18 +05:30
ishaan-jaff 0864713b62 (test) cf azure 2024-01-04 10:26:41 +05:30
ishaan-jaff 8e10a1eb81 (docs) config with cloudflare exampel 2024-01-04 10:25:35 +05:30
ishaan-jaff 6d21ee3a2f (fix) proxy - cloudflare + Azure bug [non-streaming] 2024-01-04 10:24:51 +05:30
ishaan-jaff b103ab1f0b (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff 30c6d164d2 (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff f9139e05e8 (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
Krrish Dholakia 469ae0a378 fix(proxy/utils.py): don't keep connecting to db if connection already established 2024-01-03 17:43:44 +05:30
Krrish Dholakia f2da345173 fix(caching.py): handle cached_response being a dict not json string 2024-01-03 17:29:27 +05:30
Krrish Dholakia f2210787cd feat(proxy_server.py): allow admins to update config via /config/update endpoint 2024-01-03 17:18:33 +05:30
ishaan-jaff 64a0c175d5 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff 8bfaee9654 (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff 4680a26e2e (test) proxy - load test 2024-01-03 16:16:18 +05:30
ishaan-jaff 344e8d8508 (docs) s3 cache 2024-01-03 16:16:18 +05:30
Krrish Dholakia d45101b652 fix(proxy_server.py): fix master key reset, to preserve key from env 2024-01-03 16:10:10 +05:30
Krrish Dholakia 40c974999e fix(proxy_server.py): reject bad /model/new POST requests 2024-01-03 15:54:58 +05:30
ishaan-jaff cc29860785 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
ishaan-jaff d14a41863f (test) s3 cache with setting s3_bucket_name 2024-01-03 15:42:23 +05:30
ishaan-jaff 58ce5d44ae (feat) s3 cache support all boto3 params 2024-01-03 15:42:23 +05:30
Krrish Dholakia b51371952b fix(proxy_server.py): handle base case for /model/info 2024-01-03 15:33:29 +05:30
Ishaan JaffandGitHub 92c4156ea1 Update README.md 2024-01-03 15:17:59 +05:30
Ishaan JaffandGitHub 2eeb20be46 Update README.md 2024-01-03 15:17:46 +05:30
Ishaan JaffandGitHub c71fd26125 Update README.md 2024-01-03 15:17:24 +05:30
Ishaan JaffandGitHub e91823218d Update README.md 2024-01-03 15:16:50 +05:30