 ishaan-jaff
|
dfb30d38fa
|
(feat) proxy print set callbacks
|
2023-12-06 17:16:24 -08:00 |
|
|
Krrish Dholakia
|
58848841e1
|
fix(proxy_server.py): make headers json serializable
|
2023-12-06 17:09:02 -08:00 |
|
|
Krrish Dholakia
|
51492125b5
|
test: skip flaky test
|
2023-12-06 16:50:02 -08:00 |
|
|
Krrish Dholakia
|
caac4f1779
|
docs(virtual_keys.md): fix import line
|
2023-12-06 15:12:23 -08:00 |
|
|
Krrish Dholakia
|
ad922b205b
|
fix(proxy_server.py): enable rate limiting concurrent user requests
|
2023-12-06 15:11:05 -08:00 |
|
|
ishaan-jaff
|
cf1df8204e
|
(docs) proxy - custom async func
|
2023-12-06 15:04:24 -08:00 |
|
|
ishaan-jaff
|
0ea6241d3e
|
(docs) use async callback functions
|
2023-12-06 15:00:16 -08:00 |
|
|
ishaan-jaff
|
44bf51601a
|
(feat) proxy - custom on failure callback
|
2023-12-06 14:43:47 -08:00 |
|
|
ishaan-jaff
|
b3f039627e
|
(feat) litellm - add _async_failure_callback
|
2023-12-06 14:43:47 -08:00 |
|
|
ishaan-jaff
|
3b17fd3821
|
(feat) proxy - async_on_fail_logger
|
2023-12-06 14:43:47 -08:00 |
|
|
Krrish Dholakia
|
f1c1ec8523
|
fix(bedrock.py): fix embeddings call
|
2023-12-06 14:16:00 -08:00 |
|
|
ishaan-jaff
|
be15cf20b9
|
(chore) print verbose
|
2023-12-06 14:14:20 -08:00 |
|
|
ishaan-jaff
|
e1230627d0
|
(fix) print statements
|
2023-12-06 14:11:23 -08:00 |
|
|
ishaan-jaff
|
0598ab9b63
|
(fix) proxy /model/new writing to config
|
2023-12-06 14:11:23 -08:00 |
|
|
Krrish Dholakia
|
346551da29
|
fix(proxy_server.py): allow worker config to just be the config filepath
|
2023-12-06 14:03:25 -08:00 |
|
|
ishaan-jaff
|
368934d160
|
(feat) proxy: use async_callback function
|
2023-12-06 13:51:24 -08:00 |
|
|
Krrish Dholakia
|
b24c9b4cbf
|
refactor: fix linting
|
2023-12-06 13:27:40 -08:00 |
|
|
Krrish Dholakia
|
d962d5d4c0
|
fix(bedrock.py): adding support for cohere embeddings
|
2023-12-06 13:25:18 -08:00 |
|
|
ishaan-jaff
|
cf6ecc03a5
|
(fix) linting
|
2023-12-06 13:14:26 -08:00 |
|
|
ishaan-jaff
|
f3c3a9860a
|
(feat) /v1/model/info
|
2023-12-06 13:03:29 -08:00 |
|
|
ishaan-jaff
|
06255c6590
|
(feat) proxy add ext-embedding-ada-002 as a base model
|
2023-12-06 12:19:47 -08:00 |
|
|
ishaan-jaff
|
5fcd6437e4
|
(feat) pricing - add text-embedding-ada-002
|
2023-12-06 12:16:57 -08:00 |
|
|
ishaan-jaff
|
32a3ef8683
|
(feat) add azure/text-embedding-ada-002 cost
|
2023-12-06 12:13:52 -08:00 |
|
|
ishaan-jaff
|
29fb97f88a
|
(feat) proxy - define model info
|
2023-12-06 12:06:30 -08:00 |
|
|
Krrish Dholakia
|
102de97960
|
refactor: fix linting errors
|
2023-12-06 11:46:15 -08:00 |
|
|
ishaan-jaff
|
de58dcc016
|
(feat) proxy - allow setting cost, context window
|
2023-12-06 11:42:56 -08:00 |
|
|
Krrish Dholakia
|
94f065f83c
|
feat(sagemaker.py): support huggingface embedding models
|
2023-12-06 11:41:38 -08:00 |
|
|
ishaan-jaff
|
aefa4f36f9
|
(docs) update yaml with chat/embedding/completion mode
|
2023-12-06 11:36:16 -08:00 |
|
|
ishaan-jaff
|
fd86876164
|
(feat) proxy: add mode in model info
|
2023-12-06 11:29:59 -08:00 |
|
|
ishaan-jaff
|
7c77cc3cfa
|
(feat) add mode for config.yaml health checks
|
2023-12-06 11:16:29 -08:00 |
|
|
ishaan-jaff
|
4f02b3c161
|
(fix) print_verbose health check
|
2023-12-06 11:16:29 -08:00 |
|
|
Krrish Dholakia
|
f6546076b0
|
docs(quick_start.md): add docs on calling openai-compatible endpoint on proxy
|
2023-12-06 11:06:09 -08:00 |
|
|
ishaan-jaff
|
cc48b35a8d
|
(test) router - read os.environ/ OpenAI
|
2023-12-06 10:56:27 -08:00 |
|
|
ishaan-jaff
|
8f47293ce8
|
(chore) linting fix
|
2023-12-06 10:48:01 -08:00 |
|
|
ishaan-jaff
|
1e2a8869a9
|
(docs) proxy config with azure, openai embedding models
|
2023-12-06 10:45:07 -08:00 |
|
|
ishaan-jaff
|
9f4928fae4
|
(feat) proxy - add health check for embeddings
|
2023-12-06 10:45:07 -08:00 |
|
|
Krrish Dholakia
|
37251d327d
|
docs(virtual_keys.md): add custom auth to docs
|
2023-12-06 10:29:52 -08:00 |
|
|
ishaan-jaff
|
caf2a6b279
|
(fix) proxy - move new health check import
|
2023-12-06 10:13:06 -08:00 |
|
|
ishaan-jaff
|
01aa8941a5
|
(test) OTEL / traceloop - waiting for async support
|
2023-12-06 10:08:37 -08:00 |
|
|
ishaan-jaff
|
11a8713a50
|
(test) router - set sync stream client
|
2023-12-06 10:08:37 -08:00 |
|
|
Ishaan JaffandGitHub
|
a4cf4e7ca9
|
Merge pull request #1023 from PSU3D0/speedup_health_endpoint
(feat) Speedup health endpoint
|
2023-12-06 09:52:13 -08:00 |
|
|
ishaan-jaff
|
bd0579703c
|
(test) router - reading os.environ/ with client
|
2023-12-06 09:26:21 -08:00 |
|
|
ishaan-jaff
|
13f9e78799
|
(fix) router - errors with reading timeout, stream timeout, max retries
|
2023-12-06 09:19:51 -08:00 |
|
|
ishaan-jaff
|
527aadd1ab
|
(test) router - reading os.environ/ variables
|
2023-12-06 09:19:51 -08:00 |
|
|
Krish DholakiaandGitHub
|
18225c94e4
|
Merge pull request #993 from geekyayush/main
feat: add docker compose file and running guide
|
2023-12-06 09:19:04 -08:00 |
|
|
ishaan-jaff
|
aab6be654e
|
(fix) router - set read os.environ/ values
|
2023-12-06 08:59:33 -08:00 |
|
|
Krrish Dholakia
|
92b2cbcdc5
|
feat(proxy_server.py): adding /model/delete endpoint
|
2023-12-05 22:38:38 -08:00 |
|
|
ishaan-jaff
|
ff028111cf
|
(fix) router len(num_retries)
|
2023-12-05 22:05:47 -08:00 |
|
|
ishaan-jaff
|
ba99561d08
|
bump: version 1.10.10 → 1.10.11
|
2023-12-05 21:57:12 -08:00 |
|
|
ishaan-jaff
|
5e065ebb8f
|
(test) router - explcitly call one deployment
|
2023-12-05 21:57:00 -08:00 |
|