 ishaan-jaff
|
fcd66eac7d
|
(fix) add app scheduler to poetry.lock
|
2024-01-23 20:03:28 -08:00 |
|
|
ishaan-jaff
|
19af0cd3ed
|
(docs) admin ui
v1.18.12
|
2024-01-23 19:41:40 -08:00 |
|
|
ishaan-jaff
|
889767c5aa
|
bump: version 1.18.11 → 1.18.12
|
2024-01-23 19:33:44 -08:00 |
|
|
ishaan-jaff
|
dee025b7a3
|
(docs) misc/cookbook - OpenAI python timeout
|
2024-01-23 19:31:31 -08:00 |
|
|
ishaan-jaff
|
b0902f0a8c
|
(ci/cd) add more logging to timeout test
|
2024-01-23 18:39:19 -08:00 |
|
|
Ishaan JaffandGitHub
|
d00548ee5d
|
Merge pull request #1576 from BerriAI/litellm_map_openai_auth_errors
[Feat] Make Proxy Auth Exceptions OpenAI compatible
|
2024-01-23 18:32:00 -08:00 |
|
|
Ishaan JaffandGitHub
|
a0cd4e78fc
|
Merge branch 'main' into litellm_map_openai_auth_errors
|
2024-01-23 18:31:48 -08:00 |
|
|
Krish DholakiaandGitHub
|
61cc8762f1
|
Merge pull request #1570 from BerriAI/litellm_reset_key_budget
feat(proxy/utils.py): Support keys with budget duration (resets spend on duration end)
|
2024-01-23 18:10:42 -08:00 |
|
|
Krish DholakiaandGitHub
|
9784d03d65
|
Merge branch 'main' into litellm_reset_key_budget
|
2024-01-23 18:10:32 -08:00 |
|
|
Krrish Dholakia
|
ef760cb21c
|
build(requirements.txt): add apscheduler to requirements
|
2024-01-23 17:56:11 -08:00 |
|
|
Krrish Dholakia
|
d6844f43c8
|
test(test_keys.py): use correct model name for token counting
|
2024-01-23 17:46:14 -08:00 |
|
|
ishaan-jaff
|
b3ce0ac728
|
(test) proxy_custom_auth use new exceptions
|
2024-01-23 17:36:13 -08:00 |
|
|
ishaan-jaff
|
d2675a1ff3
|
(test) switch dynamodb test to use new exceptions
|
2024-01-23 17:34:18 -08:00 |
|
|
ishaan-jaff
|
feb367bbb9
|
(feat) all endpoints raise OpenAI compatible exceptions
|
2024-01-23 17:32:47 -08:00 |
|
|
ishaan-jaff
|
37dd1114f2
|
(test) update prisma test
|
2024-01-23 17:30:01 -08:00 |
|
|
Krrish Dholakia
|
7b5e3b9934
|
refactor(proxy/utils.py): fix linting issue
|
2024-01-23 17:22:22 -08:00 |
|
|
Krish DholakiaandGitHub
|
4ca4913468
|
Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking
[WIP] fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 17:07:40 -08:00 |
|
|
Ishaan JaffandGitHub
|
fdb6a7409b
|
Merge pull request #1575 from BerriAI/litellm_ui_view_spend
[Feat] UI view spend per API Key
|
2024-01-23 17:02:19 -08:00 |
|
|
Krish Dholakia
|
5defa93a9d
|
Updated config.yml
|
2024-01-23 16:59:56 -08:00 |
|
|
ishaan-jaff
|
0e9339b390
|
(feat) /spend/logs
|
2024-01-23 16:57:51 -08:00 |
|
|
Krish Dholakia
|
7b8353e5c6
|
Updated config.yml
|
2024-01-23 16:52:08 -08:00 |
|
|
Krrish Dholakia
|
f47db44b4f
|
test(test_keys.py): fix streaming test
|
2024-01-23 16:27:45 -08:00 |
|
|
ishaan-jaff
|
8ae8edfdb4
|
(fix) add doc string for /spend/keys
|
2024-01-23 16:27:25 -08:00 |
|
|
ishaan-jaff
|
6a7126af93
|
(fix) UI
|
2024-01-23 16:24:13 -08:00 |
|
|
Krrish Dholakia
|
7e0adbb9bd
|
fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs
|
2024-01-23 16:19:32 -08:00 |
|
|
ishaan-jaff
|
e723df30f3
|
(feat) ui improvements
|
2024-01-23 16:14:39 -08:00 |
|
|
Krrish Dholakia
|
d52f5234b4
|
fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss
ue for spend logs
|
2024-01-23 16:14:01 -08:00 |
|
|
Krrish Dholakia
|
f8870fb48e
|
fix(utils.py): fix proxy streaming spend tracking
|
2024-01-23 15:59:03 -08:00 |
|
|
ishaan-jaff
|
1158ff4995
|
(feat) use cli args to start streamlit
|
2024-01-23 15:58:14 -08:00 |
|
|
ishaan-jaff
|
a2da9c30fb
|
(feat) add /spend/keys endpoint
|
2024-01-23 15:10:10 -08:00 |
|
|
Ishaan JaffandGitHub
|
5702be1601
|
Merge pull request #1572 from BerriAI/litellm_use_same_response_id_across_chunks
[Fix] Streaming - Use same `response_id` across chunks
|
2024-01-23 14:40:50 -08:00 |
|
|
Krrish Dholakia
|
afada01ffc
|
fix(utils.py): fix streaming cost tracking
|
2024-01-23 14:39:45 -08:00 |
|
|
ishaan-jaff
|
2f11b92698
|
v0 view spend logs
|
2024-01-23 14:15:19 -08:00 |
|
|
Krish Dholakia
|
7eb96e46a4
|
Updated config.yml
|
2024-01-23 13:55:08 -08:00 |
|
|
ishaan-jaff
|
b40176810e
|
(test) dynamic timeouts - router
|
2024-01-23 13:27:49 -08:00 |
|
|
ishaan-jaff
|
64a387d09b
|
(test) test chunk_ids match across chunks for bedrock
|
2024-01-23 13:06:05 -08:00 |
|
|
ishaan-jaff
|
d455833dfb
|
(test) same response id across chunks
|
2024-01-23 12:57:04 -08:00 |
|
|
ishaan-jaff
|
39b4f19bd8
|
(fix) same response_id across chunk
|
2024-01-23 12:56:03 -08:00 |
|
|
ishaan-jaff
|
6d81da3f43
|
bump: version 1.18.10 → 1.18.11
v1.18.11
|
2024-01-23 12:37:23 -08:00 |
|
|
Ishaan JaffandGitHub
|
861587e49d
|
Merge pull request #1569 from BerriAI/litellm_proxy_sagemaker_streaming
[Fix] LiteLLM Proxy - Streaming Sagemaker Support on /chat/completions
|
2024-01-23 12:35:16 -08:00 |
|
|
Krrish Dholakia
|
b1a105e309
|
feat(proxy/utils.py): enable background process to reset key budgets
|
2024-01-23 12:33:13 -08:00 |
|
|
ishaan-jaff
|
e8cd27f2b7
|
(fix) sagemaker streaming support
|
2024-01-23 12:31:16 -08:00 |
|
|
ishaan-jaff
|
44e213e842
|
(fix) select_data_generator
|
2024-01-23 12:13:34 -08:00 |
|
|
ishaan-jaff
|
a61dbc1613
|
(fix) select_data_generator - sagemaker
|
2024-01-23 12:08:58 -08:00 |
|
|
ishaan-jaff
|
bd37a9cb5e
|
(fix) proxy - streaming sagemaker
|
2024-01-23 11:12:16 -08:00 |
|
|
Krrish Dholakia
|
01a2514b98
|
bump: version 1.18.9 → 1.18.10
v1.18.10
|
2024-01-23 10:32:02 -08:00 |
|
|
Krrish Dholakia
|
05754ef238
|
test(test_router.py): add more testing for dynamically passing params to router
|
2024-01-23 10:31:49 -08:00 |
|
|
ishaan-jaff
|
6c1f8378c1
|
(test) fix sagemaker stream test
|
2024-01-23 10:07:13 -08:00 |
|
|
ishaan-jaff
|
3f37cf0bec
|
(test) router.py revert to stable version
|
2024-01-23 09:05:19 -08:00 |
|
|
ishaan-jaff
|
fa2c94aacb
|
(docs) remove custom_auth in example config.yaml
|
2024-01-23 08:40:21 -08:00 |
|