 Krish DholakiaandGitHub
|
6501fdb76e
|
Merge branch 'main' into litellm_global_spend_updates
|
2024-01-24 20:20:15 -08:00 |
|
Krrish Dholakia
|
30d615f442
|
build(proxy_server_config.yaml): add proxy budget to default yaml
|
2024-01-24 20:12:03 -08:00 |
|
Krrish Dholakia
|
b1864c3d11
|
bump: version 1.19.0 → 1.19.1
|
2024-01-24 20:10:14 -08:00 |
|
Krrish Dholakia
|
43f139fafd
|
fix(ollama_chat.py): fix default token counting for ollama chat
|
2024-01-24 20:09:17 -08:00 |
|
Krrish Dholakia
|
05b4d49882
|
ci(config.yml): add debug logs
|
2024-01-24 19:54:37 -08:00 |
|
ishaan-jaff
|
3e59a02dfb
|
(test) test /key/gen with max_budget=None
|
2024-01-24 19:27:53 -08:00 |
|
 Ishaan JaffandGitHub
|
cf58ecf5c3
|
Merge pull request #1604 from BerriAI/litellm_view_cache_key_in_spend_logs
[Feat] Add cache_key in SpendLogs Table
|
2024-01-24 19:13:13 -08:00 |
|
ishaan-jaff
|
6bc715cf85
|
(test) logging cache_key in spendLogs
|
2024-01-24 18:54:23 -08:00 |
|
ishaan-jaff
|
2f3765a03f
|
(fix) log cache hits on SpendLogs table
|
2024-01-24 18:51:39 -08:00 |
|
ishaan-jaff
|
bf851ef19a
|
(fix) use litellm.cache for getting key
|
2024-01-24 18:34:22 -08:00 |
|
ishaan-jaff
|
2130a61b6e
|
(feat) add cache_key in spend_log
|
2024-01-24 17:56:00 -08:00 |
|
Krrish Dholakia
|
f148094d18
|
test(test_key_generate_prisma.py): add unit testing for global proxy budget
|
2024-01-24 17:43:01 -08:00 |
|
ishaan-jaff
|
d694993703
|
(fix) bug from bb7705b494
v1.19.0
|
2024-01-24 17:34:17 -08:00 |
|
ishaan-jaff
|
3305dc75ca
|
(docs) add comments on prisma.schema
|
2024-01-24 17:15:05 -08:00 |
|
Krrish Dholakia
|
30a8071bf1
|
fix(proxy_server.py): enforce budget limit if global proxy limit reached
|
2024-01-24 17:11:40 -08:00 |
|
 Ishaan JaffandGitHub
|
45ca7343d0
|
Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign
[Feat] Proxy - Improve Slack Alerting
|
2024-01-24 16:43:23 -08:00 |
|
Krrish Dholakia
|
624da17698
|
test(test_users.py): add testing for global proxy spend tracking
|
2024-01-24 16:24:50 -08:00 |
|
ishaan-jaff
|
9aae60f162
|
(FIX) improve slack alerting messages
|
2024-01-24 16:07:46 -08:00 |
|
Krrish Dholakia
|
574208f005
|
fix(proxy_server.py): track cost for global proxy
|
2024-01-24 16:06:10 -08:00 |
|
ishaan-jaff
|
b993c62144
|
(fix) only alert users when requests are hanging
|
2024-01-24 15:58:07 -08:00 |
|
Krrish Dholakia
|
ba24037baf
|
bump: version 1.18.13 → 1.19.0
|
2024-01-24 15:30:49 -08:00 |
|
Krrish Dholakia
|
bb7705b494
|
test(test_users.py): test budgets with resets
|
2024-01-24 15:30:30 -08:00 |
|
ishaan-jaff
|
6c13776701
|
(fix) alerting - show timestamps in alert
|
2024-01-24 15:25:40 -08:00 |
|
ishaan-jaff
|
8f4e256531
|
(feat) add request_info to slack alerts
|
2024-01-24 15:17:33 -08:00 |
|
ishaan-jaff
|
47110180c8
|
(feat) proxy - add timestamp to debug logs
|
2024-01-24 15:16:18 -08:00 |
|
Krrish Dholakia
|
e471157d57
|
test(test_keys.py): add testing to make sure budget resets are working as expected
|
2024-01-24 15:13:11 -08:00 |
|
Krrish Dholakia
|
f9d159797a
|
fix(proxy_server.py): handle view spend logs for api key none object
|
2024-01-24 14:57:21 -08:00 |
|
 Krish DholakiaandGitHub
|
3e7ed4082a
|
Merge pull request #1600 from BerriAI/litellm_global_budget
feat(proxy_server.py): support global budget and resets
|
2024-01-24 14:55:36 -08:00 |
|
ishaan-jaff
|
087bd5e267
|
(feat) slack alerting - log request/response
|
2024-01-24 14:55:21 -08:00 |
|
 Krish DholakiaandGitHub
|
ed77f2d682
|
Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key
feat(proxy_server.py): enable returning spend logs by api key
|
2024-01-24 14:45:25 -08:00 |
|
Krrish Dholakia
|
159e54d8be
|
feat(proxy_server.py): support global budget and resets
|
2024-01-24 14:27:13 -08:00 |
|
 Ishaan JaffandGitHub
|
4dfa3f5a52
|
Merge pull request #1597 from BerriAI/litellm_simplify_spend_logs
[Fix] SpendLogs stop logging messages, response in SpendLogs
|
2024-01-24 14:02:45 -08:00 |
|
ishaan-jaff
|
fdcb588511
|
(fix) stop logging messages, response in SpendLogs
|
2024-01-24 13:16:34 -08:00 |
|
ishaan-jaff
|
63f18e7163
|
(fix) use get_attr for valid_token
|
2024-01-24 13:01:37 -08:00 |
|
ishaan-jaff
|
25332b4a60
|
(fix) LiteLLM_VerificationToken - use NULL default for max_budget
|
2024-01-24 12:59:50 -08:00 |
|
 Ishaan JaffandGitHub
|
0f6ece7a7b
|
Merge pull request #1588 from BerriAI/litellm_spend_per_user
[Feat] [WIP] View Spend Per User
|
2024-01-24 12:26:12 -08:00 |
|
 Ishaan JaffandGitHub
|
f76620b1d1
|
Merge branch 'main' into litellm_spend_per_user
|
2024-01-24 12:24:15 -08:00 |
|
ishaan-jaff
|
3ca82fb458
|
(docs) spend per user
|
2024-01-24 12:17:23 -08:00 |
|
ishaan-jaff
|
89d8d4e209
|
(ui) spend per user
|
2024-01-24 12:10:35 -08:00 |
|
ishaan-jaff
|
d812ae7e9a
|
(test) spend_user_fn, spend_key_fn
|
2024-01-24 12:09:16 -08:00 |
|
ishaan-jaff
|
3d56d8ee02
|
(ui) view spend per user
|
2024-01-24 11:39:05 -08:00 |
|
ishaan-jaff
|
2692afca75
|
(feat) /spend/users endpoint
|
2024-01-24 11:34:28 -08:00 |
|
ishaan-jaff
|
1872122bfb
|
(test) streaming spend logs test - actually run this
|
2024-01-24 11:27:27 -08:00 |
|
 Ishaan JaffandGitHub
|
c356dfa08f
|
Merge pull request #1591 from BerriAI/litellm_test_spend_logging
[Test] Proxy - writing spend logs table
|
2024-01-24 11:23:53 -08:00 |
|
Krrish Dholakia
|
f0ada5c950
|
test(test_spend_logs): new endpoint test for /spend/logs
|
2024-01-24 11:20:31 -08:00 |
|
ishaan-jaff
|
3e53742a4f
|
(test) model in SpendLogs table
|
2024-01-24 11:10:13 -08:00 |
|
ishaan-jaff
|
a842e6520c
|
(test) setting model in SpendTable logs
|
2024-01-24 11:09:20 -08:00 |
|
ishaan-jaff
|
5e8a6fd80e
|
(test) writing spend logs table
|
2024-01-24 10:56:11 -08:00 |
|
Krrish Dholakia
|
dd05c6e6e3
|
feat(proxy_server.py): enable returning spend logs by api key
https://github.com/BerriAI/litellm/issues/1582
|
2024-01-24 10:48:23 -08:00 |
|
ishaan-jaff
|
d3848b6e6c
|
(v0)
|
2024-01-24 10:13:57 -08:00 |
|