Commit Graph
6093 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 6501fdb76e Merge branch 'main' into litellm_global_spend_updates 2024-01-24 20:20:15 -08:00
Krrish Dholakia 30d615f442 build(proxy_server_config.yaml): add proxy budget to default yaml 2024-01-24 20:12:03 -08:00
Krrish Dholakia b1864c3d11 bump: version 1.19.0 → 1.19.1 2024-01-24 20:10:14 -08:00
Krrish Dholakia 43f139fafd fix(ollama_chat.py): fix default token counting for ollama chat 2024-01-24 20:09:17 -08:00
Krrish Dholakia 05b4d49882 ci(config.yml): add debug logs 2024-01-24 19:54:37 -08:00
ishaan-jaff 3e59a02dfb (test) test /key/gen with max_budget=None 2024-01-24 19:27:53 -08:00
Ishaan JaffandGitHub cf58ecf5c3 Merge pull request #1604 from BerriAI/litellm_view_cache_key_in_spend_logs
[Feat] Add cache_key in SpendLogs Table
2024-01-24 19:13:13 -08:00
ishaan-jaff 6bc715cf85 (test) logging cache_key in spendLogs 2024-01-24 18:54:23 -08:00
ishaan-jaff 2f3765a03f (fix) log cache hits on SpendLogs table 2024-01-24 18:51:39 -08:00
ishaan-jaff bf851ef19a (fix) use litellm.cache for getting key 2024-01-24 18:34:22 -08:00
ishaan-jaff 2130a61b6e (feat) add cache_key in spend_log 2024-01-24 17:56:00 -08:00
Krrish Dholakia f148094d18 test(test_key_generate_prisma.py): add unit testing for global proxy budget 2024-01-24 17:43:01 -08:00
ishaan-jaff d694993703 (fix) bug from bb7705b494 v1.19.0 2024-01-24 17:34:17 -08:00
ishaan-jaff 3305dc75ca (docs) add comments on prisma.schema 2024-01-24 17:15:05 -08:00
Krrish Dholakia 30a8071bf1 fix(proxy_server.py): enforce budget limit if global proxy limit reached 2024-01-24 17:11:40 -08:00
Ishaan JaffandGitHub 45ca7343d0 Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign
[Feat] Proxy - Improve Slack Alerting
2024-01-24 16:43:23 -08:00
Krrish Dholakia 624da17698 test(test_users.py): add testing for global proxy spend tracking 2024-01-24 16:24:50 -08:00
ishaan-jaff 9aae60f162 (FIX) improve slack alerting messages 2024-01-24 16:07:46 -08:00
Krrish Dholakia 574208f005 fix(proxy_server.py): track cost for global proxy 2024-01-24 16:06:10 -08:00
ishaan-jaff b993c62144 (fix) only alert users when requests are hanging 2024-01-24 15:58:07 -08:00
Krrish Dholakia ba24037baf bump: version 1.18.13 → 1.19.0 2024-01-24 15:30:49 -08:00
Krrish Dholakia bb7705b494 test(test_users.py): test budgets with resets 2024-01-24 15:30:30 -08:00
ishaan-jaff 6c13776701 (fix) alerting - show timestamps in alert 2024-01-24 15:25:40 -08:00
ishaan-jaff 8f4e256531 (feat) add request_info to slack alerts 2024-01-24 15:17:33 -08:00
ishaan-jaff 47110180c8 (feat) proxy - add timestamp to debug logs 2024-01-24 15:16:18 -08:00
Krrish Dholakia e471157d57 test(test_keys.py): add testing to make sure budget resets are working as expected 2024-01-24 15:13:11 -08:00
Krrish Dholakia f9d159797a fix(proxy_server.py): handle view spend logs for api key none object 2024-01-24 14:57:21 -08:00
Krish DholakiaandGitHub 3e7ed4082a Merge pull request #1600 from BerriAI/litellm_global_budget
feat(proxy_server.py): support global budget and resets
2024-01-24 14:55:36 -08:00
ishaan-jaff 087bd5e267 (feat) slack alerting - log request/response 2024-01-24 14:55:21 -08:00
Krish DholakiaandGitHub ed77f2d682 Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key
feat(proxy_server.py): enable returning spend logs by api key
2024-01-24 14:45:25 -08:00
Krrish Dholakia 159e54d8be feat(proxy_server.py): support global budget and resets 2024-01-24 14:27:13 -08:00
Ishaan JaffandGitHub 4dfa3f5a52 Merge pull request #1597 from BerriAI/litellm_simplify_spend_logs
[Fix] SpendLogs stop logging messages, response in SpendLogs
2024-01-24 14:02:45 -08:00
ishaan-jaff fdcb588511 (fix) stop logging messages, response in SpendLogs 2024-01-24 13:16:34 -08:00
ishaan-jaff 63f18e7163 (fix) use get_attr for valid_token 2024-01-24 13:01:37 -08:00
ishaan-jaff 25332b4a60 (fix) LiteLLM_VerificationToken - use NULL default for max_budget 2024-01-24 12:59:50 -08:00
Ishaan JaffandGitHub 0f6ece7a7b Merge pull request #1588 from BerriAI/litellm_spend_per_user
[Feat] [WIP] View Spend Per User
2024-01-24 12:26:12 -08:00
Ishaan JaffandGitHub f76620b1d1 Merge branch 'main' into litellm_spend_per_user 2024-01-24 12:24:15 -08:00
ishaan-jaff 3ca82fb458 (docs) spend per user 2024-01-24 12:17:23 -08:00
ishaan-jaff 89d8d4e209 (ui) spend per user 2024-01-24 12:10:35 -08:00
ishaan-jaff d812ae7e9a (test) spend_user_fn, spend_key_fn 2024-01-24 12:09:16 -08:00
ishaan-jaff 3d56d8ee02 (ui) view spend per user 2024-01-24 11:39:05 -08:00
ishaan-jaff 2692afca75 (feat) /spend/users endpoint 2024-01-24 11:34:28 -08:00
ishaan-jaff 1872122bfb (test) streaming spend logs test - actually run this 2024-01-24 11:27:27 -08:00
Ishaan JaffandGitHub c356dfa08f Merge pull request #1591 from BerriAI/litellm_test_spend_logging
[Test] Proxy - writing spend logs table
2024-01-24 11:23:53 -08:00
Krrish Dholakia f0ada5c950 test(test_spend_logs): new endpoint test for /spend/logs 2024-01-24 11:20:31 -08:00
ishaan-jaff 3e53742a4f (test) model in SpendLogs table 2024-01-24 11:10:13 -08:00
ishaan-jaff a842e6520c (test) setting model in SpendTable logs 2024-01-24 11:09:20 -08:00
ishaan-jaff 5e8a6fd80e (test) writing spend logs table 2024-01-24 10:56:11 -08:00
Krrish Dholakia dd05c6e6e3 feat(proxy_server.py): enable returning spend logs by api key
https://github.com/BerriAI/litellm/issues/1582
2024-01-24 10:48:23 -08:00
ishaan-jaff d3848b6e6c (v0) 2024-01-24 10:13:57 -08:00