Commit Graph

16311 Commits

Author SHA1 Message Date
Krrish Dholakia 718c2cfa4e docs(team_logging.md): cleanup docs 2024-08-12 19:53:05 -07:00
Krrish Dholakia d1d28487f7 refactor(test_users.py): refactor test for user info to use mock endpoints v1.43.9 2024-08-12 18:48:43 -07:00
Ishaan Jaff 66c0d32b1d fix gcs logging test 2024-08-12 17:42:04 -07:00
Krrish Dholakia ef8fb23334 fix(cost_calculator.py): fix cost calc 2024-08-12 16:47:15 -07:00
Ishaan Jaff 89e3141e2d Merge pull request #5171 from BerriAI/litellm_log_gcs_in_folders
[Feat] Log GCS logs in folders based on dd-m-yyyy
2024-08-12 16:37:33 -07:00
Ishaan Jaff 6589666028 fix gcs test 2024-08-12 16:34:27 -07:00
Ishaan Jaff 3d06abb55a tes logging to gcs buckets 2024-08-12 16:33:35 -07:00
Krrish Dholakia a8644d8a7d fix(utils.py): if openai model, don't check hf tokenizers 2024-08-12 16:28:22 -07:00
Ishaan Jaff 49b8dee14d feat log responses in folders 2024-08-12 16:28:12 -07:00
Ishaan Jaff 96f3eb99c9 test gcs logging payload 2024-08-12 16:07:08 -07:00
Ishaan Jaff 19240b6cfd feat gcs log user api key metadata 2024-08-12 16:06:10 -07:00
Krrish Dholakia e9c88952b9 bump: version 1.43.8 → 1.43.9 2024-08-12 15:50:07 -07:00
Krrish Dholakia 22e2840daa fix(cost_calculator.py): handle openai usage pydantic object
Fixes https://github.com/BerriAI/litellm/issues/5165
2024-08-12 15:45:21 -07:00
Krrish Dholakia fdd9a07051 fix(utils.py): Break out of infinite streaming loop
Fixes https://github.com/BerriAI/litellm/issues/5158
2024-08-12 14:00:43 -07:00
Ishaan Jaff d0a68ab123 bump: version 1.43.7 → 1.43.8 2024-08-12 12:27:09 -07:00
Ishaan Jaff 12f9894d69 Merge pull request #5168 from BerriAI/litellm_use_user_api_key_auth_int_usr_endpoints
[Feat Proxy] Send slack alert on CRUD endpoints for Internal Users
2024-08-12 12:20:16 -07:00
Ishaan Jaff 0fbcfef08a Merge pull request #5167 from BerriAI/litellm_fix_docstring
[Proxy docstring] fix curl on docstring on /team endpoints
2024-08-12 12:20:03 -07:00
Ishaan Jaff c401970522 Merge pull request #5166 from BerriAI/litellm_log_key_created_slack
[Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users
2024-08-12 12:18:04 -07:00
Ishaan Jaff 1c71e4db17 fix internal user tests to pass 2024-08-12 12:11:23 -07:00
Ishaan Jaff a44bd23631 log new_user, delete user 2024-08-12 12:01:26 -07:00
Ishaan Jaff 06eb9c4e39 send slack alert on team events 2024-08-12 11:56:13 -07:00
Ishaan Jaff f6896aaaf7 fix doc string for team endpoints 2024-08-12 11:54:28 -07:00
Ishaan Jaff 4435a23121 send alert on all key events 2024-08-12 11:39:24 -07:00
Krrish Dholakia 96d4466a8f fix(azure.py): return response headers acompletion + acompletion w/ streaming
Fixes https://github.com/BerriAI/litellm/issues/2440#issuecomment-2283259187
2024-08-12 11:29:49 -07:00
Krrish Dholakia b3c7d63ec1 fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True. 2024-08-12 11:20:30 -07:00
Ishaan Jaff 65ac139b6b make send_management_endpoint_alert a premium feature 2024-08-12 11:12:38 -07:00
Ishaan Jaff 1335859e5d send management endpoint alert 2024-08-12 11:07:48 -07:00
Ishaan Jaff 47953aaa96 use management_endpoint_wrapper for key endpoints 2024-08-12 11:02:21 -07:00
Ishaan Jaff 30a54ef007 v0 log KeyCreatedEvent 2024-08-12 10:56:11 -07:00
Krrish Dholakia 2ed2ae96af fix(user_api_key_auth.py): move warning to debug log 2024-08-12 10:35:44 -07:00
Ishaan Jaff dc8f9e7241 docs mark oidc as beta 2024-08-12 09:01:36 -07:00
Krrish Dholakia 8cbf8d5671 docs(perplexity.md): show how to get 'return_citations' 2024-08-12 09:01:14 -07:00
Ishaan Jaff dd9be6f160 allow setting PROMETHEUS_SELECTED_INSTANCE 2024-08-10 17:31:05 -07:00
Ishaan Jaff e46009f3d2 Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack
[Feat-Proxy] send prometheus fallbacks stats to slack
2024-08-10 17:14:01 -07:00
Ishaan Jaff cc3316104f doc new prometheus metrics 2024-08-10 17:13:36 -07:00
Krrish Dholakia a0a1feb7da fix(management/utils.py): fix add_member to team when adding user_email
Fixes https://github.com/BerriAI/litellm/issues/5112
2024-08-10 17:12:09 -07:00
Ishaan Jaff aef13a37f4 feat add cron job for sending stats from prometheus 2024-08-10 16:56:03 -07:00
Ishaan Jaff 017ba7a0fe add slack alerting on proxy_config.yaml 2024-08-10 16:37:59 -07:00
Krrish Dholakia 575afa8029 fix(internal_user_endpoints.py): return all teams if user is admin 2024-08-10 16:36:43 -07:00
Ishaan Jaff 28b930c0b7 feat - use api to get prometheus api metrics 2024-08-10 16:36:06 -07:00
Ishaan Jaff 35de40e6eb add fallback_reports in slack alert types 2024-08-10 16:08:36 -07:00
Ishaan Jaff 4cdc5c2e25 feat add prometheus api to get data from endpoint 2024-08-10 16:07:08 -07:00
Ishaan Jaff ffb7f9f280 add fallback_reports as slack alert 2024-08-10 15:26:32 -07:00
Krrish Dholakia e67a239520 fix(teams.tsx): reduce network calls to /team/info 2024-08-10 15:24:23 -07:00
Krrish Dholakia 19bb95f781 build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map
Closes https://github.com/BerriAI/litellm/issues/4881
2024-08-10 14:15:12 -07:00
Ishaan Jaff e861d97bf2 bump: version 1.43.6 → 1.43.7 v1.43.7-stable v1.43.7 v1.43.6.dev1 2024-08-10 14:11:14 -07:00
Ishaan Jaff 3bc39af1b9 Merge pull request #5153 from BerriAI/litellm_track_fallback_prometheus
Feat - Proxy track fallback metrics on prometheus
2024-08-10 14:10:42 -07:00
Ishaan Jaff d1eedb04bd prometheus log_success_fallback_event 2024-08-10 14:05:18 -07:00
Ishaan Jaff 2a54be4a43 feat - log fallbacks events on prometheus 2024-08-10 13:57:25 -07:00
Krrish Dholakia 0ea056971c docs(prefix.md): add prefix support to docs 2024-08-10 13:55:47 -07:00