Commit Graph
11459 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub ea9b4dc439 Merge pull request #3619 from BerriAI/litellm_show_spend_reports
[Feat] -  `/global/spend/report`
2024-05-13 16:06:02 -07:00
Ishaan Jaff eb2d6ba20a ui - new build 2024-05-13 15:56:59 -07:00
Ishaan Jaff 53ab935151 cleanup PR template 2024-05-13 15:54:58 -07:00
Ishaan Jaff d0a5c9b363 docs - spend per team 2024-05-13 15:48:26 -07:00
Krrish Dholakia aa2f6aa5bd bump: version 1.37.7 → 1.37.8 2024-05-13 15:31:59 -07:00
Ishaan Jaff 11d3c86cf1 test /spend/report 2024-05-13 15:26:39 -07:00
Krrish Dholakia b4a8665d11 fix(utils.py): fix custom pricing when litellm model != response obj model name 2024-05-13 15:25:35 -07:00
Ishaan JaffandGitHub 1be6ea0c0d Merge pull request #3603 from alexanderepstein/langfuse_turn_off_messaging
feat(langfuse.py): Allow for individual call message/response redaction
2024-05-13 15:21:41 -07:00
Ishaan Jaff 12cf9d71c7 feat - /spend/report endpoint 2024-05-13 15:01:02 -07:00
Krrish Dholakia 1312eece6d fix(router.py): overloads for better router.acompletion typing 2024-05-13 14:27:16 -07:00
Krrish Dholakia bd2f46fd75 fix(slack_alerting.py): if 'turn_off_message_logging' enabled, do not log the message to logging integration 2024-05-13 14:02:43 -07:00
Ishaan Jaff 9d4b727913 fix - show team based spend reports 2024-05-13 13:56:48 -07:00
Krrish Dholakia 7fa203c810 docs(input.md): add mistral to input param docs 2024-05-13 13:50:49 -07:00
Krrish Dholakia 20456968e9 fix(openai.py): creat MistralConfig with response_format mapping for mistral api v1.37.7 2024-05-13 13:29:58 -07:00
Ishaan Jaff 20fe4ffd6b bump: version 1.37.6 → 1.37.7 2024-05-13 13:03:14 -07:00
Ishaan JaffandGitHub 112c06ae54 Merge pull request #3550 from BerriAI/dependabot/npm_and_yarn/ui/litellm-dashboard/next-14.1.1
build(deps): bump next from 14.1.0 to 14.1.1 in /ui/litellm-dashboard
2024-05-13 13:01:02 -07:00
Ishaan Jaff 3a838934c9 docs - cooldown deployment 2024-05-13 12:50:59 -07:00
Ishaan Jaff dac8c644fd docs - router show cooldown_time 2024-05-13 12:49:51 -07:00
Ishaan JaffandGitHub 21845bc061 Merge pull request #3609 from BerriAI/litellm_send_daily_spend_report
[Feat] send weekly spend reports by Team/Tag
2024-05-13 12:45:37 -07:00
Krrish Dholakia 39e4927752 fix(utils.py): fix vertex ai function calling + streaming
Completes https://github.com/BerriAI/litellm/issues/3147
v1.37.6
2024-05-13 12:32:39 -07:00
Ishaan Jaff 40b2f33a80 fix - only schedule spend alerting when db is not none 2024-05-13 12:30:54 -07:00
Ishaan JaffandGitHub efaf4c87f2 Merge pull request #3601 from msabramo/msabramo/update-fastapi-to-update-starlette-to-fix-httpx-warnings
Update FastAPI to update starlette to fix warnings
2024-05-13 12:20:17 -07:00
Krrish Dholakia 5dc3f157a6 build(model_prices_and_context_window.json): fix gpt-4o max tokens 2024-05-13 12:11:15 -07:00
Krish DholakiaandGitHub 6c2168b6f7 Merge pull request #3613 from ConnorDoyle/patch-1
Add gpt-4o metadata
2024-05-13 12:09:27 -07:00
Connor DoyleandGitHub 5da5021918 Update model_prices_and_context_window.json 2024-05-13 11:51:54 -07:00
Connor DoyleandGitHub a4380f67a9 Add gpt-4o metadata
#3612
2024-05-13 11:12:17 -07:00
Ishaan Jaff 7f6f196e66 ui - show daily reports on UI 2024-05-13 10:55:54 -07:00
Ishaan Jaff 3fbebe16aa fix - spend reports on alerts 2024-05-13 10:51:59 -07:00
Ishaan Jaff aac81c59b5 test - weekly / monthly spend report alerts on /health/services 2024-05-13 10:50:26 -07:00
Ishaan Jaff 197eb44832 fix scheduling spend reports 2024-05-13 10:45:22 -07:00
Ishaan Jaff 4a679bb640 schedule weekly/monthly spend reports 2024-05-13 10:44:19 -07:00
Krrish Dholakia 04ae285001 fix(vertex_ai.py): support tool call list response async completion 2024-05-13 10:42:31 -07:00
Ishaan Jaff 2cd584a3ad feat - send_monthly_spend_report 2024-05-13 10:17:40 -07:00
Krrish Dholakia 7f6e933372 fix(router.py): give an 'info' log when fallbacks work successfully 2024-05-13 10:17:32 -07:00
Ishaan Jaff 55f747fb1d fix - show monthly spend in slack reports 2024-05-13 10:17:09 -07:00
Ishaan Jaff 07247452c5 feat - show monthly spend reports 2024-05-13 10:10:44 -07:00
Krrish Dholakia 13e1577753 fix(slack_alerting.py): don't fire spam alerts when backend api call fails 2024-05-13 10:04:43 -07:00
Ishaan Jaff 50f3677989 feat - _get_weekly_spend_reports 2024-05-13 09:26:51 -07:00
Ishaan Jaff b7bbaf1a68 feat - send daily spend reports 2024-05-13 09:25:31 -07:00
Marc Abramowitz e73e36f210 requirements.txt: Update fastapi to 0.111.0 2024-05-13 09:21:19 -07:00
Krrish Dholakia b063ef7a47 bump: version 1.37.5 → 1.37.6 2024-05-13 09:08:04 -07:00
Krrish Dholakia 5342b3dc05 fix(router.py): fix error message to return if pre-call-checks + allowed model region 2024-05-13 09:04:38 -07:00
Krrish Dholakia c3293474dd fix(proxy_server.py): return 'allowed-model-region' in headers 2024-05-13 08:48:16 -07:00
Ishaan JaffandGitHub 514c5737f8 Merge pull request #3587 from BerriAI/litellm_proxy_use_batch_completions_model_csv
[Feat] Use csv values for proxy batch completions (OpenAI Python compatible)
2024-05-13 07:55:12 -07:00
Alex Epstein 3bf2ccc856 feat(langfuse.py): Allow for individual call message/response redaction 2024-05-12 22:38:29 -04:00
Marc Abramowitz 82f43f98b3 Update FastAPI to update starlette to fix warnings
The httpx package emits some warnings when we run the tests in
`test_proxy_server.py`:

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py
...
litellm/tests/test_proxy_server.py::test_bedrock_embedding
litellm/tests/test_proxy_server.py::test_chat_completion
litellm/tests/test_proxy_server.py::test_chat_completion_azure
litellm/tests/test_proxy_server.py::test_chat_completion_optional_params
litellm/tests/test_proxy_server.py::test_embedding
litellm/tests/test_proxy_server.py::test_engines_model_chat_completions
litellm/tests/test_proxy_server.py::test_health
litellm/tests/test_proxy_server.py::test_img_gen
litellm/tests/test_proxy_server.py::test_openai_deployments_model_chat_completions_azure
  .../site-packages/httpx/_client.py:680:
  DeprecationWarning: The 'app' shortcut is now deprecated.
  Use the explicit style 'transport=WSGITransport(app=...)' instead.
    warnings.warn(message, DeprecationWarning)
...
```

Fixing this requires updating starlette, but the version of FastAPI in use
prevents that. So I updated FastAPI to update starlette to fix the httpx
warnings.

When run in combination with the changes in GH-3600, the tests pass and only
emit 1 warning!

```shell
$ env -i PATH=$PATH poetry run pytest litellm/tests/test_proxy_server.py
====================================== test session starts ======================================
platform darwin -- Python 3.12.3, pytest-7.4.4, pluggy-1.5.0
rootdir: /Users/abramowi/Code/OpenSource/litellm
plugins: anyio-4.3.0, mock-3.14.0
collected 12 items

litellm/tests/test_proxy_server.py s..........s                                           [100%]

======================================= warnings summary ========================================
litellm/utils.py:43
  /Users/abramowi/Code/OpenSource/litellm/litellm/utils.py:43: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources  # type: ignore

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== 10 passed, 2 skipped, 1 warning in 8.81s ============================
```
2024-05-12 12:26:23 -07:00
Krrish Dholakia 61143c8b45 refactor(main.py): trigger new build v1.37.5 v1.37.5-stable 2024-05-11 22:53:09 -07:00
Krrish Dholakia 99e8f0715e test(test_end_users.py): fix end user region routing test 2024-05-11 22:42:43 -07:00
Krrish Dholakia b4684d5132 fix(proxy_server.py): linting fix 2024-05-11 22:05:01 -07:00
Krrish Dholakia 094f20121a build(model_prices_and_context_window.json): add bedrock cohere command r pricing 2024-05-11 21:38:53 -07:00