Commit Graph
15128 Commits
Author SHA1 Message Date
Krrish Dholakia 77ffee4e2e test(test_completion.py): add basic test to confirm azure ad token flow works as expected 2024-07-24 13:07:25 -07:00
Krrish Dholakia 99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Krrish Dholakia d9539e518e build(docker-compose.yml): add prometheus scraper to docker compose
persists prometheus data across restarts
v1.42.0-stable
2024-07-24 10:09:23 -07:00
Ishaan JaffandGitHub ac7f6598f3 Merge pull request #4853 from BerriAI/litellm_support_tags
[Feat] - Support Logging tags on langsmith
2024-07-24 09:51:56 -07:00
Ishaan JaffandGitHub 9c2c231c7c Merge pull request #4857 from Manouchehri/improve-oidc-tests-5
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
2024-07-24 09:48:01 -07:00
Ishaan JaffandGitHub 691c1a5355 Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1
Add Llama 3.1 for Bedrock
2024-07-24 09:47:32 -07:00
David Manouchehri ced03d9d7f (test_embedding.py) - Re-enable embedding test with Azure OIDC. 2024-07-24 16:41:24 +00:00
Krish DholakiaandGitHub 035d03c7f2 Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning
Fix `test_prompt_factory` flake8 warning
v1.42.0
2024-07-24 09:38:48 -07:00
Marc Abramowitz a50fe3e1ca Fix test_prompt_factory flake8 warning
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```

Fixed by making the string a raw string, which is equivalent:

```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```

See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
2024-07-24 09:14:22 -07:00
Ishaan JaffandGitHub d06229d168 Merge pull request #4855 from Manouchehri/improve-oidc-tests-4
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
2024-07-24 09:13:48 -07:00
David Manouchehri c364a3129e (test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon. 2024-07-24 16:05:58 +00:00
Ishaan JaffandGitHub f325e29147 Merge pull request #4854 from Manouchehri/oidc-azure-tests-3
OIDC azure tests 3
2024-07-24 08:53:53 -07:00
Ishaan JaffandGitHub b5d580752d Merge pull request #4843 from elabbarw/main
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
2024-07-24 08:53:29 -07:00
Wanis ElabbarandGitHub 1350ac217d Merge pull request #3 from elabbarw/elabbarw-llamav31prices
update azure_ai llamav31 prices with sources
2024-07-24 16:50:35 +01:00
Wanis ElabbarandGitHub 77cf1fd600 update azure_ai llamav31 prices with sources 2024-07-24 16:50:07 +01:00
David Manouchehri 4b89397136 (tests) - Skip embedding Azure AD test for now. 2024-07-24 15:42:57 +00:00
David Manouchehri af3a900b4d (tests) - Try azure AD auth directly. 2024-07-24 15:42:40 +00:00
Krish DholakiaandGitHub bd9486501d Merge pull request #4846 from msabramo/speed-up-check_view_exists
Check existence of multiple views in 1 query
2024-07-24 08:06:04 -07:00
Krrish Dholakia 41fda47587 test(test_embedding.py): fix base url 2024-07-24 08:04:27 -07:00
Ishaan Jaff cea8fcc3fc test - logging langsmith tags 2024-07-24 07:12:45 -07:00
Ishaan Jaff e378ab8bc9 docs - logging langsmith tags 2024-07-24 07:12:36 -07:00
Ishaan Jaff adfd6ab900 langsmith - support logging tags 2024-07-24 07:08:40 -07:00
Wanis ElabbarandGitHub e370b0cde3 Merge branch 'BerriAI:main' into main 2024-07-24 08:32:49 +01:00
David Manouchehri 609075bd17 Add Llama 3.1 for Bedrock. 2024-07-24 05:48:23 +00:00
Marc Abramowitz 642f1a7bcc Check existence of multiple views in 1 query
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
2024-07-23 21:55:02 -07:00
Krrish Dholakia d5d2ffffdf bump: version 1.41.28 → 1.42.0 2024-07-23 21:54:06 -07:00
Krish DholakiaandGitHub 6c580ac8dc Merge pull request #4845 from BerriAI/litellm_vertex_ai_llama3_1_api
feat(vertex_ai_llama.py): vertex ai llama3.1 api support
2024-07-23 21:51:46 -07:00
Krrish Dholakia fb0a13c8bb fix(anthropic.py): support openai system message being a list 2024-07-23 21:45:56 -07:00
Krrish Dholakia ae693424e4 fix(__init__.py): update init 2024-07-23 17:55:28 -07:00
Krrish Dholakia 7df94100e8 build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krrish Dholakia 83ef52e180 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krish DholakiaandGitHub cb4c42e061 Merge pull request #4839 from Manouchehri/azure-oidc-test-1
Add test for Azure OIDC auth
2024-07-23 17:01:00 -07:00
Ishaan Jaff 83b13d34ba bump: version 1.41.27 → 1.41.28 v1.41.28 2024-07-23 16:48:50 -07:00
Ishaan JaffandGitHub e9d6816011 Merge pull request #4838 from BerriAI/doc_anthropic_proxy_usage
doc - using anthropic with litellm proxy server
2024-07-23 16:38:09 -07:00
Ishaan JaffandGitHub 92708a2737 Merge pull request #4841 from BerriAI/litellm_anthropic_cost_tracking
[Feat] - /v1/messages support usage tracking on spendLogs
2024-07-23 16:37:42 -07:00
Ishaan JaffandGitHub d13aa698ea Merge pull request #4844 from BerriAI/litellm_accept_null_values_spend_logs
[Fix-Proxy] Spend Tracking - accept null values for api_base (optional fields) in SpendLogs
2024-07-23 16:37:08 -07:00
Ishaan Jaff 78eb5164df fix DB accept null values for api_base, user, etc 2024-07-23 16:33:04 -07:00
Wanis ElabbarandGitHub b8183bf42c Merge pull request #2 from elabbarw/azureaillama31
feat - add azure_ai llama v3.1 8B 70B and 405B to model prices json
2024-07-24 00:00:41 +01:00
Wanis ElabbarandGitHub e14ef3eeda feat - add azure_ai llama v3.1 8B 70B and 405B 2024-07-23 23:57:50 +01:00
Krrish Dholakia 169da8b8d0 docs(guardrails.md): add team-based controls to guardrails 2024-07-23 15:39:21 -07:00
Ishaan Jaff a71b60d005 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Ishaan Jaff 4c1ee1e282 fix add better debugging _PROXY_track_cost_callback 2024-07-23 15:25:46 -07:00
Ishaan Jaff c3d90f9aee test_anthropic_completion_input_translation_with_metadata 2024-07-23 15:23:58 -07:00
David Manouchehri 2dcd9a5567 (test - azure): Add test for Azure OIDC auth. 2024-07-23 19:12:40 +00:00
Krrish Dholakia f64a3309d1 fix(utils.py): support raw response headers for streaming requests 2024-07-23 11:58:58 -07:00
Krrish Dholakia d1ffb4de5f docs(raw_request_response.md): show how to get openai headers from response 2024-07-23 11:40:26 -07:00
Krrish Dholakia dcb974dd1e feat(utils.py): support passing openai response headers to client, if enabled
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Ishaan Jaff b137207ae6 doc alert_to_webhook_url 2024-07-23 11:04:15 -07:00
Ishaan Jaff aba600a892 fix triton linting 2024-07-23 11:03:34 -07:00
Ishaan Jaff 8845bd4d76 doc - using anthropic with litellm proxy server 2024-07-23 10:42:17 -07:00