 Ishaan JaffandGitHub
|
3dd1e8dfe7
|
Merge pull request #3427 from BerriAI/litellm_test_alert_size
[Test] - Ensure only 1 slack callback + Size of of all callbacks do not grow
|
2024-05-03 16:27:16 -07:00 |
|
|
Krish DholakiaandGitHub
|
1b35a75245
|
Merge pull request #3430 from BerriAI/litellm_return_api_base
feat(proxy_server.py): return api base in response headers
|
2024-05-03 16:25:21 -07:00 |
|
|
Krrish Dholakia
|
a732d8772a
|
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
Closes https://github.com/BerriAI/litellm/issues/3398
|
2024-05-03 16:24:21 -07:00 |
|
|
Ishaan Jaff
|
401bf8d67e
|
test - bedrock v2 supports dimension
|
2024-05-03 16:23:37 -07:00 |
|
|
Ishaan Jaff
|
4a39b95acc
|
fix - support dimension for titan embed v2
|
2024-05-03 16:13:27 -07:00 |
|
|
Ishaan Jaff
|
bf048ecda4
|
docs - titan embeddings v2
|
2024-05-03 15:59:02 -07:00 |
|
|
Ishaan Jaff
|
fbe412a3a6
|
feat - add amazon.titan-embed-text-v2
|
2024-05-03 15:58:05 -07:00 |
|
|
Ishaan JaffandGitHub
|
5333474a6f
|
Merge pull request #3431 from BerriAI/litellm_simplify_docs_prod
docs - simplify best practices for prod
|
2024-05-03 15:56:03 -07:00 |
|
|
Ishaan Jaff
|
209baaca02
|
docs - simplify prod docs
|
2024-05-03 15:40:05 -07:00 |
|
|
Krrish Dholakia
|
5b39f8e282
|
feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
|
2024-05-03 15:27:32 -07:00 |
|
|
Ishaan Jaff
|
bae5d3601d
|
feat - add unit tests for slack alerting
|
2024-05-03 15:08:55 -07:00 |
|
|
Ishaan Jaff
|
ab27866b6a
|
fix test slack alerting len
|
2024-05-03 14:58:11 -07:00 |
|
|
Ishaan Jaff
|
a369867e02
|
test - num alerts on callbacks
|
2024-05-03 14:46:44 -07:00 |
|
|
Ishaan Jaff
|
e5311d35f2
|
fix test len active callbacks
|
2024-05-03 14:32:13 -07:00 |
|
|
Ishaan Jaff
|
3997ea6442
|
fix - return num callbacks in /active/callbacks
|
2024-05-03 14:24:01 -07:00 |
|
|
Ishaan Jaff
|
e9eead2f25
|
test - size of callbacks, alerts
|
2024-05-03 14:22:15 -07:00 |
|
|
Ishaan JaffandGitHub
|
e99edaf4e1
|
Merge pull request #3426 from BerriAI/litellm_set_db_exceptions_on_ui
UI - set DB Exceptions webhook_url on UI
|
2024-05-03 14:05:37 -07:00 |
|
|
Ishaan Jaff
|
776f541f6c
|
fix bug where slack would get inserting several times
|
2024-05-03 14:04:38 -07:00 |
|
|
Ishaan Jaff
|
fdc9856652
|
UI - set DB Exceptions webhook_url
|
2024-05-03 13:33:43 -07:00 |
|
|
Ishaan JaffandGitHub
|
34bf0b37f5
|
Merge pull request #3423 from BerriAI/litellm_test_callbacks_proxy
[Test] Assert num Callbacks on Proxy don't increase
|
2024-05-03 12:44:56 -07:00 |
|
|
Krrish Dholakia
|
b2a0502383
|
bump: version 1.35.36 → 1.35.37
v1.35.37
|
2024-05-03 12:42:20 -07:00 |
|
|
Krrish Dholakia
|
defc205348
|
test(test_alangfuse.py): fix test
|
2024-05-03 12:39:38 -07:00 |
|
|
Krish DholakiaandGitHub
|
cb1872d7cb
|
Merge pull request #3422 from BerriAI/litellm_lowest_latency_fix
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
v1.35.36-dev2
|
2024-05-03 10:14:50 -07:00 |
|
|
Krrish Dholakia
|
2dd9d2f704
|
test(test_amazing_vertex_completion.py): try-except api errors
|
2024-05-03 10:09:57 -07:00 |
|
|
Ishaan Jaff
|
9ba5685722
|
test active callbacks on proxy
|
2024-05-03 10:05:06 -07:00 |
|
|
Ishaan Jaff
|
fe6e465466
|
test - num callbacks on proxy should not increase
|
2024-05-03 09:59:59 -07:00 |
|
|
Ishaan JaffandGitHub
|
c6a9b460cd
|
Merge pull request #3419 from BerriAI/litellm_fix_lowest_latency_router
[Fix] Ensure callbacks are not added to router when `store_model_in_db=True`
|
2024-05-03 09:28:35 -07:00 |
|
|
Ishaan Jaff
|
23d334fe60
|
proxy - return num callbacks on /health/readiness
|
2024-05-03 09:14:32 -07:00 |
|
|
Ishaan Jaff
|
a1814a3e4c
|
test - num callbacks on proxy
|
2024-05-03 09:13:37 -07:00 |
|
|
Krrish Dholakia
|
0b72904608
|
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
1.35.36
|
2024-05-03 09:00:32 -07:00 |
|
|
Ishaan Jaff
|
540a35ed5e
|
fix update router logic
|
2024-05-03 08:48:11 -07:00 |
|
|
mikeyandGitHub
|
de7fe98556
|
Merge branch 'BerriAI:main' into main
|
2024-05-03 11:30:03 +08:00 |
|
|
ffreemt
|
a7ec1772b1
|
Add litellm\tests\test_batch_completion_return_exceptions.py
|
2024-05-03 11:28:38 +08:00 |
|
|
Krrish Dholakia
|
91971fa9e0
|
feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id
1.35.36.dev1
|
2024-05-02 17:53:09 -07:00 |
|
|
Krrish Dholakia
|
fdc4fdb91a
|
fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
|
2024-05-02 17:18:21 -07:00 |
|
|
Krrish Dholakia
|
5baeeec899
|
fix(openmeter.py): fix get from env
|
2024-05-02 16:34:22 -07:00 |
|
|
Krish DholakiaandGitHub
|
2200900ca2
|
Merge pull request #3393 from Priva28/main
Add Llama3 tokenizer and allow custom tokenizers.
|
2024-05-02 16:32:41 -07:00 |
|
|
Ishaan JaffandGitHub
|
0b27f5b3dc
|
Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts
fix - revert init langfuse client on slack alerts
|
2024-05-02 16:09:23 -07:00 |
|
|
Ishaan Jaff
|
9edf463c3b
|
fix - revert init langfuse client on slack alerts
|
2024-05-02 16:02:52 -07:00 |
|
|
Marc Abramowitz
|
cdb39e90ce
|
Improve mocking in test_proxy_exception_mapping
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
|
2024-05-02 15:16:20 -07:00 |
|
|
Ishaan JaffandGitHub
|
f893f8bc55
|
Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors
Disambiguate invalid model name errors
|
2024-05-02 15:09:59 -07:00 |
|
|
Krish DholakiaandGitHub
|
9e56472a81
|
Merge pull request #3406 from msabramo/test_proxy_server_mock_improvements
Improve mocking in `test_proxy_server.py`
|
2024-05-02 15:05:09 -07:00 |
|
|
Marc Abramowitz
|
6d154e2317
|
Update tests to reflect new error messages
|
2024-05-02 15:02:58 -07:00 |
|
|
Marc Abramowitz
|
988c37fda3
|
Disambiguate invalid model name errors
because that error can be thrown in several different places, so
knowing the function it's being thrown from can be very useul for debugging.
|
2024-05-02 15:02:54 -07:00 |
|
|
Krrish Dholakia
|
acda064be6
|
fix(proxy/utils.py): fix retry logic for generic data request
v1.35.36
|
2024-05-02 14:50:50 -07:00 |
|
|
Krish DholakiaandGitHub
|
e26b39822c
|
Merge pull request #3405 from azohra/patch-1
Vision for Claude 3 Family + Info for Azure/GPT-4-0409
|
2024-05-02 13:42:01 -07:00 |
|
|
Marc Abramowitz
|
14e7c9b01c
|
Improve mocking in test_proxy_server
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
|
2024-05-02 13:36:23 -07:00 |
|
|
Justin WattsandGitHub
|
77098e31e4
|
Update model_prices_and_context_window.json
|
2024-05-02 13:21:36 -07:00 |
|
|
Justin WattsandGitHub
|
39670cd84a
|
Add Vision Support for Claude 3 Family
modified the model info table to add "supports_vision": true, for the claude 3 family (haiku, sonnet, and opus)
|
2024-05-02 13:09:17 -07:00 |
|
|
Krish DholakiaandGitHub
|
762a1fbd50
|
Merge pull request #3375 from msabramo/GH-3372
Fix route `/openai/deployments/{model}/chat/completions` not working properly
|
2024-05-02 13:00:25 -07:00 |
|