Ishaan Jaff
c762e60ae5
stash ui changes
2024-05-06 07:53:55 -07:00
Ishaan Jaff
1b9c799a93
ui - show retry on Admin UI
2024-05-04 22:06:43 -07:00
Ishaan Jaff
87bd499d11
add save button on admin ui
2024-05-04 22:00:57 -07:00
Ishaan Jaff
281e92d0a8
ui - show default retries
2024-05-04 21:58:36 -07:00
Ishaan Jaff
3175be6303
get correct settings on router
2024-05-04 21:51:25 -07:00
Ishaan Jaff
43b50b7151
ui - show retry policy for errors
2024-05-04 21:39:23 -07:00
Ishaan Jaff
e62d8e9bc9
stash ui changes
2024-05-04 21:24:07 -07:00
Ishaan Jaff
c1a215b955
fix set router retry policy on ui
2024-05-04 21:00:03 -07:00
Ishaan Jaff
4dcb4b81f1
fix - python 3.8 error
2024-05-04 20:44:40 -07:00
Ishaan Jaff
fc63c3f555
bump: version 1.35.38 → 1.35.39
2024-05-04 20:43:05 -07:00
Ishaan Jaff and GitHub
713e04848d
Merge pull request #3460 from BerriAI/litellm_use_retry_policy_per_mg
...
[Feat] Set a Retry Policy per model group
2024-05-04 20:42:40 -07:00
Ishaan Jaff and GitHub
ba065653ca
Merge pull request #3457 from BerriAI/litellm_return_num_retries_exceptions
...
[Feat] return num_retries in litellm.Router exceptions
2024-05-04 20:41:54 -07:00
Ishaan Jaff
f09da3f14c
test - test setting retry policies per model groups
2024-05-04 20:40:56 -07:00
Ishaan Jaff
90ac1e3fd9
feat - set retry policy per model group
2024-05-04 20:39:51 -07:00
Ishaan Jaff
95864a1d37
fix router debug logs
2024-05-04 20:24:15 -07:00
Ishaan Jaff
dfc22194b2
fix - undo local dev changes
2024-05-04 19:11:57 -07:00
Ishaan Jaff
6b59aeb603
fix return num retries in exceptions
2024-05-04 19:09:34 -07:00
Ishaan Jaff
5be8c95c6e
fix don't return num retries in utils.py
2024-05-04 19:07:28 -07:00
Ishaan Jaff
0f03e53348
feat return num retries in exceptions
2024-05-04 18:50:38 -07:00
Ishaan Jaff and GitHub
87e165e413
Merge pull request #3456 from BerriAI/litellm_router_set_retry_policy_errors
...
[FEAT] router set custom num retries for ContentPolicyViolationErrorRetries, RateLimitErrorRetries, BadRequestErrorRetries etc
2024-05-04 18:26:03 -07:00
Ishaan Jaff
495d3a9646
router set dynamic retry policies
2024-05-04 18:13:43 -07:00
Ishaan Jaff
009f7c9bfc
support dynamic retry policies
2024-05-04 18:10:15 -07:00
Ishaan Jaff
f70ae68188
fix router test
2024-05-04 17:58:54 -07:00
Ishaan Jaff
bbf5d79069
docs - set retry policy
2024-05-04 17:52:01 -07:00
Ishaan Jaff
8d128a4b91
test - router retry policy
2024-05-04 17:30:30 -07:00
Ishaan Jaff and GitHub
b83901a861
Merge pull request #3451 from BerriAI/litellm_return_model_api_base
...
[Feat] Return model, api_base and first 100 chars of messages in Azure Exceptions
2024-05-04 17:07:09 -07:00
Ishaan Jaff
9e4e467039
test router - retry policy
2024-05-04 17:06:34 -07:00
Ishaan Jaff
5d17c814a3
router - use retry policy
2024-05-04 17:04:51 -07:00
Ishaan Jaff
6d1981fbaa
init router retry policy
2024-05-04 16:59:14 -07:00
Krish Dholakia and GitHub
601e8a1172
Merge pull request #3448 from BerriAI/litellm_anthropic_fix
...
fix(factory.py): support 'function' openai message role for anthropic
2024-05-04 16:36:05 -07:00
Ishaan Jaff
85b2137f9c
fix - test exceptions vertex ai
2024-05-04 16:09:20 -07:00
Ishaan Jaff
7150df653f
test azure exceptions are more decriptive
2024-05-04 13:02:29 -07:00
Ishaan Jaff and GitHub
d45328dda6
Merge pull request #3450 from BerriAI/revert-3397-main
...
Revert "Add return_exceptions to litellm.batch_completion"
2024-05-04 13:01:25 -07:00
Ishaan Jaff and GitHub
df8e33739d
Revert "Add return_exceptions to litellm.batch_completion"
2024-05-04 13:01:17 -07:00
Ishaan Jaff and GitHub
d968dedd77
Merge pull request #1530 from TanaroSch/main
...
change max_tokens type to int
2024-05-04 12:47:15 -07:00
Krish Dholakia and GitHub
a3905bad94
Merge pull request #3447 from BerriAI/litellm_fix_redis_ping
...
fix(caching.py): fix redis caching ping check
2024-05-04 12:46:31 -07:00
Krrish Dholakia
09d7121af2
fix(bedrock.py): map finish reason for bedrock
2024-05-04 12:45:40 -07:00
Ishaan Jaff
855c7caf0b
fix add get_first_chars_messages in utils
2024-05-04 12:43:09 -07:00
Ishaan Jaff and GitHub
7094ac9557
Merge pull request #3397 from ffreemt/main
...
Add return_exceptions to litellm.batch_completion
2024-05-04 12:41:21 -07:00
Krrish Dholakia
8d49b3a84c
fix(factory.py): support openai 'functions' messages
2024-05-04 12:33:39 -07:00
Ishaan Jaff and GitHub
faa8b77325
Merge pull request #3449 from BerriAI/litellm_return_messages_exceptions
...
[Feat] Add Exception mapping for Azure ContentPolicyViolationError
2024-05-04 11:55:19 -07:00
Ishaan Jaff
76825e1d2c
test - mapping content policy violation errors
2024-05-04 11:15:34 -07:00
Ishaan Jaff
c6beaf53af
litellm map Azure GPT ContentPolicyViolationError
2024-05-04 11:14:47 -07:00
Ishaan Jaff
59dac1bc7a
ui - new build
2024-05-04 10:55:39 -07:00
Krrish Dholakia
d9d5149aa1
fix(factory.py): support mapping openai 'tool' message to anthropic format
2024-05-04 10:14:52 -07:00
Krrish Dholakia
33472bfd2b
fix(factory.py): support 'function' openai message role for anthropic
...
Fixes https://github.com/BerriAI/litellm/issues/3446
2024-05-04 10:03:30 -07:00
Ishaan Jaff and GitHub
0bc6969e4d
Merge pull request #3408 from msabramo/test_proxy_exception_mapping_mock_improvements
...
Improve mocking in `test_proxy_exception_mapping.py`
2024-05-04 09:29:41 -07:00
Krrish Dholakia
5a79f648c6
fix(caching.py): fix redis caching ping check
...
don't fail to startup. Log an error message.
2024-05-04 08:48:53 -07:00
Krish Dholakia and GitHub
e7149a6812
Merge pull request #3445 from paneru-rajan/Issue-1159-imrove-reaceloop-doc
...
Improve the document of Traceloop
2024-05-04 08:35:56 -07:00
Rajan Paneru
7d9377f18a
Improve the document of Traceloop
...
If we follow exact step I was getting two errors, which this Pull-Request will fix:
* Fixed the yaml snippet spacing issue: it was throwing error when running copy+paste code
* Added api_key: my-fake-key as to run litellm --config config.yaml --debug it will be required, otherwise it will fail
Need for Improvements:
* The traceloop is ambigous, because it's a company that maintains OpenLLMetry, and has observability solution and the sdk name is aslo traceloop-sdk
* The doc was missing several other observability solutions
* The steps were not quite obvious, added one more steps to make things clear
2024-05-04 22:42:53 +09:30
Ishaan Jaff