Commit Graph
11302 Commits
Author SHA1 Message Date
Ishaan Jaff 7150df653f test azure exceptions are more decriptive 2024-05-04 13:02:29 -07:00
Ishaan JaffandGitHub d45328dda6 Merge pull request #3450 from BerriAI/revert-3397-main
Revert "Add return_exceptions to litellm.batch_completion"
2024-05-04 13:01:25 -07:00
Ishaan JaffandGitHub df8e33739d Revert "Add return_exceptions to litellm.batch_completion" 2024-05-04 13:01:17 -07:00
Ishaan JaffandGitHub d968dedd77 Merge pull request #1530 from TanaroSch/main
change max_tokens type to int
2024-05-04 12:47:15 -07:00
Krish DholakiaandGitHub a3905bad94 Merge pull request #3447 from BerriAI/litellm_fix_redis_ping
fix(caching.py): fix redis caching ping check
2024-05-04 12:46:31 -07:00
Krrish Dholakia 09d7121af2 fix(bedrock.py): map finish reason for bedrock 2024-05-04 12:45:40 -07:00
Ishaan Jaff 855c7caf0b fix add get_first_chars_messages in utils 2024-05-04 12:43:09 -07:00
Ishaan JaffandGitHub 7094ac9557 Merge pull request #3397 from ffreemt/main
Add return_exceptions to litellm.batch_completion
2024-05-04 12:41:21 -07:00
Krrish Dholakia 8d49b3a84c fix(factory.py): support openai 'functions' messages 2024-05-04 12:33:39 -07:00
Ishaan JaffandGitHub faa8b77325 Merge pull request #3449 from BerriAI/litellm_return_messages_exceptions
[Feat] Add Exception mapping for Azure ContentPolicyViolationError
2024-05-04 11:55:19 -07:00
Ishaan Jaff 76825e1d2c test - mapping content policy violation errors 2024-05-04 11:15:34 -07:00
Ishaan Jaff c6beaf53af litellm map Azure GPT ContentPolicyViolationError 2024-05-04 11:14:47 -07:00
Ishaan Jaff 59dac1bc7a ui - new build 2024-05-04 10:55:39 -07:00
Krrish Dholakia d9d5149aa1 fix(factory.py): support mapping openai 'tool' message to anthropic format 2024-05-04 10:14:52 -07:00
Krrish Dholakia 33472bfd2b fix(factory.py): support 'function' openai message role for anthropic
Fixes https://github.com/BerriAI/litellm/issues/3446
2024-05-04 10:03:30 -07:00
Ishaan JaffandGitHub 0bc6969e4d Merge pull request #3408 from msabramo/test_proxy_exception_mapping_mock_improvements
Improve mocking in `test_proxy_exception_mapping.py`
v1.35.38-stable
2024-05-04 09:29:41 -07:00
Krrish Dholakia 5a79f648c6 fix(caching.py): fix redis caching ping check
don't fail to startup. Log an error message.
2024-05-04 08:48:53 -07:00
Krish DholakiaandGitHub e7149a6812 Merge pull request #3445 from paneru-rajan/Issue-1159-imrove-reaceloop-doc
Improve the document of Traceloop
2024-05-04 08:35:56 -07:00
Rajan Paneru 7d9377f18a Improve the document of Traceloop
If we follow exact step I was getting two errors, which this Pull-Request will fix:
* Fixed the yaml snippet spacing issue: it was throwing error when running copy+paste code
* Added api_key: my-fake-key as to run litellm --config config.yaml --debug it will be required, otherwise it will fail

Need for Improvements:
* The traceloop is ambigous, because it's a company that maintains OpenLLMetry, and has observability solution and the sdk name is aslo traceloop-sdk
* The doc was missing several other observability solutions
* The steps were not quite obvious, added one more steps to make things clear
2024-05-04 22:42:53 +09:30
Ishaan JaffandGitHub 8e9ba0f27f Merge pull request #3441 from BerriAI/ui_select_start_end_time
UI select start end time
2024-05-03 22:14:58 -07:00
Ishaan Jaff 2cfb37aaaf add text about model group / time range 2024-05-03 22:14:12 -07:00
Ishaan Jaff 1d9a96bf8f ui - set models and start/endtimes 2024-05-03 22:10:40 -07:00
Ishaan Jaff 19aa43798c ui - select model group 2024-05-03 22:09:22 -07:00
Ishaan Jaff e7adbb3801 ui - model dashboard 2024-05-03 22:09:01 -07:00
Ishaan Jaff d4afe8a3bc ui - view logs by model group and time 2024-05-03 21:59:22 -07:00
Krrish Dholakia b7ca9a53c9 refactor(main.py): trigger new build 2024-05-03 21:53:51 -07:00
Ishaan Jaff 611e7bd403 ui - select model group and date time range 2024-05-03 21:51:47 -07:00
Krrish Dholakia fa47ce456d bump: version 1.35.37 → 1.35.38 v1.35.38 2024-05-03 21:38:32 -07:00
Krrish Dholakia 8249c986bf fix(main.py): support new 'supports_system_message=False' param
Fixes https://github.com/BerriAI/litellm/issues/3325
2024-05-03 21:31:45 -07:00
Ishaan Jaff ed714a9d6e ui select model and start and endtime 2024-05-03 21:21:41 -07:00
Ishaan Jaff d806fe3513 startTime and endTime on UI 2024-05-03 21:21:28 -07:00
Ishaan Jaff fccdb92c6b fix - select startTime and endTime on UI 2024-05-03 21:20:19 -07:00
Ishaan Jaff f7150cdba2 ui - slect start and end date 2024-05-03 20:52:30 -07:00
Krrish Dholakia a35ac050d2 test(test_router_fallbacks.py): bump test limits 2024-05-03 20:42:29 -07:00
Ishaan Jaff 01a11ccced ui - new build 2024-05-03 20:40:58 -07:00
Sebastián EstévezandGitHub fc0ced48c1 add_function_to_prompt bug fix
This blows up when there's no "functions" in the dictionary even when tools is present because the inner function executes regardless (does not short circuit).
2024-05-03 23:38:54 -04:00
Krish DholakiaandGitHub 7d2aa2f645 Merge pull request #3433 from BerriAI/litellm_timeout_fix
fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
2024-05-03 18:53:59 -07:00
Marc Abramowitz eb433bde86 Add route: "/engines/{model:path}/chat/completions"
Without this, it results in:

```pytb
Traceback (most recent call last):
  File "/Users/abramowi/Code/OpenSource/litellm/litellm/proxy/proxy_server.py", line 3836, in completion
    raise HTTPException(
fastapi.exceptions.HTTPException: 400: {'error': 'completion: Invalid model name passed in model=gpt-3.5-turbo/chat'}
```
2024-05-03 18:02:29 -07:00
Marc Abramowitz 4ce4927c0c Add test_engines_model_chat_completions 2024-05-03 17:56:39 -07:00
Krish DholakiaandGitHub e6e742d464 Merge pull request #3436 from BerriAI/litellm_anthropic_stop_sequence_fix
fix(anthropic.py): drop unsupported non-whitespace character value wh…
2024-05-03 17:53:29 -07:00
Krrish Dholakia 097714e02f fix(anthropic.py): handle whitespace characters for anthropic calls 2024-05-03 17:31:34 -07:00
Krrish Dholakia 0450abfdc1 fix(bedrock.py): fix boto3 config init 2024-05-03 17:22:06 -07:00
Ishaan JaffandGitHub debd8137f3 Merge pull request #3435 from BerriAI/litellm_ui_filter_exceptions_by_model_group
Admin UI - filter exceptions by model group
2024-05-03 17:18:44 -07:00
Krrish Dholakia 0b9fa53e3e fix(anthropic.py): drop unsupported non-whitespace character value when calling anthropic with stop sequences
Fixes https://github.com/BerriAI/litellm/issues/3286
2024-05-03 16:59:49 -07:00
Ishaan Jaff e7034ea53d feat - filter exceptions by model group 2024-05-03 16:54:24 -07:00
Ishaan Jaff d3152e606f fix - ui filter exceptions by modelGroup 2024-05-03 16:53:24 -07:00
Krrish Dholakia f7eee60943 docs(exception_mapping.md): update exception mapping docs with 'should_retry' 2024-05-03 16:51:26 -07:00
Ishaan Jaff 2084cfd959 fix - test_check_num_callbacks 2024-05-03 16:41:08 -07:00
Ishaan JaffandGitHub 5e6b6c41c4 Merge pull request #3432 from BerriAI/litellm_add_bedrock_titan_embed
Feat - add bedrock titan embed-v2
2024-05-03 16:28:12 -07:00
Ishaan JaffandGitHub 926670bfb7 Merge pull request #3429 from BerriAI/litellm_add_unit_tests_slack_alerts
[Test] Add Slack Alerting unit tests
2024-05-03 16:27:40 -07:00