ef66bb87b3
Merge branch 'main' into litellm_dev_08_16_2025_p2
2025-08-23 11:30:51 -07:00
385bb15219
test: skip test
2025-08-23 11:27:46 -07:00
06a2915e9f
Merge pull request #13671 from BerriAI/litellm_dev_08_15_2025_p1
...
Responses API - support `allowed_openai_params` + Mistral - handle empty assistant content + support new mistral 'thinking' response block
2025-08-23 11:15:23 -07:00
4d7433b5ad
test: reduce mistral direct tests b/c of rate limit errors
2025-08-23 11:15:03 -07:00
cbb161f10b
test: handle internal server errors
2025-08-23 11:00:18 -07:00
f0b0ee51e0
Merge branch 'main' into litellm_dev_08_15_2025_p1
2025-08-23 10:51:56 -07:00
ba9f6894b7
test: update tests
2025-08-23 10:42:41 -07:00
3e764ec268
Merge pull request #13808 from mainred/validate_api_version
...
feat(utils.py): accept 'api_version' as param for validate_environment
2025-08-22 23:59:38 -07:00
867b48a24f
Merge pull request #13866 from jinskjoy/Mistral-File-ID
...
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-22 23:54:17 -07:00
825d6b08f0
test fix location of encode bedrock runtime modelid arn
2025-08-22 17:34:09 -07:00
56c16fc6f6
[Performance] Reduce Significant CPU overhead from litellm_logging.py ( #13895 )
...
* fix: litellm.configured_cold_storage_logger
* fix Session Management - Non-OpenAI Models docs
* ruff fix
* test fix
2025-08-22 16:17:57 -07:00
3c1dcb64cc
fix by adding init lock ( #13666 )
2025-08-22 11:42:43 -07:00
dcad39c00f
Merge pull request #13753 from RichardoC/fix-bedrock-irsa-role-assumption
...
fix: role chaining and session name with webauthentication for aws bedrock
2025-08-22 07:20:27 -07:00
59e43595b9
Merge pull request #13852 from michal-otmianowski/async-s3-implementation
...
Async s3 implementation
2025-08-21 23:19:51 -07:00
8b45e53878
Merge pull request #13880 from datarobot-forks/carsongee/improve_datarobot_api_handling
...
🐛 Bug Fix: Updated URL handling for DataRobot provider URL
2025-08-21 23:18:40 -07:00
9c4a86e98e
Merge pull request #13868 from kankute-sameer/litellm_feat_voyage_context_3_embedding_model
...
[Feat] Add support for voyage-context-3 embedding model
2025-08-21 23:18:20 -07:00
6214d22126
Merge pull request #13863 from luizrennocosta/fix/pll-req-lim-v3-api-key
...
fix: fixing descriptor/response size mismatch on parallel_request_limiter_v3
2025-08-21 23:14:04 -07:00
e93e266f84
[Performance] Use O(1) Set lookups for model routing ( #13879 )
...
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 620d14246980813366b4b1f1c0ce396b528dd9df.
* o(1) lookups
* Revert "o(1) lookups"
This reverts commit 676a9f5bcc3c2b9fa31e0a9fdf00389739b3052f.
* o(1) lookups
* register_model fix
* test_aget_valid_models
* lambda ai models fix
* test_utils.py
* test fix vertex ai
2025-08-21 22:56:46 -07:00
a61275f6e2
Merge pull request #13796 from 0x-fang/fix_aip_pass_through_08_20
...
Fix(Bedrock): fix application inference profile for pass-through endpoints for bedrock
2025-08-21 19:41:23 -07:00
b46de0ab5c
Updated URL handling for DataRobot provider base
2025-08-21 19:42:46 -06:00
7c2c1c11d9
Merge pull request #13783 from philipkiely-baseten/main
...
Update Baseten LiteLLM integration
2025-08-21 18:34:36 -07:00
77a5de37b1
[Fix] Ensure Service Account Keys require team_id field on API Endpoints ( #13873 )
...
* fixes for generating service accounts through the API
* fixes for test_update_service_account_works_with_team_id
2025-08-21 14:55:06 -07:00
5ac4fb512c
Add support for voyage-context-3 embedding model
2025-08-22 00:15:12 +05:30
d8a33e137d
[Enhancement] Add support for Mistral model file handling and update documentation
2025-08-21 20:35:07 +02:00
5fa4a18073
add testing and remove redundant function
2025-08-21 11:25:26 -07:00
f8711200d0
fix: fixing descriptor/response size difference when indexing descriptor
2025-08-21 13:43:23 -03:00
a6f052882b
fix test
2025-08-21 12:10:29 +02:00
feae09da5d
minor adjustments
2025-08-21 11:33:11 +02:00
5dd7e00127
formatting adjustments
2025-08-21 11:27:12 +02:00
08c942c306
refactor tests
2025-08-21 10:38:43 +02:00
744dca1dc3
init asyc implementation
2025-08-21 10:22:54 +02:00
0e6e8af1c3
Merge pull request #13795 from TomeHirata/feat/predict/mlflow
...
Include predicted output in MLflow tracing
2025-08-20 22:40:33 -07:00
1f84451925
Merge pull request #13803 from UlookEE/fix_bedrock_epc_acompletion
...
fix : Synchronize cache behavior between acompletion and completion
2025-08-20 22:38:30 -07:00
ff267ab68e
Merge pull request #13820 from kankute-sameer/litellm_rerank_deepinfra_endpoint
...
Add rerank endpoint support for deepinfra
2025-08-20 22:33:25 -07:00
609679ded4
Merge pull request #13835 from 0x-fang/fix_api_key_guardrail_proxy
...
Fix(bedrock): fix the api key support for bedrock guardrail in proxy
2025-08-20 22:31:17 -07:00
07f6235730
[Performance] Improve LiteLLM Python SDK RPS by +200 RPS ( #13839 )
...
* fix _proxy_from_env +100 RPS
* fix: global_braintrust_http_handler
* test_braintrust_logging
2025-08-20 21:46:33 -07:00
91040b6b56
fix the api key support for bedrock guardrail in proxy
2025-08-20 18:46:00 -07:00
55dcaded72
[Feat] Add VertexAI qwen API Service ( #13828 )
...
* add support for vertex AI QWEN API
* streaming QWEN API support
* test_partner_models_httpx
* test_partner_models_httpx_streaming
* add cost tracking for vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maa
* docs qwen models vertexAI
2025-08-20 15:00:33 -07:00
5b5a2d12a8
remove test
2025-08-21 00:32:16 +05:30
1d1d637ac0
fix automated checks
2025-08-21 00:09:17 +05:30
37b84d1582
Add rerank endpoint support for deepinfra
2025-08-20 23:36:05 +05:30
12bae8fdda
test_partner_models_httpx_streaming
2025-08-20 09:44:47 -07:00
e69a895884
test_apply_default_settings
2025-08-20 08:53:38 -07:00
f2a6be390b
feat(utils.py): accept 'api_version' as param for validate_environment
2025-08-20 14:29:58 +00:00
036b358636
Synchronize cache behavior between acompletion and completion
2025-08-20 18:27:36 +09:00
caad9b3ca7
fix application inference profile for pass-through endpoints for bedrock
2025-08-20 00:40:43 -07:00
5879f6e930
comment
2025-08-20 15:46:53 +09:00
d64b579131
Include predicted output in tracing
...
Signed-off-by: Tomu Hirata <tomu.hirata@gmail.com >
2025-08-20 15:39:32 +09:00
04feaf33c0
Merge pull request #13748 from hakasecurity/migrate-to-aim-new-firewall-api
...
Migrate to aim new firewall api
2025-08-19 22:32:22 -07:00
be30bc68ae
Merge pull request #13759 from kankute-sameer/litellm_feat_correct_cost_calculations
...
Add long context support for claude-4-sonnet
2025-08-19 22:30:25 -07:00
Krish Dholakia