Ishaan Jaffer
39b0e76a33
test_completion_cohere_command_r_plus_function_call
2025-10-16 20:33:41 -07:00
Ishaan Jaffer
13e895b9b0
test fix
2025-10-16 18:00:46 -07:00
Ishaan Jaffer
ea69f4547d
Merge branch 'main' into litellm_oct_staging2
2025-10-16 17:06:29 -07:00
Ishaan Jaff and GitHub
f69f7d101b
Merge pull request #15618 from BerriAI/litellm_bedrock_invoke_support
...
[Feat] Allow calling /invoke, /converse routes through AI Gateway + models on config.yaml
2025-10-16 16:56:23 -07:00
Ishaan Jaff and GitHub
f27f2d4803
Merge branch 'main' into litellm_sso_add_pkce
2025-10-16 15:48:01 -07:00
Ishaan Jaffer
bcf53c6ceb
working - errors from bedrock through pass throughs
2025-10-16 15:40:42 -07:00
Krrish Dholakia
e43c3b9b88
test: add unit testing
2025-10-16 15:37:26 -07:00
Ishaan Jaffer
51f1907e98
test_bedrock_error_handling_returns_actual_error
2025-10-16 15:36:51 -07:00
Ishaan Jaffer
cc5eac4965
fix _add_deployment_model_to_endpoint_for_llm_passthrough_route
2025-10-16 15:10:54 -07:00
Ishaan Jaff and GitHub
f98f299854
Merge pull request #15617 from BerriAI/litellm_october_alexsander_stanging
...
[OCT] Alexsander PERF improvements
2025-10-16 15:10:02 -07:00
AlexsanderHamir
bdca4db941
Merge branch 'litellm_october_alexsander_stanging' of https://github.com/BerriAI/litellm into litellm_october_alexsander_stanging
2025-10-16 14:43:30 -07:00
AlexsanderHamir
e154ab6a66
test: ensure model_names is a O(1) datastructure
2025-10-16 14:42:24 -07:00
AlexsanderHamir
76b272dffa
test(router): update error message assertion after string concat optimization
...
Update test_generate_model_id_with_deployment_model_name to accept the new
error message format that results from the list+join optimization.
The function still correctly rejects None values with a TypeError, but the
error message changed from 'unsupported operand type(s) for +=' to
'expected str instance, NoneType found' due to the implementation change
from string concatenation to list joining.
2025-10-16 14:41:59 -07:00
AlexsanderHamir
35de05dc8b
test: add static analysis to prevent O(n) linear scans in router
...
Add AST-based test to detect 'for ... in self.model_list' anti-pattern.
Enforces use of index maps (model_id_to_deployment_index_map and
model_name_to_deployment_indices) for O(1) lookups instead of O(n) iteration.
2025-10-16 14:41:58 -07:00
Ishaan Jaffer
da72a812c9
test_bedrock_passthrough_router
2025-10-16 14:23:34 -07:00
Ishaan Jaff and GitHub
6f69b009c8
[Fix] Dall-e-2 for Image Edits API ( #15604 )
...
* feat: add DallE2ImageEditConfig
* fix: get_openai_image_edit_config
* fix get_provider_image_edit_config
* fix _add_image_to_files
* fix DallE2ImageEditConfig
* fix TestOpenAIImageEditDallE2
2025-10-16 13:24:24 -07:00
Ishaan Jaffer
086904f3db
TestPKCEFunctionality
2025-10-16 13:18:31 -07:00
Krish Dholakia and GitHub
3bf32e8e5c
feature: update pillar security integration to support no persistence mode in litellm proxy
...
feature: update pillar security integration to support no persistence mode in litellm proxy
2025-10-16 12:13:37 -07:00
Ariel Fogel
59c3aa02c3
respond to review comments
2025-10-16 20:38:49 +03:00
Alexsander Hamir and GitHub
1846363b94
Merge branch 'litellm_october_alexsander_stanging' into litellm_router_index_change
2025-10-16 09:07:15 -07:00
AlexsanderHamir
5e929dad2d
test: add static analysis to prevent O(n) linear scans in router
...
Add AST-based test to detect 'for ... in self.model_list' anti-pattern.
Enforces use of index maps (model_id_to_deployment_index_map and
model_name_to_deployment_indices) for O(1) lookups instead of O(n) iteration.
2025-10-16 09:04:57 -07:00
Ariel Fogel
b075cf4a6c
PLR-2400: support no persistence in litellm proxy
2025-10-16 17:22:58 +03:00
berri-teddy
1b55803c76
test: reduce EntraID app roles tests to essential scenarios
...
- Keep only 2 focused tests: single role extraction and no roles claim
- Remove complex fixtures and edge case tests
- Maintain clean, maintainable test coverage
2025-10-15 18:15:04 -07:00
berri-teddy
6b166e046d
fix: correct EntraID app roles JWT claim extraction
...
- Fix get_app_roles_from_id_token to use 'app_roles' claim instead of 'roles'
- Add comprehensive unit tests for EntraID app roles functionality
- Prevent regressions in Microsoft EntraID SSO authentication
Resolves issue where EntraID app roles were not being extracted correctly
from JWT tokens, causing authentication failures for users with assigned
app roles in Microsoft EntraID.
2025-10-15 18:06:03 -07:00
Alexsander Hamir and GitHub
a17f3a7aa8
Merge pull request #15578 from BerriAI/litellm_remove_list_lookup
...
perf(router): optimize model lookups with O(1) data structures
2025-10-15 17:59:55 -07:00
AlexsanderHamir
56838e2388
test: ensure model_names is a O(1) datastructure
2025-10-15 17:52:44 -07:00
Ishaan Jaffer
fd83b292a6
test_bedrock_anthropic_prompt_caching
2025-10-15 17:46:44 -07:00
Alexsander Hamir and GitHub
4e84937efc
Merge pull request #15575 from BerriAI/litellm_remove_constly_string_operation
...
perf(router): optimize string concatenation in hash generation
2025-10-15 17:26:32 -07:00
bc26845ec4
[Feat] Native /ocr endpoint support ( #15573 )
...
* [Feat] Add native litellm.ocr() functions (#15567 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* Potential fix for code scanning alert no. 3521: Clear-text logging of sensitive information
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
* [Feat] Add /ocr route on LiteLLM AI Gateway - Adds support for native mistral ocr calling (#15571 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* [Feat] Add Azure AI Mistral OCR Integration (#15572 )
* fix get_supported_ocr_params
* add get_provider_ocr_config
* init OCR
* init ocr functions
* add OCRResponse Base Model
* add ocr to llm http handlers
* add main.py for OCR
* fix linting for OCR
* TestMistralOCR
* update to use DocumentType for Mistral
* fix _prepare_ocr_request
* fix transform
* add main.py for OCR
* add spec to init
* fix OCR
* TestMistralOCR
* ruff fix
* add router.ocr() methods
* add OCR routes
* feat add ocr routes
* add OCR routes
* feat: add OCR routes in proxy server
* working /ocr routes
* test_router_aocr_with_mistral
* docs Mistral OCR
* docs OCR
* add azure ai to get_provider_ocr_config
* add AzureAIOCRConfig
* TestAzureAIOCR
* TestAzureAIOCR
* test fixes for azure ai ocr
* fix async OCR transform for Azure
* fix transform_ocr_request
---------
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-10-15 17:20:01 -07:00
AlexsanderHamir
97ed3d01ec
test(router): update error message assertion after string concat optimization
...
Update test_generate_model_id_with_deployment_model_name to accept the new
error message format that results from the list+join optimization.
The function still correctly rejects None values with a TypeError, but the
error message changed from 'unsupported operand type(s) for +=' to
'expected str instance, NoneType found' due to the implementation change
from string concatenation to list joining.
2025-10-15 15:58:08 -07:00
Ishaan Jaff and GitHub
5b7e2fd778
[Feat] UI - Allow setting Provider Discounts on UI ( #15550 )
...
* fix cost_discount_config
* add CostBreakdown
* fix: set_cost_breakdown
* test_cost_discount_vertex_ai
* docs fix
* docs fix discounts
* docs fix
* docs custom pricing
* docs fix
* fixes for getting cost breakdown in response headers
* test - response headers wth discount
* - feat: allow setting cost tracking settings
* add cost tracking endpoints
* feat add cost_tracking_settings_router
* add validation when setting cost settings
* add CostTrackingSettings
* add page
* refactor
* use simple table
* add ProviderDiscountTable
* fix ui
* save
* fix: discount settings
* fix edits
* add settings
* add HelpLink
* add help link
* docs HelpLink
* docs fix
* fix how it works
* fix layout
* test TestCostTrackingSettings
* fix Dict
2025-10-14 20:08:18 -07:00
Ishaan Jaff and GitHub
a6c57cb5bd
[Feat] Cost Tracking - specify a global vendor discount for costs. ( #15546 )
...
* fix cost_discount_config
* add CostBreakdown
* fix: set_cost_breakdown
* test_cost_discount_vertex_ai
* docs fix
* docs fix discounts
* docs fix
* docs custom pricing
* docs fix
* fixes for getting cost breakdown in response headers
* test - response headers wth discount
2025-10-14 20:07:04 -07:00
AlexsanderHamir
d094a334d9
add: unit test
2025-10-14 16:38:04 -07:00
Ishaan Jaff and AlexsanderHamir
65163c7ccb
[Fix] GEMINI - CLI - add google_routes to llm_api_routes ( #15500 )
...
* fix: add google_routes to llm_api_routes
* test: test_virtual_key_llm_api_routes_allows_google_routes
2025-10-14 13:57:39 -07:00
Dhruv Yadav and AlexsanderHamir
b57406e53e
add tests for openrouter cost tracking
2025-10-14 13:57:39 -07:00
Ishaan Jaff and GitHub
f13eb283e1
[Fix] GEMINI - CLI - add google_routes to llm_api_routes ( #15500 )
...
* fix: add google_routes to llm_api_routes
* test: test_virtual_key_llm_api_routes_allows_google_routes
2025-10-13 10:58:47 -07:00
Krish Dholakia and GitHub
2ea7005c40
Merge pull request #15448 from dhruvyad/main
...
Get completion cost directly from OpenRouter
2025-10-12 22:12:52 -07:00
Krrish Dholakia
1949436047
test: update test
2025-10-12 21:58:06 -07:00
Krish Dholakia and GitHub
04dc9d091c
Merge branch 'main' into litellm_staging_branch_10_11_2025_p1
2025-10-12 21:55:44 -07:00
Dhruv Yadav
84a65440c5
add tests for openrouter cost tracking
2025-10-12 12:36:24 +05:30
f5359ba007
Fix apply_guardrail endpoint returning raw string instead of ApplyGuardrailResponse ( #15436 )
...
* Initial plan
* Fix apply_guardrail endpoint to return ApplyGuardrailResponse
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-10-11 17:50:37 -07:00
Krrish Dholakia
6bd722bba4
fix: always retain config models
2025-10-11 16:09:33 -07:00
Krrish Dholakia
090a2c0cfe
fix: remove unused uuid import
2025-10-11 15:38:28 -07:00
Krish Dholakia and GitHub
323389c244
(feat) Passthrough - allow admin to give access to specific passthrough endpoints
...
(feat) Passthrough - allow admin to give access to specific passthrough endpoints
2025-10-11 13:51:10 -07:00
Krish Dholakia and GitHub
5507d50acf
Merge branch 'main' into litellm_dev_10_09_2025_p1
2025-10-11 13:06:34 -07:00
Krish Dholakia and GitHub
ff930dc6df
Merge branch 'main' into litellm_dev_10_10_2025_p2
2025-10-11 13:03:16 -07:00
Krish Dholakia and GitHub
07ba5c1ea9
Merge branch 'main' into litellm_dev_10_10_2025_p3
2025-10-11 12:58:53 -07:00
Ishaan Jaffer
97626f2d02
fix test
2025-10-11 11:30:19 -07:00
Ishaan Jaffer
ce6102d54f
test_azure_responses_api_status_error
2025-10-11 10:41:15 -07:00
Ishaan Jaffer
86881a8fc1
test_azure_responses_api_status_error
2025-10-11 10:21:07 -07:00
Ishaan Jaffer