Commit Graph
3300 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub b7803bcbb0 Merge pull request #14778 from otaviofbrito/chore/fix-vllm-pasthrough
fix vllm passthrough
2025-09-22 22:40:15 -07:00
Krish DholakiaandGitHub 88f9cad886 Merge pull request #14796 from BerriAI/litellm_anthopic_token_count_issue
Add service_tier based pricing support for openai[ BOTH Service & Priority Support]
2025-09-22 22:38:59 -07:00
Krish DholakiaandGitHub 66f7e4a832 Merge pull request #14790 from eycjur/support_flux_image_edit
[Feat] Support flux image edit
2025-09-22 22:38:45 -07:00
Sameerlite d2208023d2 Add service_tier based pricing support for openai 2025-09-23 10:48:27 +05:30
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
b9ffa98c55 [Feat] Proxy CLI: Create a python method to login using litellm proxy (#14782)
* fix: cli auth with SSO okta

* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME

* fix: get_litellm_cli_user_api_key_auth

* use existing_key CLI

* fix: use existing key

* test auth commands

* test_cli_sso_callback_regenerate_vs_create_flow

* feat: add CLI Token Utilities

* fix: get_stored_api_key

* move file

* fix: get_valid_models

* fix config.yaml

* TestCLITokenUtils

* TestGetValidModelsWithCLI

* fix: tie user id to keys created through CLI

* fix: add teams interface to CLI

* add /keys/update to the list client commands

* fix /sso/cli/poll to return the user_id

* fix: working TeamsManagementClient

* fix CLI Login command

* fixes for auth

* Potential fix for code scanning alert no. 3400: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* ruff fix

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-22 21:28:38 -07:00
Uzair AliandGitHub 3e9540f589 feat: enable custom fields in mcp_info configuration (#14794)
Allow proxy admins to add arbitrary metadata fields to MCP servers
in config.yaml under mcp_servers.<server>.mcp_info, similar to how
model_info already works.

Changes:
- Changed MCPInfo from TypedDict to Dict[str, Any] for flexibility
- Updated load_servers_from_config to preserve all custom fields
- Updated add_update_server to handle arbitrary fields from database
- Added comprehensive unit tests covering all scenarios
2025-09-22 21:15:35 -07:00
eycjur 00b36554b3 add unit test 2025-09-23 01:57:50 +00:00
Krish DholakiaandGitHub 0a1c1a27a7 Merge pull request #14787 from BerriAI/litellm_dev_09_22_2025_p1
docs(provider_specific_params.md): fix docs
2025-09-22 17:45:57 -07:00
Krrish Dholakia 70cd9d3d4e test: fix unit test to work on github action 2025-09-22 17:38:11 -07:00
Anubhav SinghandGitHub fde4dcb0b8 Merge branch 'main' into wandb-inference 2025-09-23 00:14:11 +05:30
Ishaan JaffandGitHub fa20abfe48 [Feat] Proxy CLI Auth - Allow re-using cli auth token (#14780)
* fix: cli auth with SSO okta

* fix: add LITTELM_CLI_SERVICE_ACCOUNT_NAME

* fix: get_litellm_cli_user_api_key_auth

* use existing_key CLI

* fix: use existing key

* test auth commands

* test_cli_sso_callback_regenerate_vs_create_flow
2025-09-22 10:07:16 -07:00
Otavio Brito ffd9117357 fix failing test 2025-09-22 11:06:11 -03:00
Otavio Brito 33a11c4b07 fix vllm passthrough 2025-09-22 10:09:02 -03:00
Krish DholakiaandGitHub 9096d9cb25 Merge branch 'main' into feat/issue-14562-bedrock-converse-request-metadata 2025-09-21 21:26:37 -07:00
Krish DholakiaandGitHub d4540d31c1 Merge branch 'main' into fix/streaming-tool-call-indices 2025-09-21 21:24:22 -07:00
Krish DholakiaandGitHub 197e98b6fb Merge pull request #14758 from TeddyAmkie/model-armor-restore
Resolve Model Armor gaps (Pdfs, basic
2025-09-21 21:18:53 -07:00
uzaxirr d8d5581f29 Resolve merge conflicts with main branch
- Accept main branch's consolidation of Cohere providers
- Preserve header implementation with proper three-tier merging
- Replace outdated header handling in Cohere sections with consolidated approach
- Maintain backward compatibility and functionality
2025-09-22 05:59:28 +05:30
uzaxirr 50d717cde0 Apply Black formatting and fix Ruff issues
- Format code with Black to meet style requirements
- Fix auto-fixable Ruff linting issues
- Maintain header implementation functionality
2025-09-22 04:46:08 +05:30
uzaxirr 3986b073c9 feat: Add SDK support for additional headers 2025-09-21 14:58:14 +05:30
Teddy Amkie 9d1878029d Added model armor testing files basic 2025-09-20 22:40:46 -07:00
Ishaan Jaffer 8b3e3c1882 tes fix 2025-09-20 17:00:30 -07:00
Ishaan Jaffer c656982f18 test fix 2025-09-20 16:55:23 -07:00
Ishaan Jaffer d0dcf8c81c test_rerank_custom_callbacks 2025-09-20 16:27:58 -07:00
Ishaan Jaffer 979ca9287b test prometheus fix 2025-09-20 16:03:34 -07:00
Ishaan Jaffer f1a18b69a4 test_aincrement_top_level_request_and_spend_metrics 2025-09-20 15:33:08 -07:00
Ishaan Jaffer 8ec73db36b test fix 2025-09-20 15:32:59 -07:00
Ishaan Jaffer 6c966400dd fix test 2025-09-20 15:03:35 -07:00
Ishaan Jaffer d4a2a4a608 test fix 2025-09-20 14:10:40 -07:00
Ishaan Jaffer 18d5177aec test fix 2025-09-20 14:09:24 -07:00
Ishaan Jaffer 59d2f0f465 test_string_cost_values 2025-09-20 13:34:57 -07:00
Ishaan Jaffer 4b876ea9ca test_sanitize_request_body_for_spend_logs_payload_mixed_types 2025-09-20 12:33:37 -07:00
Ishaan Jaffer aa992fb86f test e2e bedrock embedding 2025-09-20 11:35:31 -07:00
Ishaan Jaffer 39cf690d50 test_e2e_bedrock_embedding_image_twelvelabs_marengodocs fix 2025-09-20 09:34:08 -07:00
Ishaan Jaffer 7236202e41 test fix 2025-09-20 09:28:15 -07:00
Krish DholakiaandGitHub 1f9afcb349 Merge pull request #14438 from hakasecurity/change-aim-headers
rename aim headers + tests
2025-09-19 23:32:50 -07:00
Krish DholakiaandGitHub 981e8470ef Merge pull request #14578 from timelfrink/fix/issue-14373-bedrock-inference-profiles
Fix: Bedrock inference profiles for Nova Canvas image generation
2025-09-19 23:31:23 -07:00
Krish DholakiaandGitHub 0f0f4327a3 Merge pull request #14589 from timelfrink/fix/issue-14586-gemini-exception-messages
Fix: Updated error message for Gemini API
2025-09-19 23:29:21 -07:00
Krish DholakiaandGitHub 270d612029 Merge branch 'main' into litellm_dev_09_10_2025_p1 2025-09-19 22:01:57 -07:00
Ishaan Jaffer a6795a6560 test fix 2025-09-19 18:05:36 -07:00
Ishaan Jaffer eabc9cd415 test test_e2e_bedrock_embedding 2025-09-19 18:03:20 -07:00
Ishaan Jaffer ed5c9f1c69 test fixes for mapped tests 2025-09-19 18:01:36 -07:00
Krish DholakiaandGitHub 6142c3ac3d Merge pull request #14738 from BerriAI/litellm_dev_09_19_2025_p1
UI SSO - consider token info endpoint on generic SSO route for access control groups
2025-09-19 17:58:37 -07:00
Ishaan Jaffer dec15a80a2 test: mcp test fix 2025-09-19 17:52:32 -07:00
Ishaan Jaffer 15898c89e1 test: test_azure_openai_gpt_5_responses_api 2025-09-19 17:45:34 -07:00
Ishaan Jaffer c3f150b13d mcp test fix 2025-09-19 17:41:15 -07:00
Ishaan Jaffer 0ba4c7753a test fix 2025-09-19 17:33:37 -07:00
Krrish Dholakia 7694e9f6a9 test: refactoring + testing 2025-09-19 17:20:15 -07:00
Ishaan Jaffer d739d226ed fix: test 2025-09-19 16:28:09 -07:00
Ishaan JaffGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
90ee9e4587 [Feat] Dynamic Rate Limiter v3 - fixes to ensure priority routing works as expected (#14734)
* fix: dynamic limiter v3

* fix: dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3

* feat: add dynamic limiter v3 in init litellm_logging

* feat: add dynamic limiter v3 in init litellm_logging

* fix: priority rate limiting

* Potential fix for code scanning alert no. 3397: Clear-text logging of sensitive information

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* fix: priority rate limiting

* fix: ruff

* fix: mypy lint

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2025-09-19 16:04:45 -07:00
Felipe GaréandGitHub a696ffe4a6 Litellm gemini batch (#14733)
* feat: add Vertex AI support for file content retrieval

- Extended `custom_llm_provider` to include "vertex_ai" in `afile_content` function.
- Implemented file content retrieval logic for Vertex AI in `VertexAIFilesHandler`.
- Added helper method to extract bucket and object from URL-encoded file_id.
- Created comprehensive unit and integration tests for Vertex AI file handling.
- Updated transformation logic to ensure compatibility with Vertex AI file responses.

* fix: update Vertex AI file transformation logic

- Modified the transformation logic in `VertexAIFilesConfig` to return a newline-separated JSON string for batch JSONL files instead of a array if JSON strings.

* fix: enhance Vertex AI output handling in transformation logic

- Updated the transformation logic in `VertexAIBatchTransformation` to utilize the new `OutputInfo` TypedDict for retrieving the GCS output directory.
- Added `OutputInfo` class to type definitions for better structure and clarity in Vertex AI responses.
2025-09-19 15:22:52 -07:00