tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-20 18:24:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,881 Commits 2,072 Branches 1,425 Tags
12bc66aa5ba767f2af4daf4ae99d41af77ba5ede
Commit Graph
30881 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
orgersh92andGitHub d8d10f5e25 lasso-guardrail-api docs (#18652) 2026-01-05 20:58:26 +05:30
Ishaan Jaffer f752ec3eaf fix 2026-01-05 20:25:39 +05:30
Ishaan JaffandGitHub 2b3b16c86c [Feat] Litellm UI allow selecting many models for cost estimator (#18653) 
* LiteLLM Cost Estimate

* fix - multi model selector

* v2 of report

* fixes

* export fix
 2026-01-05 20:19:59 +05:30
Ishaan JaffandGitHub bf1c5bef59 [UI] Add view for estimating costs across requests (#18645) 
* add estimate_cost endpoint

* TestCostEstimateEndpoint

* fix estimate_cost

* add /cost/estimate to spend tracking routes

* fix code QA checks

* fixes endpoint

* v0 cost estimator

* v0 cost estimator

* formatNumberWithCommas

* fix admin view

* docs

* docs fix + export PDF/CSV

* fixes for export
 2026-01-05 19:19:58 +05:30
Sameer KankuteandGitHub d0a26dd4bc Merge pull request #18644 from BerriAI/litellm_fix_mapped_tests_05012026 
Fix mapped tests 05012026
 2026-01-05 17:53:17 +05:30
Sameer Kankute d3107ac61a revert litellm/litellm/llms/gemini/interactions/transformation.py 2026-01-05 17:37:01 +05:30
Sameer KankuteandGitHub 3c60b930e2 Merge pull request #18635 from BerriAI/litellm_completions_api_summary_param 
(feat) Add mapping for reasoning effort to summary param of responses API
 2026-01-05 17:36:21 +05:30
Sameer KankuteandGitHub 30096ffe5c Merge pull request #18637 from BerriAI/litellm_gemini_api_base_auth_fix 
fix: auth header for custom api base in generate Content request
 2026-01-05 17:35:47 +05:30
Sameer KankuteandGitHub 23fa88f64e Merge pull request #18638 from BerriAI/litellm_fix_custom_llm_providers_ui_testing 
fix: Add custom llm provider to get_llm_provider when sent via UI
 2026-01-05 17:34:50 +05:30
Sameer Kankute 2d7f0a1351 fix: test_create_simple_string_input 2026-01-05 17:15:12 +05:30
Sameer Kankute c0f74c994a Fix: test_transform_request_image_extraction 2026-01-05 17:02:54 +05:30
Sameer Kankute 935824e4f9 Fix : test_sap_chat[False] 2026-01-05 16:56:22 +05:30
Costa TsaousisandGitHub 196509cbb1 feat(mcp): parallelize tool fetching from multiple MCP servers (#18627) 
* feat(mcp): parallelize tool fetching from multiple MCP servers

Replace sequential tool fetching with asyncio.gather() to reduce
client timeouts when using multiple MCP servers.

Changes:
- mcp_server_manager.py: list_tools() now fetches tools in parallel
- server.py: _get_tools_from_mcp_servers() now fetches tools in parallel

Real-world impact (7 MCP servers example):
- Sequential: ~4.5+ seconds (exceeds typical 5-second client timeouts)
- Parallel: ~1.2 seconds (max of all servers)

Fixes #18626

* fix: copy oauth2_headers to avoid shared dict mutation in parallel tasks
 2026-01-05 16:54:24 +05:30
Ishaan JaffandGitHub 7f4dba2a01 [Feat] Add Cost Estimator for AI Gateway (#18643) 
* add estimate_cost endpoint

* TestCostEstimateEndpoint

* fix estimate_cost

* add /cost/estimate to spend tracking routes

* fix code QA checks

* fixes endpoint
 2026-01-05 16:51:23 +05:30
Sameer Kankute 840617de73 fix: tests.test_litellm.interactions.test_gemini_interactions.TestGeminiInteractions 2026-01-05 16:41:24 +05:30
Matt GreathouseandGitHub b24156079f Add gemini-3-flash on openrouter (#18247) 2026-01-05 16:37:23 +05:30
Sameer Kankute d590c820c2 Fix: TypeError: Object of type function is not JSON serializable 2026-01-05 16:32:21 +05:30
Sameer KankuteGitHubCopilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 		28c7659d3d Potential fix for code scanning alert no. 3954: Clear-text logging of sensitive information 
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
 2026-01-05 16:06:10 +05:30
YutaSaitoandGitHub 165d5f3af1 Merge pull request #18640 from BerriAI/litellm_fix_cloudzero_integration_test 
tests: mock LiteLLM_UserTable for CloudZero export
 2026-01-05 17:41:22 +09:00
YutaSaitoandGitHub d5e4a43be3 Merge pull request #18639 from BerriAI/litellm_feat_mcp_global_mode 
[feat] mcp global mode
 2026-01-05 17:34:06 +09:00
Yuta Saito bdc35b4cd2 tests: mock LiteLLM_UserTable for CloudZero export 2026-01-05 17:23:04 +09:00
Yuta Saito ef2f76e5a5 fix: npm build error 2026-01-05 17:06:02 +09:00
Yuta Saito 7213f4a690 chore: lint 2026-01-05 16:57:39 +09:00
Yuta Saito fee9553c51 feat: add allow_all_keys doc 2026-01-05 16:56:19 +09:00
Yuta Saito 38a20b8036 feat: feat: allow_all_keys to mcp server on the UI 2026-01-05 16:28:51 +09:00
Sameer Kankute 6337ea876b fix: Add custom llm provider to get_llm_provider when sent via UI 2026-01-05 12:57:30 +05:30
Sameer Kankute 0730a74dda fix: auth header for custom api base in generate Content request 2026-01-05 12:25:13 +05:30
Yuta Saito f1d77ae14d feat: allow_all_keys to mcp server 2026-01-05 15:49:09 +09:00
Sameer Kankute 02a41a5c13 fix the comment 2026-01-05 11:40:40 +05:30
Sameer Kankute 0f8e4364d6 Replace summary param as detailed 2026-01-05 11:24:35 +05:30
Sameer Kankute 42d4aab3e7 Add mapping for reasoning effort to summary of responses API 2026-01-05 11:21:34 +05:30
YutaSaitoandGitHub b6664669d2 Merge pull request #18480 from hamzaq453/fix/openapi-parameter-names-security 
Fix: Remove exec() usage and handle invalid OpenAPI parameter names
 2026-01-05 14:34:57 +09:00
YutaSaitoandGitHub c405135c2b Merge pull request #18584 from BerriAI/feat/add_user_email_to_cloudzero 
feat: add user email to cloudzero
 2026-01-05 14:22:46 +09:00
hamzaq453 9ca7b1ad9b Resolve merge conflicts: integrate path validation with **kwargs approach 
- Keep **kwargs approach (no exec()) for security
- Integrate path traversal validation from main branch
- Add URL encoding for path parameters
- Merge both test suites (edge cases + security tests)
- All 14 tests passing
 2026-01-05 10:20:26 +05:00
YutaSaitoandGitHub ff6fd0c7f4 Merge pull request #18634 from BerriAI/litellm_refactor_bedrock_guardrail 
refactor: remove redundant Bedrock guardrail block handling
 2026-01-05 14:12:21 +09:00
Yuta Saito b37076bf2a refactor: remove redundant Bedrock guardrail block handling 2026-01-05 13:55:38 +09:00
YutaSaitoandGitHub fcabc059ca Merge pull request #18630 from BerriAI/litellm_fix_mcp_guardrail 
fix: MCP handling in unified guardrail
 2026-01-05 12:25:14 +09:00
amangupta-20andGitHub 399579f8ea feat: Add Levo AI integration (#18529) 2026-01-05 08:49:21 +05:30
Yuta Saito 0509fc79da fix: move code from litellm/llms to the mcp_server dir 2026-01-05 12:05:16 +09:00
Yuta Saito c8c73e6fa5 fix: MCP handling in unified guardrail 2026-01-05 10:41:24 +09:00
Akiva Kraines fa08f157d8 fix: Improve error messages and validation for wildcard routing with multiple credentials 
- Enhanced error messages to show which deployment/credential was used when routing fails
- Added debug logging for pattern-matched deployments to track which deployment was selected
- Added validation warning at startup when multiple wildcard patterns exist for same provider with different credentials
- Helps diagnose intermittent authentication failures caused by non-deterministic wildcard routing

Addresses issue where multiple wildcard deployments (e.g., openai/*) with different credentials
cause intermittent 403 errors due to random credential selection.
 2026-01-05 00:14:14 +02:00
yuneng-jiangandGitHub 359b8df8b2 Merge pull request #18619 from BerriAI/litellm_ui_keys_loading_2 
[Feature] UI - Virtual Keys Table Loading State Between Pages
 2026-01-03 19:30:32 -08:00
yuneng-jiang 1112974112 Virtual Keys Table Loading State 2026-01-03 19:22:38 -08:00
yuneng-jiangandGitHub 280085edaa Merge pull request #18618 from BerriAI/litellm_ui_unit_test_coverage 
[Infra] UI - Unit Tests: Adding Tests to Increase Coverage
 2026-01-03 17:55:53 -08:00
yuneng-jiang 816124a40b Fixign build 2026-01-03 17:39:59 -08:00
yuneng-jiang 1184db079e fixing tests 2026-01-03 17:30:52 -08:00
yuneng-jiang 60c39255d5 Adding unit testing coverage 2026-01-03 17:25:46 -08:00
yuneng-jiangandGitHub c07ff5d9ee Merge pull request #18617 from BerriAI/litellm_ui_sso_loading_state 
[Feature] UI - SSO Settings Loading State + Deprecate Previous SSO Flow
 2026-01-03 16:33:51 -08:00
yuneng-jiang d6296411ec SSO Settings Loading, deprecate previous flow 2026-01-03 16:23:10 -08:00
Alexsander HamirandGitHub b6d601c2f0 perf(utils): lazy load 15+ unused imports (#18616) 
- Move BaseBatchesConfig, BaseContainerConfig, BaseEmbeddingConfig, BaseImageEditConfig, BaseImageGenerationConfig, BaseImageVariationConfig, BasePassthroughConfig, BaseRealtimeConfig, BaseRerankConfig, BaseVectorStoreConfig, BaseVectorStoreFilesConfig, BaseVideoConfig to lazy loading
- Move ANTHROPIC_API_ONLY_HEADERS, AnthropicThinkingParam, RerankResponse to lazy loading
- Move ChatCompletionDeltaToolCallChunk, ChatCompletionToolCallChunk, ChatCompletionToolCallFunctionChunk, LiteLLM_Params to lazy loading
- Add type stubs to TYPE_CHECKING block for mypy support
- Add lazy loading handlers in __getattr__ method
- These imports are not used in utils.py runtime code, only in type annotations (safe with from __future__ import annotations)
 2026-01-03 16:16:17 -08:00