tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-22 08:24:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,308 Commits 2,072 Branches 1,425 Tags
201d96b2d2e1d94031e2c8b6a3db58deaa9cfc17
Commit Graph
24308 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish DholakiaandGitHub 201d96b2d2 Merge pull request #13917 from Toy-97/patch-1 
Deepinfra Metadata Update 24082025
 2025-08-26 23:13:46 -07:00
Krish DholakiaandGitHub 28f7df8da8 Merge pull request #13965 from manascb1344/feat/nebius-models-update 
feat(constants): expand Nebius provider models and normalize model IDs
 2025-08-26 23:13:06 -07:00
Krish DholakiaandGitHub 682fb697d0 Merge pull request #13969 from dttran-glo/patch-1 
bump `orjson` version to "3.11.2"
 2025-08-26 23:09:57 -07:00
Ishaan Jaff ee324943d7 bump: version 1.76.0 → 1.76.1 2025-08-26 20:02:57 -07:00
Ishaan Jaff c839b2c751 installing_litellm_on_python 2025-08-26 19:51:02 -07:00
Ishaan JaffandGitHub 80d4cc1283 [Perf] Use fastuuid for fast UUID generations - 2.1x Faster (#13992) 
* use fastuuid

* add fastuuid

* add fastuuid==0.12.0
 2025-08-26 19:47:25 -07:00
Ishaan JaffandGitHub ab7efaa832 test_pre_process_non_default_params (#13990) 2025-08-26 19:15:17 -07:00
Cole FrenchandGitHub 6696955506 [Bug]: Fix tests to reference moved attributes in braintrust_logging module (#13978) 
* Mock instance attribute moved from globals

* Support looking up mock message on mock choice
 2025-08-26 18:58:16 -07:00
codeflash-ai[bot]GitHubcodeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
 		5dba5822f2 ⚡️ Speed up function _is_debugging_on by 45% (#13988) 
The optimization eliminates unnecessary conditional branching by replacing the explicit `if-else` structure with a direct return of the boolean expression. Instead of evaluating the condition and then branching to return `True` or `False`, the optimized version directly returns the result of the boolean expression `verbose_logger.isEnabledFor(logging.DEBUG) or set_verbose is True`.

This change removes Python's conditional jump overhead and reduces the number of executed bytecode instructions per function call. The line profiler shows the original version required 3 lines of execution (condition check, conditional return True, fallback return False) while the optimized version executes only 1 line.

The 45% speedup is achieved by:
- **Eliminating branching overhead**: No conditional jumps needed
- **Reducing bytecode instructions**: From ~3 instructions to 1 instruction per call
- **Leveraging Python's short-circuit evaluation**: The `or` operator still evaluates left-to-right and stops early when the first condition is True

The optimization is particularly effective for this logging utility function which is likely called frequently throughout the application. All test cases show consistent 40-75% improvements across different scenarios (debug on/off, verbose flag variations, edge cases with different logging levels), demonstrating the optimization works well regardless of the boolean expression's outcome.

Co-authored-by: codeflash-ai[bot] <148906541+codeflash-ai[bot]@users.noreply.github.com>
 2025-08-26 17:25:45 -07:00
Ishaan JaffandGitHub 5647757ab3 [Feat] New model gemini-2.5-flash-image-preview (#13979) 
* add gemini-2.5-flash-image-preview

* add gemini-2.5-flash-image-preview
 2025-08-26 15:04:02 -07:00
Duc TranandGitHub e3d947abeb bump orjson version to "3.11.2" 2025-08-26 23:21:53 +07:00
manascb1344 1150b93e8f feat(constants): expand nebius_models set with DeepSeek, Llama, Qwen, NVIDIA, ZAI, and others; normalize model IDs (remove -fast variants, add new instruct/thinking variants) 2025-08-26 18:20:29 +05:30
Krish DholakiaandGitHub 55c3fd62ac Add Claude Opus 4 and 4.1 via OpenRouter and Fix Claude Sonnet 4 and 3.7 via OpenRouter in Prices and Context Window Config 
Update model prices and context window
 2025-08-25 23:28:39 -07:00
Krish DholakiaandGitHub 3803af5ff5 Merge pull request #13566 from kankute-sameer/fix/azure-gpt4-web-search-support 
fix: remove incorrect web search support for azure/gpt-4.1 family
 2025-08-25 23:28:15 -07:00
Krish DholakiaandGitHub ae678a6642 Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata 
Feature/braintrust span name metadata
 2025-08-25 23:19:56 -07:00
Krish DholakiaandGitHub 3ed1220f75 Merge pull request #13916 from mubashir1osmani/openai-multiple-images 
feat: multiple images in openai images/edits endpoint
 2025-08-25 23:11:13 -07:00
Krish DholakiaandGitHub 22934907ba Merge pull request #13933 from michal-otmianowski/ignore-expired-s3-cache-entries 
Verify if cache entry has expired prior to serving it to client
 2025-08-25 23:10:48 -07:00
Krish DholakiaandGitHub b1bc8e3aa2 Merge pull request #13955 from ckoehler/push-oymwkvxmkqxv 
feat: add image headers for Copilot
 2025-08-25 23:04:24 -07:00
Krish DholakiaandGitHub 51b491e7a1 Merge pull request #13958 from TeddyAmkie/pricing/deepseek-v3p1 
Add DeepSeek-v3.1 pricing for Fireworks AI provider
 2025-08-25 23:03:39 -07:00
Teddy Amkie 97e9502f4a Add DeepSeek-v3.1 pricing for Fireworks AI provider 
- Add fireworks_ai/accounts/fireworks/models/deepseek-v3p1 model configuration
- Set context window: 128K input, 8K output tokens
- Pricing: /bin/zsh.56/1M input tokens, .68/1M output tokens
- Supports response schema and tool choice
- Based on DeepSeek API unified pricing effective Sept 2025
 2025-08-25 18:41:49 -07:00
Ishaan JaffandGitHub 6ce1d82970 [Bug] Fix: Vertex Mistral not working for streaming (#13952) 
* fix OpenAI like chat handler

* fix MockResponse

* test_partner_models_httpx_streaming

* test_partner_models_httpx_streaming
 2025-08-25 17:39:40 -07:00
Christoph Koehler 04cca1e7f3 feat: add image headers for Copilot 
Fixes #13696. See issue for details.
 2025-08-25 18:15:26 -06:00
Ishaan JaffandGitHub c7b0c57b1e [Bug Fix] Azure Passthrough request with streaming (#13831) 
* fix: _update_stream_param_based_on_request_body

* test_update_stream_param_based_on_request_body

* test_pass_through_request_stream_param_override
 2025-08-25 14:11:17 -07:00
Ishaan JaffandGitHub 433d1a4947 [Bug fix] - Fix /messages fallback from Anthropic API -> Bedrock API (#13946) 
* use helper get_provider_specific_headers

* fix get_provider_specific_headers

* test_anthropic_messages_fallbacks

* bedrock/us.anthropic.claude-sonnet-4

* fix: get_provider_specific_headers

* TestProviderSpecificHeaderUtils

* test_anthropic_messages_fallbacks
 2025-08-25 13:44:54 -07:00
Ishaan JaffandGitHub c1ee8c26af [UI QA] - Allow setting Team Member RPM/TPM limits when creating a team (#13943) 
* allow setting team_member_rpm_limit on creating

* create_team_member_rate_limits

* docs fix

* fix img
 2025-08-25 09:12:50 -07:00
Ishaan Jaff 7c5e9b666b update release notes 2025-08-25 08:17:30 -07:00
Michal Otmianowski 3b6462236c clean imports 2025-08-25 11:09:06 +02:00
Michal Otmianowski c444263e7d verify expires field prior to serving cache entry 2025-08-25 10:42:12 +02:00
Krish DholakiaandGitHub 68aaeb4f4a Merge pull request #13914 from uc4w6c/docs/fix-custom-guardrail-imports 
Fix missing and unused imports in custom_guardrail docs example
 2025-08-25 00:57:46 -07:00
Krish DholakiaandGitHub 0d285c8b4c Merge pull request #13919 from stevenmanton/fix-aws-assume-role-with-token 
Add support for AWS assume_role with a session token
 2025-08-25 00:55:02 -07:00
Krish DholakiaandGitHub a7bb5bc814 Merge pull request #13922 from ArthurRenault/patch-1 
[BUG] Add back supervisor to non-root image
 2025-08-25 00:54:18 -07:00
ArthurandGitHub 6c97a31c9c bug: add supervisor to non-root image 2025-08-24 15:43:57 +02:00
Steven Anton d95578464e Add support for AWS assume_role with a session token 2025-08-23 22:37:21 -07:00
Toy-97andGitHub f2bb1ce31e Deepinfra Metadata Update 24082025 
Deepseek v3.1 Price Dropped
 2025-08-24 08:30:25 +08:00
Ishaan Jaff 827d1def02 UI new build v1.76.0-nightly 2025-08-23 17:12:09 -07:00
Ishaan Jaff 373a13f9d4 ui fix logos 2025-08-23 17:10:18 -07:00
Ishaan Jaff 65adddd91e fix callback logos 2025-08-23 17:08:18 -07:00
Ishaan JaffandGitHub f4de167654 [Feat] UI QA Fixes (#13915) 
* fix add fallbacks page

* leftnav - allow expand / collapse
 2025-08-23 17:05:25 -07:00
Ishaan Jaff e0e356e328 test mapped test fixes 2025-08-23 17:04:23 -07:00
Yuta Saito cca1ea1592 Fix missing and unused imports in custom_guardrail docs example 2025-08-24 08:37:17 +09:00
mubashir1osmani 2fa8f971e0 feat: multiple images in openai images/edits endpoint 2025-08-23 19:13:32 -04:00
Krish DholakiaandGitHub 242c06e691 Merge pull request #13784 from mubashir1osmani/docs-deploy 2025-08-23 15:40:34 -07:00
Ishaan Jaff 8a8b6f6b2c ui new build 2025-08-23 14:18:38 -07:00
Ishaan Jaff 0fccd619ea test_vertex_ai_deepseek 2025-08-23 14:13:03 -07:00
Ishaan Jaff cf64033044 test fix 2025-08-23 14:04:41 -07:00
Ishaan Jaff 835879bc85 fix: img gen 2025-08-23 14:03:11 -07:00
Ishaan Jaff f1c710a608 test_e2e_generate_cold_storage_object_key_not_configured 2025-08-23 13:33:33 -07:00
Ishaan Jaff 58c413d7ab use litellm-proxy-extras==0.2.18 v1.76.0-stable-draft 2025-08-23 13:27:26 -07:00
Mubashir OsmaniandGitHub 1a8d3cc2d5 Added FAQ under deployment docs (#13912) 
* updated faq questions

* updated faq

* added faq under deployment
 2025-08-23 13:22:56 -07:00
Ishaan Jaff e637930d6d fix Providers UI 2025-08-23 13:16:40 -07:00