tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-07 10:21:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,929 Commits 2,072 Branches 1,425 Tags
e254d9013b690aef4dc67c8563dfdf657ffb5af2
Commit Graph
770 Commits
Author SHA1 Message Date
Ishaan JaffandGitHub 18372f9ebe Revert "fix vertex ai file upload" (#14501) 2025-09-12 12:02:24 -07:00
SameerliteGitHubIshaan Jaff
 		fa175e8d90 Fix gemini cli error (#14417) 
* Fix gemini cli error

* Added better handling

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2025-09-12 11:56:51 -07:00
Sameer KankuteGitHubsameer@berri.ai <sameer@berri.ai>
 		1a123b2cd5 Litellm gemini cli bug fix (#14451) 
* Fix gemini cli error

* Add reasoning request support

* Added better handling

* remove other PR code

* refactored code for better structure following

---------

Co-authored-by: sameer@berri.ai <sameer@berri.ai>
 2025-09-12 11:55:26 -07:00
Boopesh ShanmugamandGitHub 8b338a4d8c User Headers X LiteLLM Users Mapping feature (#14485) 
* Draft commit.

* user header mapping feature with backward compatibility with user_header_name field.

* user header mapping feature with backward compatibility with user_header_name field optimizations.

* Added unit tests.
 2025-09-12 11:49:37 -07:00
Krish DholakiaandGitHub f8036a25a2 Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context 
propagate execution context into logging tasks
 2025-09-12 00:36:08 -07:00
Krish DholakiaandGitHub 113d2a8c5a Merge pull request #14459 from holzman/fix-provider-budget 
Fix provider budgets
 2025-09-12 00:34:52 -07:00
Krish DholakiaandGitHub 0413a701a2 Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue 
fix vertex ai file upload
 2025-09-12 00:04:21 -07:00
Ishaan JaffandGitHub 32d87c242b [Fixes] Using Qwen API Tiered Pricing (#14479) 
* fix: use dashscope cost calc

* add qwen logo
 2025-09-11 20:07:41 -07:00
Ishaan Jaff 69ef062f55 fix tiered_pricing test 2025-09-11 19:56:44 -07:00
Ishaan JaffandGitHub 51d5255452 [Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 (#14475) 
* add request body azure img gen

* fix test_get_optional_params_image_gen_filters_empty_values

* test_azure_image_generation_request_body

* test_azure_image_generation_request_body
 2025-09-11 19:39:06 -07:00
Ishaan JaffandGitHub dda115cc6d [Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471) 
* add dashscope logo

* docs fix

* docs fix

* fix supports_batch_calling

* fix naming

* fix input_cost_per_audio_token

* use output_cost_per_reasoning_token

* add tiered_pricing in get_model_info

* test fixes

* fix cost calc

* ruff fix
 2025-09-11 18:14:39 -07:00
Burt Holzman e9e548d797 Fix provider budgets 2025-09-11 12:08:43 -05:00
Sameer Kankute 090e0fddf4 fix vertex ai file upload 2025-09-11 22:20:54 +05:30
Din ee5a9d0aa0 propagate execution context into logging tasks 2025-09-11 15:54:40 +01:00
Ishaan Jaff 258b674dbb fix deepinfra test 2025-09-10 19:39:23 -07:00
Ishaan JaffandGitHub a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392) 
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
 2025-09-10 19:12:11 -07:00
Ishaan JaffandGitHub dc5650eeda Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421) 2025-09-10 15:47:18 -07:00
Krish DholakiaandGitHub a80cfe5fb5 Merge branch 'main' into feature/databricks-function-call-missing-pass-description 2025-09-09 22:42:32 -07:00
Krish DholakiaandGitHub 53bf023876 Merge pull request #14092 from gotsysdba/main 
OCI Provder: Update OCIPromptTokensDetails
 2025-09-09 22:39:16 -07:00
Krish DholakiaandGitHub d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection 
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
 2025-09-09 22:35:30 -07:00
Krish DholakiaandGitHub 03a457842d Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai 
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
 2025-09-09 22:32:40 -07:00
Krrish Dholakia bdd7255bab test: remove redundant tests - moved to parallel_request_limiter_v3.py 2025-09-09 21:35:50 -07:00
pinkguandGitHub 285b14bd69 Fix/gcp model armor (#14381) 
* chore: fix model armor always success

Signed-off-by: bjorn <bjornjee95@gmail.com>

* chore: fix sanitisation field extraction

Signed-off-by: bjorn <bjornjee95@gmail.com>

---------

Signed-off-by: bjorn <bjornjee95@gmail.com>
 2025-09-09 09:18:37 -07:00
swarnabhasinha f8ddd123d1 fix: add missing patch import in vertex_ai test 2025-09-09 16:16:59 +05:30
Krish DholakiaandGitHub 54c3ae15c8 Merge pull request #14312 from mubashir1osmani/main 
fix: spend tags endpoint returns 500
 2025-09-08 19:05:13 -07:00
Dharamendra Kumar 5b26e78ad6 Fix linting 2025-09-07 18:04:00 -07:00
Dharamendra Kumar 92596e48fe Merge branch 'main' into feature/aiohttp-dependency-injection 2025-09-07 17:54:55 -07:00
mubashir1osmani d9bbbc10a6 added tests 2025-09-07 10:17:28 -04:00
Krish DholakiaandGitHub fbc0ec98b6 Merge pull request #12438 from jasonpnnl/fix-customer-update 
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
 2025-09-06 22:12:30 -07:00
Krish DholakiaandGitHub ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish DholakiaandGitHub 884cca7da9 Merge pull request #12984 from darashenka/main 
honor OLLAMA_API_KEY for ollama_chat
 2025-09-06 22:07:28 -07:00
Krish DholakiaandGitHub db6fd68540 Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1 
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
 2025-09-06 19:26:00 -07:00
Ishaan JaffGitHubJugal Bhatt
 		c9ab104445 [Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305) 
* Implement pass-through route registration and removal to prevent duplicates and memory leaks

* fix MYPY linting

* fix InitPassThroughEndpointHelpers

* fix test_aaparallel_function_call

---------

Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
 2025-09-06 19:22:25 -07:00
Krrish Dholakia 5a0328b1a9 test: update tests 2025-09-06 19:02:03 -07:00
Ishaan Jaff d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff c168fff38a test_cooldown_badrequest_error 2025-09-06 16:28:00 -07:00
Ishaan Jaff 7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00
Ishaan Jaff 7f5460465c unit test oai pass through 2025-09-06 14:54:34 -07:00
Ishaan Jaff b1552cae46 fix mocked CZ tests 2025-09-06 14:33:02 -07:00
Ishaan JaffandGitHub 8920a645e9 Revert "feat: add redis ssl and username support (#11319)" (#14303) 
This reverts commit 31f806f7d0.
 2025-09-06 14:01:00 -07:00
Ishaan Jaff fc7accad74 test_dry_run_export_usage_data_cbf_transformation_failure 2025-09-06 13:59:28 -07:00
Ishaan Jaff 1227b54fa6 test_get_model_info_gemini 2025-09-06 13:43:42 -07:00
Krish DholakiaandGitHub 1980960218 Merge branch 'main' into litellm_responses_structured_output 2025-09-06 09:20:00 -07:00
Ishaan JaffandGitHub 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296) 
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
 2025-09-05 21:29:41 -07:00
Sameer KankuteandGitHub 07ba3ff036 [Feat] Add pass through image gen and image editing on OpenAI (#14292) 
* add pass through image gen and image editing on OpenAI

* fix lint
 2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIERandGitHub 31f806f7d0 feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan Jaff 0a60390521 Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)" 
This reverts commit e3b752d3dc.
 2025-09-05 10:04:07 -07:00
Ishaan JaffandGitHub 982800069c [Bug Fix] x-litellm-tags not routing with Responses API (#14289) 
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
 2025-09-05 09:40:37 -07:00
Sameer Kankute 231d54741f Move test to test_litellm/ folder 2025-09-05 10:40:26 +05:30
Sameer Kankute 4fefac1bf2 Move test to test_litellm/ folder 2025-09-05 10:24:55 +05:30