tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-07 06:29:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,921 Commits 2,072 Branches 1,425 Tags
ef9d1ddc40cdbff2cd61ca1dfad71ec8533ea6bc
Commit Graph
767 Commits
Author SHA1 Message Date
Elias TOURNEUX ef9d1ddc40 feat: Add OVHCloud AI Endpoints as a provider 2025-09-12 13:37:03 +02:00
Krish DholakiaandGitHub f8036a25a2 Merge pull request #14455 from lmnr-ai/fix/async-logging-tasks-context 
propagate execution context into logging tasks
 2025-09-12 00:36:08 -07:00
Krish DholakiaandGitHub 113d2a8c5a Merge pull request #14459 from holzman/fix-provider-budget 
Fix provider budgets
 2025-09-12 00:34:52 -07:00
Krish DholakiaandGitHub 0413a701a2 Merge pull request #14460 from Sameerlite/litellm_vertex_gcs_bucket_issue 
fix vertex ai file upload
 2025-09-12 00:04:21 -07:00
Ishaan JaffandGitHub 32d87c242b [Fixes] Using Qwen API Tiered Pricing (#14479) 
* fix: use dashscope cost calc

* add qwen logo
 2025-09-11 20:07:41 -07:00
Ishaan Jaff 69ef062f55 fix tiered_pricing test 2025-09-11 19:56:44 -07:00
Ishaan JaffandGitHub 51d5255452 [Bug]: Azure OpenAI & AI Foundry Reject Image Generation Payload Due to extra_body Injection in LiteLLM v1.76.3 (#14475) 
* add request body azure img gen

* fix test_get_optional_params_image_gen_filters_empty_values

* test_azure_image_generation_request_body

* test_azure_image_generation_request_body
 2025-09-11 19:39:06 -07:00
Ishaan JaffandGitHub dda115cc6d [Feat] Cost Tracking - Add support for Tiered Cost Tracking for Qwen API (Dashscope) (#14471) 
* add dashscope logo

* docs fix

* docs fix

* fix supports_batch_calling

* fix naming

* fix input_cost_per_audio_token

* use output_cost_per_reasoning_token

* add tiered_pricing in get_model_info

* test fixes

* fix cost calc

* ruff fix
 2025-09-11 18:14:39 -07:00
Burt Holzman e9e548d797 Fix provider budgets 2025-09-11 12:08:43 -05:00
Sameer Kankute 090e0fddf4 fix vertex ai file upload 2025-09-11 22:20:54 +05:30
Din ee5a9d0aa0 propagate execution context into logging tasks 2025-09-11 15:54:40 +01:00
Ishaan Jaff 258b674dbb fix deepinfra test 2025-09-10 19:39:23 -07:00
Ishaan JaffandGitHub a13aa4740a [Fixes] Bug fixes to using LiteLLM MCP Gateway (#14392) 
* fix: use _get_mcp_servers_in_path

* fix checks for using litellm_proxy as MCP tool provider

* fix: fix mcp_tools_with_litellm_proxy

* fix: fix aresponses_api_with_mcp

* aresponses_api_with_mcp

* test_mcp_allowed_tools_filtering

* fix: _filter_mcp_tools_by_allowed_tools

* fix: _filter_mcp_tools_by_allowed_tools

* test_streaming_responses_api_with_mcp_tools

* fixes: test tools transfrom MCP->OpenaI spec

* test_streaming_responses_api_with_mcp_tools

* fix: chat ui allow multi select with allowed tools

* fix: use correct MCP events with litellm proxy response API

* fix get_event_model_class

* fix litellm proxy MCP handler

* fix MCPEnhancedStreamingIterator

* chat ui show list tools result

* UI: show MCP events

* fix stream iterator

* fixes: litellm proxy mcp handler

* test responses + mcp

* fix: update responses api with mcp handling

* ruff check fix

* central: _process_mcp_tools_to_openai_format

* fix: refactor code

* test_mcp_allowed_tools_filtering

* test mcp with litellm proxy

* fix mcp call

* demo: video using MCP ui

* fixes for using stream iterator

* test_no_duplicate_mcp_tools_in_streaming_e2e

* docs fix

* fix code snippet
 2025-09-10 19:12:11 -07:00
Ishaan JaffandGitHub dc5650eeda Revert "fix: remove anthropic-beta header for Vertex AI requests with prompt caching" (#14421) 2025-09-10 15:47:18 -07:00
Krish DholakiaandGitHub a80cfe5fb5 Merge branch 'main' into feature/databricks-function-call-missing-pass-description 2025-09-09 22:42:32 -07:00
Krish DholakiaandGitHub 53bf023876 Merge pull request #14092 from gotsysdba/main 
OCI Provder: Update OCIPromptTokensDetails
 2025-09-09 22:39:16 -07:00
Krish DholakiaandGitHub d72081113e Merge pull request #14111 from dharamendrak/feature/aiohttp-dependency-injection 
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
 2025-09-09 22:35:30 -07:00
Krish DholakiaandGitHub 03a457842d Merge pull request #14310 from swarna1101/fix-anthropic-prompt-caching-vertex-ai 
fix: remove anthropic-beta header for Vertex AI requests with prompt caching
 2025-09-09 22:32:40 -07:00
Krrish Dholakia bdd7255bab test: remove redundant tests - moved to parallel_request_limiter_v3.py 2025-09-09 21:35:50 -07:00
pinkguandGitHub 285b14bd69 Fix/gcp model armor (#14381) 
* chore: fix model armor always success

Signed-off-by: bjorn <bjornjee95@gmail.com>

* chore: fix sanitisation field extraction

Signed-off-by: bjorn <bjornjee95@gmail.com>

---------

Signed-off-by: bjorn <bjornjee95@gmail.com>
 2025-09-09 09:18:37 -07:00
swarnabhasinha f8ddd123d1 fix: add missing patch import in vertex_ai test 2025-09-09 16:16:59 +05:30
Krish DholakiaandGitHub 54c3ae15c8 Merge pull request #14312 from mubashir1osmani/main 
fix: spend tags endpoint returns 500
 2025-09-08 19:05:13 -07:00
Dharamendra Kumar 5b26e78ad6 Fix linting 2025-09-07 18:04:00 -07:00
Dharamendra Kumar 92596e48fe Merge branch 'main' into feature/aiohttp-dependency-injection 2025-09-07 17:54:55 -07:00
mubashir1osmani d9bbbc10a6 added tests 2025-09-07 10:17:28 -04:00
Krish DholakiaandGitHub fbc0ec98b6 Merge pull request #12438 from jasonpnnl/fix-customer-update 
Fix 500 error in `/customer/update` endpoint when updating with `budget_id`
 2025-09-06 22:12:30 -07:00
Krish DholakiaandGitHub ba10173ec7 Merge branch 'main' into heroku-llms 2025-09-06 22:10:20 -07:00
Krish DholakiaandGitHub 884cca7da9 Merge pull request #12984 from darashenka/main 
honor OLLAMA_API_KEY for ollama_chat
 2025-09-06 22:07:28 -07:00
Krish DholakiaandGitHub db6fd68540 Merge pull request #14160 from BerriAI/litellm_dev_09_01_2025_p1 
MINOR update: Add openrouter image generation support + refactor Gemini `image` output param to be `images` (openrouter compatible)
 2025-09-06 19:26:00 -07:00
Ishaan JaffGitHubJugal Bhatt
 		c9ab104445 [Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305) 
* Implement pass-through route registration and removal to prevent duplicates and memory leaks

* fix MYPY linting

* fix InitPassThroughEndpointHelpers

* fix test_aaparallel_function_call

---------

Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>
 2025-09-06 19:22:25 -07:00
Krrish Dholakia 5a0328b1a9 test: update tests 2025-09-06 19:02:03 -07:00
Ishaan Jaff d89a2a0797 test 2025-09-06 16:38:43 -07:00
Ishaan Jaff c168fff38a test_cooldown_badrequest_error 2025-09-06 16:28:00 -07:00
Ishaan Jaff 7054067238 test_cooldown_handlers.py 2025-09-06 16:13:30 -07:00
Ishaan Jaff 7f5460465c unit test oai pass through 2025-09-06 14:54:34 -07:00
Ishaan Jaff b1552cae46 fix mocked CZ tests 2025-09-06 14:33:02 -07:00
Ishaan JaffandGitHub 8920a645e9 Revert "feat: add redis ssl and username support (#11319)" (#14303) 
This reverts commit 31f806f7d0.
 2025-09-06 14:01:00 -07:00
Ishaan Jaff fc7accad74 test_dry_run_export_usage_data_cbf_transformation_failure 2025-09-06 13:59:28 -07:00
Ishaan Jaff 1227b54fa6 test_get_model_info_gemini 2025-09-06 13:43:42 -07:00
Krish DholakiaandGitHub 1980960218 Merge branch 'main' into litellm_responses_structured_output 2025-09-06 09:20:00 -07:00
Ishaan JaffandGitHub 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296) 
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
 2025-09-05 21:29:41 -07:00
Sameer KankuteandGitHub 07ba3ff036 [Feat] Add pass through image gen and image editing on OpenAI (#14292) 
* add pass through image gen and image editing on OpenAI

* fix lint
 2025-09-05 12:25:49 -07:00
Pierre-Emmanuel MERCIERandGitHub 31f806f7d0 feat: add redis ssl and username support (#11319) 2025-09-05 10:35:11 -07:00
Ishaan Jaff 0a60390521 Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)" 
This reverts commit e3b752d3dc.
 2025-09-05 10:04:07 -07:00
Ishaan JaffandGitHub 982800069c [Bug Fix] x-litellm-tags not routing with Responses API (#14289) 
* fix: get_deployments_for_tag

* fix get_deployments_for_tag

* test_router_tag_routing.py

* test_get_metadata_variable_name_from_kwargs

* fix mapped tests

* docs fix
 2025-09-05 09:40:37 -07:00
Sameer Kankute 231d54741f Move test to test_litellm/ folder 2025-09-05 10:40:26 +05:30
Sameer Kankute 4fefac1bf2 Move test to test_litellm/ folder 2025-09-05 10:24:55 +05:30
Sameer Kankute ad9f54a192 Move test to test_litellm/ folder 2025-09-05 10:08:34 +05:30
Sameer Kankute f7f106f8b8 Move test to test_litellm/ folder 2025-09-05 10:00:58 +05:30
Krish DholakiaandGitHub f67339a86c Merge pull request #14028 from onlylhf/volcengine-embedding-support 
Add Volcengine embedding module with handler and transformation logic
 2025-09-04 21:01:25 -07:00