tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-28 06:20:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,280 Commits 2,072 Branches 1,425 Tags
7dd76bc4e3e2a86c2c5fb1957b19c7da86afdee2
Commit Graph
27280 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
yuneng-jiangandGitHub 7dd76bc4e3 Usage indicator Near Limit Fix (#16504) 2025-11-11 18:50:15 -08:00
Ishaan JaffandGitHub 50b5cf5215 [Feat] New Provider - Add RunwayML Provider for video generations (#16505) 
* add RUNWAYML

* init folders

* add RunwayMLVideoConfig

* add RUNWAYML_DEFAULT_API_VERSION

* add RunwayMLVideoConfig

* fix getting status

* add async_transform_video_content_response

* add runwayml transform_video_content_response

* fix config.yaml

* add runwayml docs

* add runwayml to videos

* docs runwayml video gen

* add new models to model cost map

* TestRunwayMLVideoTransformation

* fix linting errors
 2025-11-11 18:48:23 -08:00
Pedro AzevedoandGitHub 663f2d7e7f docs: remove enterprise restriction from guardrails list endpoint (#15333) 
- Remove enterprise-only label from 'View Available Guardrails' section
- The /guardrails/list endpoint appears to be available in OSS version
- Makes documentation more accurate for OSS users
 2025-11-11 18:45:26 -08:00
yuneng-jiangandGitHub c623ff916f Add Tags To Edit Key Flow (#16500) 2025-11-11 17:44:29 -08:00
jwang-gifGitHubAngela Tao
 		443bada425 Add Zscaler AI Guard hook (#15691) 
* Add Zscaler AI Guard hook

Co-authored-by: Angela Tao <atao@zscaler.com>

* Fix lint error, update document

* Fix lint error, update document

* update document

* fix mypy type error

* fix mypy issue

* fix test

* fix test

* improve document

* remove unuseful code

* use litellm httphandler

* update test cases

* revover guardrail_initializers.py and guardrail_registry.py

* remove unuse import

* app apply_guardrail

* remove functions repleased by apply_guardrail, update test and doc

* remove functions repleased by apply_guardrail, update test and doc

---------

Co-authored-by: Angela Tao <atao@zscaler.com>
 2025-11-11 15:34:27 -08:00
yuneng-jiangandGitHub 627463b21f [Infra] CI/CD - Bump up docker version for e2e ui testing (#16506) 
* Bump up docker version for e2e ui testing CICD

* Fixing config file
 2025-11-11 15:07:30 -08:00
Krrish Dholakia a987e3ca46 fix(proxy_cli.py): check for env var for IAM_TOKEN_DB_AUTH v1.79.dev.1 2025-11-11 11:56:58 -08:00
Ishaan Jaffer be05324645 docs fix MAX_LANGFUSE_INITIALIZED_CLIENTS 2025-11-11 11:26:33 -08:00
Ishaan JaffandGitHub 5c9f50d584 [AI Gateway] - End User Budgets - Allow pointing max_end_user budget to an id, so the default ID applies to all end users (#16456) 
* add _apply_budget_limits_to_end_user_params

* add _apply_budget_limits_to_end_user_params

* add _apply_budget_limits_to_end_user_params

* test_default_budget_applied_to_end_user_without_budget

* docs fix

* fix config
 2025-11-11 08:20:13 -08:00
Ishaan JaffandGitHub e94186629d [Fix] Bedrock Knowledge bases - ensure users can access search_results for both stream + non stream response to /chat/completions (#16459) 
* fix message with provider_specific_fields

* test_provider_specific_fields_in_proxy_http_response

* test_provider_specific_fields_in_proxy_http_response
 2025-11-11 08:19:57 -08:00
YutaSaitoandGitHub aff1060512 fix: unable to delete MCP server from permission settings #16124 (#16407) 2025-11-10 19:50:13 -08:00
Daniel SabanovandGitHub 0ecc38519e [Bug] Updated spend would not be sent to CloudZero (#16201) 
* Address a bug where cloudzero spend is not sent to cloudzero if a spend
update happens

* revert change unrelated to PR

* use polars for mocking instead of sqlite
 2025-11-10 19:43:15 -08:00
yellowsubmarine372andGitHub b6dbd4fa28 fix: apply provided timeout value to ClientTimeout.total (#16395) 2025-11-10 19:37:42 -08:00
Alan PonnachanandGitHub 5f12e4be1e fix(langfuse): Handle null usage values to prevent validation errors (#16396) 
* langfuse null validation fix

* formatting
 2025-11-10 19:34:56 -08:00
Alan PonnachanandGitHub 7b292ccdf5 router fallback for unknown models (#16419) 2025-11-10 19:33:01 -08:00
Matt CowgerandGitHub e0d6774ec1 fix: update model_cost_map_url to use environment variable (#16429) 
* fix: update model_cost_map_url to use environment variable, to match behavior to documentation in docs/my-website/docs/proxy/sync_models_github.md

* Add an appropriate test.
 2025-11-10 19:30:44 -08:00
Alan PonnachanandGitHub df33f36c06 Correctly handle date filters in /spend/logs endpoint (#16443) 2025-11-10 19:26:55 -08:00
Val MiscenkoandGitHub 19e6e60d30 fix: remove strict master_key check in add_deployment (#16453) 
Allows proxy to save spend logs without requiring master_key.
  Decryption now gracefully handles both encrypted and unencrypted values.
 2025-11-10 19:23:13 -08:00
Sameer KankuteandGitHub aaa8cba00b Add docs for tracking callback failure (#16474) 2025-11-10 19:15:14 -08:00
Sameer KankuteandGitHub 6cab77f53f Added thinking streaming support for mistral (#16434) 2025-11-10 18:41:45 -08:00
Sameer KankuteandGitHub bf363cdf10 Add sdk focused examples (#16441) 2025-11-10 18:39:34 -08:00
yuneng-jiangandGitHub 8f1f5825aa Invite User Searchable Team Select (#16454) 2025-11-10 18:38:23 -08:00
Sameer KankuteandGitHub be3c09e6d5 Add GET list of providers endpoint (#16432) 2025-11-10 18:38:09 -08:00
yuneng-jiangandGitHub af68763f5d Only show models based on selected endpoint (#16452) 2025-11-10 18:38:01 -08:00
Ishaan Jaffer b8eda0ef55 proxy_store_model_in_db_tests 2025-11-10 18:20:52 -08:00
Ishaan JaffandGitHub 8140d85d28 [Bug Fix] - LiteLLM Usage shows key_hash- (#16471) 
* test_get_logging_payload_api_key_preserved_when_standard_logging_payload_is_none

* fix get_logging_payload

* test_api_key_preserved_through_failure_hook_to_database
 2025-11-10 18:15:52 -08:00
Jehandad KamalGitHubClaude
 		912be308b2 fix: allow internal users to access video generation routes (#16472) 
Fixes #16470

Video generation endpoints (/v1/videos, /videos/{video_id}, etc.) were
incorrectly restricted to proxy_admin role only. These routes are now
added to openai_routes list, making them accessible to internal_user
role as they should be - video generation is a legitimate user feature,
not a management/admin operation.

Changes:
- Added 8 video route patterns to LiteLLMRoutes.openai_routes in _types.py
- Added comprehensive tests verifying internal_user and virtual key access
- All existing route permission tests continue to pass

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Claude <noreply@anthropic.com>
 2025-11-10 17:44:16 -08:00
Ishaan Jaffer 82d538c6f3 fix code qa check 2025-11-10 17:42:16 -08:00
yuneng-jiangandGitHub a03c9fde4a Add deprecation warning to Model Analytics Page (#16417) 2025-11-10 17:17:31 -08:00
Ishaan JaffandGitHub dc76b6c76e [Fix] Management Endpoints - Fixes inconsistent error responses in customer management endpoints. Non-existent user errors now return proper 404 status codes with consistent error schema format across all endpoints. (#16450) 
* fix: ensure end user endpoints use "handle_exception_on_proxy" correctly

* test 404 on info and update for non-existent user

* test 404 for no customer found

* fix 404 handling for customer endpoints

* test_error_schema_consistency

* test_customer_endpoints_error_schema_consistency
 2025-11-10 17:16:53 -08:00
Cesar GarciaandGitHub 656dce92d0 docs: fix streaming example in README (#16461) 
* docs: add messages variable definition in streaming example

- Add missing messages variable in streaming code example
- Makes the example complete and runnable without modifications

* docs: capitalize LiteLLM in streaming section

* docs: add gpt-4o comment
 2025-11-10 17:16:17 -08:00
‮ArtemandGitHub 3289038089 add kimi k2 thinking (#16445) 2025-11-10 15:56:06 -08:00
yuneng-jiangandGitHub 39ae7549a4 [Feature] UI - Model Info Page Health Check (#16416) 
* Add test connection button to model info page

* Unused import
 2025-11-10 11:10:06 -08:00
‮ArtemandGitHub a97676b8ae Add softgen to projects that are using litellm (#16423) 
* Add Softgen project documentation

* Add Softgen project to sidebars

* Update Softgen
 2025-11-10 11:09:29 -08:00
Sameer KankuteandGitHub 013c195ab7 Fix container api link (#16440) 2025-11-10 11:09:10 -08:00
Krrish Dholakia 50f35fca47 docs: reorder docs 2025-11-10 07:33:22 -08:00
Ishaan Jaffer c088483da9 docs playground 2025-11-08 18:15:52 -08:00
Ishaan Jaffer 8c1dd78c13 fix imports v1.79.3.rc.1 v1.79.3-nightly 2025-11-08 18:01:32 -08:00
Ishaan Jaffer b2df26d0be fix _transform_usage_objects 2025-11-08 17:29:19 -08:00
Ishaan Jaffer 8a8c24e391 ci/cd new deploy 2025-11-08 17:25:13 -08:00
Ishaan Jaffer f2832ba2f8 docs fix 2025-11-08 17:25:01 -08:00
Ishaan Jaffer b803af4aae docs fix 2025-11-08 17:05:20 -08:00
Ishaan Jaffer 36d181e398 docs fix + linting fix 2025-11-08 17:02:00 -08:00
Ishaan Jaffer 42c1e4740a docs built in guard 2025-11-08 16:59:00 -08:00
Ishaan Jaffer a298a9d492 docs fix 2025-11-08 16:52:26 -08:00
Ishaan Jaffer 7fb46e0b29 docs fix 2025-11-08 16:50:51 -08:00
Ishaan Jaffer 4647b41d7f docs fix 2025-11-08 16:50:06 -08:00
Krrish Dholakia 0640949333 fix(litellm_logging.py): correctly log token usage for audio transcription calls to langfuse 2025-11-08 16:47:58 -08:00
Ishaan JaffandGitHub 08cfc2bf7e [Docs] Litellm 1 79 2 rc (#16415) 
* stash - v1

* docs fix

* docs fix

* docs

* folder fix

* docs fix
 2025-11-08 16:47:15 -08:00
Alexsander HamirandGitHub 277b564385 add: performance improvements to release notes (#16401) 
* add: performance improvements to release notes

* fix: mention which endpoint is getting faster

* fix: clarify that reported latency is end-to-end
 2025-11-08 16:42:58 -08:00