Commit Graph
2336 Commits
Author SHA1 Message Date
yuneng-jiangandGitHub 809b4cb310 Revert "Revert "[Feature] Deleted Keys and Deleted Teams Table"" 2026-01-16 14:25:23 -08:00
Yuta Saito 18bcb429fc Manual revert #19078 2026-01-17 06:54:08 +09:00
YutaSaitoandGitHub 034e3a6d44 Revert "[Feature] Deleted Keys and Deleted Teams Table" 2026-01-17 06:46:41 +09:00
YutaSaitoandGitHub 7aba0f738a Revert "Litellm staging 01 15 2026" 2026-01-17 06:31:34 +09:00
YutaSaitoandGitHub 3e9e65c123 Merge pull request #19245 from BerriAI/revert-19141-litellm_stablise_mock_tests
Revert "Stabilise mock tests"
2026-01-17 06:27:53 +09:00
yuneng-jiangandGitHub 2394e722d6 Merge branch 'main' into litellm_deleted_keys_team 2026-01-16 13:27:16 -08:00
YutaSaitoandGitHub eec4ed640b Revert "Stabilise mock tests" 2026-01-17 06:26:18 +09:00
YutaSaitoandGitHub edea885316 Merge pull request #19240 from BerriAI/revert-19116-litellm_org_admin_escalte
Revert "[Fix] /user/new Privilege Escalation"
2026-01-17 06:12:14 +09:00
YutaSaitoandGitHub 66d67ae356 Revert "Add sanititzation for anthropic messages" 2026-01-17 06:01:12 +09:00
YutaSaitoandGitHub 237ba2203e Revert "[Fix] /user/new Privilege Escalation" 2026-01-17 05:57:07 +09:00
Anand KambleandGitHub 2c75194b49 fix(vertex_ai): Vertex AI 400 Error: Model used by GenerateContent request (models/gemini-3-*) and CachedContent (models/gemini-3-*) has to be the same (#19193)
* fix(vertex_ai): include model in context cache key generation

* test(vertex_ai): update context caching tests to verify model in cache key
2026-01-17 00:56:15 +05:30
yuneng-jiang 33ff58b70a Merge remote-tracking branch 'origin' into litellm_deleted_keys_team 2026-01-16 09:55:52 -08:00
yuneng-jiang e3d1e0345c only show own internal user usage 2026-01-16 09:38:34 -08:00
Sameer KankuteandGitHub 9388dd842a Merge pull request #19159 from BerriAI/litellm_staging_01_15_2026
Litellm staging 01 15 2026
2026-01-16 18:04:25 +05:30
Sameer KankuteandGitHub fb3b4e6b33 Merge pull request #19196 from BerriAI/litellm_sanitise_anthropic_mesages
Add sanititzation for anthropic messages
2026-01-16 17:48:55 +05:30
Sameer KankuteandGitHub 43893cb81a Merge pull request #19191 from BerriAI/litellm_fix_stream_timeout
Fix: [Bug]: stream_timeout:The function of this parameter has been changed
2026-01-16 17:43:43 +05:30
Sameer KankuteandGitHub cca6632dae Merge pull request #19185 from BerriAI/litellm_fallback_endpoints_support
[Feat] Add fallback endpoints support
2026-01-16 17:39:35 +05:30
Sameer KankuteandGitHub ca06bb4e3a Merge pull request #19201 from BerriAI/litellm_fix_vertex_ai_structured_output2
Fix: vertex ai doesn't support structured output
2026-01-16 17:09:03 +05:30
Sameer KankuteandGitHub 101230e538 Merge pull request #19213 from BerriAI/main
merge main in sanitisation
2026-01-16 17:04:01 +05:30
Sameer KankuteandGitHub f562186c75 Merge pull request #19212 from BerriAI/main
merge main in timeout PR
2026-01-16 17:02:22 +05:30
Sameer KankuteandGitHub e54af42774 Merge pull request #19211 from BerriAI/main
merge main in fallback PR
2026-01-16 17:01:10 +05:30
Sameer KankuteandGitHub f3ca05112e Merge pull request #19206 from BerriAI/main
merge main
2026-01-16 15:22:16 +05:30
Sameer KankuteandGitHub dcd66db4a8 Revert "fix: models loadbalancing billing issue by filter (#18891)"
This reverts commit 41d8f79929.
2026-01-16 15:21:10 +05:30
Sameer KankuteandGitHub b0c6a1b308 Merge pull request #19203 from BerriAI/main
merge main
2026-01-16 15:16:29 +05:30
Sameer Kankute ac5a4df724 Fix: vertex ai doesn't support structured output 2026-01-16 14:54:31 +05:30
Sameer Kankute f1bde3c549 Add sanititzation for anthropic messages 2026-01-16 12:47:56 +05:30
Sameer Kankute c0e5637eae Fix: [Bug]: stream_timeout:The function of this parameter has been changed 2026-01-16 11:40:49 +05:30
Sameer KankuteandGitHub 9ac490de62 Merge pull request #19179 from BerriAI/litellm_fix_streaming_chunk
Fix : test_stream_chunk_builder_litellm_mixed_calls
2026-01-16 10:52:25 +05:30
Sameer Kankute d585b760c9 Add fallback endpoints support 2026-01-16 10:51:33 +05:30
Sameer Kankute aec1990dc2 Fix : test_streaming_multiple_partial_tool_calls 2026-01-16 09:29:54 +05:30
YutaSaitoandGitHub f123e08b16 Merge pull request #19178 from BerriAI/litellm_fix_ci_litellm_mapped_tests_llms
[tests] skip Azure SDK init check for acreate_skill
2026-01-16 12:17:55 +09:00
Yuta Saito 1c38847b17 tests: skip Azure SDK init check for acreate_skill 2026-01-16 12:03:38 +09:00
YutaSaitoandGitHub bbf9a9e6e6 Revert "[Fix] /team/daily/activity Show Internal Users Their Spend Only" 2026-01-16 11:27:59 +09:00
Ishaan JaffandGitHub 117c7dd158 [Feat] Claude Code - Add End-user tracking with Claude Code (#19171)
* add claude code customer usage tracking

* fix get end user trackign claude code

* TestGetCustomerIdFromStandardHeaders
2026-01-15 17:57:10 -08:00
Yuta Saito c03630d95e test: fix missing test 2026-01-16 10:33:53 +09:00
Yuta Saito 993742166d test: fix router_code_coverage test fail 2026-01-16 10:16:01 +09:00
yuneng-jiang 5ff768e5e0 Merge remote-tracking branch 'origin' into litellm_deleted_keys_team 2026-01-15 15:55:18 -08:00
yuneng-jiangandGitHub 6a7edd8f2b Merge pull request #18785 from BerriAI/litellm_user_promethus_metrics
[Feature] User Metrics for Promethus
2026-01-15 15:51:02 -08:00
yuneng-jiangandGitHub e07106244e Merge pull request #19116 from BerriAI/litellm_org_admin_escalte
[Fix] /user/new Privilege Escalation
2026-01-15 15:50:43 -08:00
d76f3acb80 fix: video status/content credential injection for wildcard models (#18854)
* fix: video status/content credential injection for wildcard models

When using wildcard model patterns like `vertex_ai/*`, the video status
and content endpoints failed to resolve the model_name correctly,
causing credential injection to be skipped.

Changes:
- router.py: Added `custom_llm_provider` parameter to
  `resolve_model_name_from_model_id` method
- router.py: Added Strategy 2 (provider prefix matching) and
  Strategy 4 (wildcard pattern matching)
- endpoints.py: Pass `provider_from_id` to resolver in video_status,
  video_content, and video_remix endpoints

This allows video_id like `vertex_ai:veo-3.0-generate-preview:...` to
correctly match `vertex_ai/*` wildcard pattern and inject credentials
from the model config.

Fixes: Video status returns "Your default credentials were not found"
when using Vertex AI video generation with wildcard model patterns.

* pr18845-video기능버그픽스 (vibe-kanban e43e2d2d)

pr코멘트 대응

litellm fork해서 branch만들고 작업후 pull request를 올렸는데 피드백을줬어.

이 내용 파악해서 내가 올린 pr 브랜치에 해당 작업 이어서 해야할거같아.

https://github.com/BerriAI/litellm/pull/18854#discussion\_r2677026995

여기 내용 읽고 현황 파악해서 작업하자.

테스트코드 작성해달라는데 테스트코드작성후 로컬에서 테스트명령어 한번 돌리고 커밋 푸시하려고.

litellm에서 pull request를 위한 문서가 있어.

https://docs.litellm.ai/docs/extras/contributing\_code

CRA서명은 했어. 그다음거부터 양식에 맞게 해야할듯. 지금 버그만 바로 고쳐서 pr했거든.

* fix: resolve mypy type error in resolve_model_name_from_model_id

Rename loop variable to avoid type conflict between DeploymentTypedDict
and Dict[Any, Any] from pattern_router.route() return type.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-16 03:45:25 +05:30
Harshit JainandGitHub 41d8f79929 fix: models loadbalancing billing issue by filter (#18891)
* fix: models loadbalancing billing issue by filter

* fix: separate key and team access groups in metadata
2026-01-16 03:41:21 +05:30
ccc0e342f2 Make keepalive_timeout parameter work for Gunicorn (#19087)
* [Fix] Containers API - Allow routing to regional endpoints (#19118)

* fix get_complete_url

* fix url resolution containers API

* TestContainerRegionalApiBase

* feat(proxy): add keepalive_timeout support for Gunicorn server

Add configurable keepalive timeout parameter for Gunicorn workers to
match existing Uvicorn functionality. This allows users to tune the
keep-alive connection timeout based on their deployment requirements.

Changes:
- Add keepalive_timeout parameter to _run_gunicorn_server method
- Configure Gunicorn's keepalive setting (defaults to 90s if not specified)
- Update --keepalive_timeout CLI help text to document both Uvicorn and Gunicorn behavior
- Pass keepalive_timeout from run_server to _run_gunicorn_server

Tests:
- Add test to verify keepalive_timeout flag is properly passed to Gunicorn
- Add test to verify default 90s timeout when flag is not specified

Co-Authored-By: lizhen921 <294474470@qq.com>
Signed-off-by: Kris Xia <xiajiayi0506@gmail.com>

---------

Signed-off-by: Kris Xia <xiajiayi0506@gmail.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: lizhen921 <294474470@qq.com>
2026-01-16 03:32:59 +05:30
VikashandGitHub c619569604 Added ability to customize logfire base url through env var (#19148)
* Added ability to customize logfire base url through env var

* Added test to check if env var is used correctly for logfire

* Document the env var

* Documented env var in config_settings.md
2026-01-16 00:10:59 +05:30
Sameer Kankute 8c454eb74f Fix: mock test tests 2026-01-15 22:02:51 +05:30
Sameer Kankute 83e33944ef Fix: mock test tests 2026-01-15 22:02:42 +05:30
Sameer Kankute 890fa85a33 Fix: response enterprise tests 2026-01-15 21:25:22 +05:30
Sameer Kankute b4ee1b2589 Fix: response enterprise tests 2026-01-15 19:53:04 +05:30
Sameer Kankute 4bdda9cc28 Fix: tests/test_litellm/proxy/test_proxy_server.py::test_embedding_input_array_of_tokens 2026-01-15 19:46:35 +05:30
Sameer Kankute f28d951202 Fix: tests/test_litellm/proxy/test_litellm_pre_call_utils.py::test_embedding_header_forwarding_with_model_group 2026-01-15 19:41:16 +05:30
Sameer Kankute 3af994a32a Fix: test router 2026-01-15 19:21:31 +05:30