Ishaan Jaffer
31e38efc8a
Revert "bump v extras"
...
This reverts commit c4838e730c
2025-09-24 22:12:13 -07:00
Ishaan Jaffer
b1e56c55ad
merge
2025-09-24 22:11:37 -07:00
Ishaan Jaffer
1585750c1b
test fix
2025-09-24 21:45:42 -07:00
Ishaan Jaffer
c4838e730c
bump v extras
2025-09-24 21:42:05 -07:00
Ishaan Jaff and GitHub
ded823a3a3
[Feat] Initial support for scheduled key rotations ( #14877 )
...
* add KeyRotationSettings
* add KeyRotationManager
* add key rotation manager
* add KeyRotationManager
* fix _initialize_spend_tracking_background_jobs
* fix add_key_rotation_fields
* fixes
* new fields in schema
* update schema
* fix fixes for init key rotation manager
* fixes for init key rotation manager
* fix KeyRotationManager
* tests for key rotation
* fix key_rotation_settings
* fix KeyRotationManager
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix fixes for init key rotation manager
* ruff check fix
* fix LITELLM_KEY_ROTATION_CHECK_INTERVAL_SECONDS
* fix _initialize_spend_tracking_background_jobs
* docs fix
* docs auto rotate
* schema fix
* bump proxy extras
* fix config.yml
2025-09-24 21:37:56 -07:00
Ishaan Jaffer
a0e4707782
Revert "Added missing dependencies ( #14706 )"
...
This reverts commit b33d52c6e1
2025-09-24 21:36:57 -07:00
Ishaan Jaffer
ba1cd3f0d2
Revert "feature: generic object pool ( #14702 )"
...
This reverts commit 60800698f2
2025-09-24 21:36:49 -07:00
Ishaan Jaff and GitHub
d9bf6a8c53
Revert "Fix: make pondpond as optional dependency for proxy extras, disab…" ( #14880 )
...
This reverts commit e75d8b711e
2025-09-24 21:34:42 -07:00
Alex Shoop and GitHub
e75d8b711e
Fix: make pondpond as optional dependency for proxy extras, disable object pooling gracefully ( #14863 )
...
* pondpond optional dep proxy extra
* lock
2025-09-24 17:09:30 -07:00
Krrish Dholakia
df88b0656e
test: update .json
2025-09-24 16:13:51 -07:00
268b66b7ea
Bump tar-fs from 3.0.10 to 3.1.1 in /docs/my-website ( #14872 )
...
Bumps [tar-fs](https://github.com/mafintosh/tar-fs ) from 3.0.10 to 3.1.1.
- [Commits](https://github.com/mafintosh/tar-fs/compare/v3.0.10...v3.1.1 )
---
updated-dependencies:
- dependency-name: tar-fs
dependency-version: 3.1.1
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-09-24 16:13:13 -07:00
Ishaan Jaffer
66a88d3761
fix ci/cd
2025-09-24 11:55:34 -07:00
1816176f9d
[Memory Leak Fix] Fix InMemoryCache unbounded growth when TTLs are set ( #14869 )
...
* Initial plan
* Fix InMemoryCache unbounded growth issue when TTLs are set
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com >
2025-09-24 11:54:06 -07:00
3f5b4c84eb
feat: Add /user/list route to LiteLLMRoutes ( #14868 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-09-24 11:21:14 -07:00
Ishaan Jaff and GitHub
c69bac991b
[Fix] LakeraAI v2 Guardrail - Ensure exception is raised correctly ( #14867 )
...
* fix exception lakera
* test lakera ai v2
* ruff fix
2025-09-24 10:55:56 -07:00
Luis Felipe Salazar Ucros and GitHub
c6cb36186c
Add sambanova deepseek v3.1 and gpt-oss-120b ( #14866 )
...
* add sambanova deepseek v3.1 and gpt-oss-120b
* add sambanova deepseek v3.1 and gpt-oss-120b
2025-09-24 10:54:22 -07:00
Mubashir Osmani and GitHub
0cd91a82d2
Added vertex_ai/qwen models and azure/gpt-5-codex ( #14844 )
...
* added qwen models and gpt-5-codex
* fix flaky test
* fix failing test
2025-09-24 10:40:00 -07:00
onlylonly and GitHub
22eef373eb
feat: New model - Add support for Qwen models family & Deepseek 3.1 to Amazon Bedrock ( #14845 )
...
* New model - Add Bedrock deepseek v3.1 model - "deepseek.v3-v1:0"
* New model - Add Bedrock Qwen models - "qwen.qwen3-coder-480b-a35b-v1:0", "qwen.qwen3-235b-a22b-2507-v1:0", "qwen.qwen3-coder-30b-a3b-v1:0", "qwen.qwen3-32b-v1:0"
* fix: add "deepseek.v3-v1:0" in litellm/model_prices_and_context_window_backup.json
2025-09-24 09:58:23 -07:00
Franklin and GitHub
e437273ad5
doc: make the README document clearer ( #14860 )
...
* Update README.md
* Update README.md
2025-09-24 09:57:21 -07:00
Krish Dholakia and GitHub
1049c50d6c
Merge pull request #10955 from fabriciojoc/LangfuseUsageDetails
...
Adding langfuse usage details for cached tokens
2025-09-24 09:24:33 -07:00
Fabrício Ceschin and GitHub
5eb32e0c24
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-24 09:43:43 -04:00
Krish Dholakia and GitHub
d2f8787bdc
Merge pull request #14808 from eycjur/fix_load_credentials_in_token_counter_proxy
...
Fix load credentials in token counter proxy
2025-09-23 23:00:34 -07:00
Krish Dholakia and GitHub
2e3e7de2eb
Merge pull request #14816 from leventov/no-streaming-logging
...
Fix concurrency/scaling when many Python threads do streaming using *sync* completions
2025-09-23 22:53:18 -07:00
Krish Dholakia and GitHub
37ea89eff0
Merge pull request #14821 from hazyone/fix-13380
...
Fix: support claude code auth via subscription (anthropic)
2025-09-23 22:52:32 -07:00
Krish Dholakia and GitHub
aede742db5
Merge pull request #14818 from akshoop/akshoop/fastuuid-dep-make-optional
...
Fix: make `fastuuid` an optional dependency for `proxy`, graceful fallback to stdlib `uuid`
2025-09-23 22:51:10 -07:00
Krish Dholakia and GitHub
d59dec39d0
Merge pull request #14826 from Jetemple/sso-clear-button-fix
...
fix: SSO "Clear" button writes empty values instead of removing SSO config
2025-09-23 22:49:47 -07:00
Sameer Kankute and GitHub
e132ad63f1
Merge pull request #14164 from TomeHirata/citation-supported-text-3
...
Add supported text field to anthropic citation response
2025-09-24 10:30:44 +05:30
Ishaan Jaff and GitHub
f4ecf3ca72
[Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway ( #14836 )
...
* fix: error msg from updating key
* fix _create_new_cli_key
* fix validate_key_team_change
* fix interface for chat
* ruff fix
* fix auth for keys
* get_litellm_gateway_api_key
* fix chat
* test fix
* linting fix
* fix mypy
* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer
e1b342604d
test vertex test_get_token_url
2025-09-23 19:34:50 -07:00
Alex Shoop
ab2bd2a50f
add check_fastuuid_usage.py script to check_code_and_doc_quality job
2025-09-24 10:45:59 +09:00
Alex Shoop
3573a36d71
isolated scope chngs
2025-09-24 10:33:39 +09:00
Alex Shoop and GitHub
c919996470
Merge branch 'main' into akshoop/fastuuid-dep-make-optional
2025-09-24 10:31:09 +09:00
Krish Dholakia and GitHub
e92a73d603
Merge pull request #14831 from otaviofbrito/minor/fix-context-caching-vertex
...
Vertex AI Context Caching: use Vertex ai API v1 instead of v1beta1 and accept 'cachedContent' param
2025-09-23 18:29:51 -07:00
Ishaan Jaffer
6964b5a67a
test humanloop
2025-09-23 18:28:27 -07:00
Alex Shoop
b6247d0d77
code cov test script check_fastuuid_usage.py
2025-09-24 10:27:22 +09:00
Krish Dholakia and GitHub
64a305f9dd
Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
...
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Krish Dholakia and GitHub
d5ced7e068
Merge pull request #14639 from danielmklein/main
...
fix: update sonnet 4 configs to reflect million-token context window pricing
2025-09-23 18:06:15 -07:00
Ishaan Jaffer
a48273740d
test fix
2025-09-23 17:46:09 -07:00
Ishaan Jaffer
ceb400eee9
Revert "Added model armor testing files basic"
...
This reverts commit 9d1878029d
2025-09-23 17:45:44 -07:00
Ishaan Jaffer
79a6feb7ac
generate_mock_mcp_server_config_record
2025-09-23 17:33:11 -07:00
Alexsander Hamir and GitHub
8b9bd9bdb6
fix: added oracle to provider's list ( #14835 )
2025-09-23 17:21:19 -07:00
Ishaan Jaffer
eb72990aa6
test_get_valid_models_with_cli_pattern
2025-09-23 16:46:40 -07:00
Mubashir Osmani and GitHub
fc1c39645a
docs: Letta Guide ( #14798 )
...
* fix: flaky passthrough tests
* Revert "fix: flaky passthrough tests"
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.
* fix: serialize prisma objects
* docs: added letta
* arranged endpoints in alphabetical order
* added user_api_key fields to custom auth docs
* user onboarding
* cleaning up
This reverts commit 40e2aade73632cea371c6092d766ba193f9ac4a3.
* cleaning up
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.
* Revert "fix: serialize prisma objects"
This reverts commit 1e7bd13c26dcac8bff1f818c39b2b78f22f0ba28.
2025-09-23 16:18:57 -07:00
fff1d1a9f9
Add Vertex AI Qwen3 models to pricing and context window ( #14828 )
...
Co-authored-by: Cursor Agent <cursoragent@cursor.com >
Co-authored-by: ishaan <ishaan@berri.ai >
2025-09-23 16:16:57 -07:00
Alexsander Hamir and GitHub
bd0741fa22
fix: cache root cause ( #14827 )
...
* fix: cache root cause
Ensure values are set and retrieved with the expected type to avoid unnecessary checks and cache misses.
fix: undoing hard changes
* fix: removed unexpected errors
* fix: removed unnecessary changes
2025-09-23 16:15:15 -07:00
Ishaan Jaffer
aaebd83f31
test fixes
2025-09-23 16:07:01 -07:00
Ishaan Jaff and GitHub
8443eff4a2
feat: add xai/grok-4-fast models ( #14833 )
2025-09-23 16:01:44 -07:00
Ishaan Jaffer
5fc70396ad
test fix
2025-09-23 15:50:11 -07:00
Ishaan Jaff and GitHub
e0526c4554
[Fix] Priority Reservation: keys without priority metadata receive higher priority than keys with explicit priority configurations. ( #14832 )
...
* add PriorityReservationSettings
* add priority_reservation_settings
* add _get_priority_weight
* docs update
2025-09-23 15:45:05 -07:00
Ishaan Jaffer
7e64df92a5
test_cli_sso_callback_regenerate_existing_key
2025-09-23 15:42:07 -07:00
Ishaan Jaffer