Commit Graph
28928 Commits
Author SHA1 Message Date
yuneng-jiangandGitHub 9faee8bba6 Merge pull request #17989 from Jetemple/non-root-ui-path-fix
fix: update UI path handling for non-root Docker and restructure HTML…
2025-12-16 21:57:31 -08:00
Sameer KankuteandGitHub d547b43beb Merge pull request #18107 from BerriAI/litellm_add_gpt_1.5_image
Add gpt-image-1.5-2025-12-16 in model cost map
2025-12-17 11:24:12 +05:30
Sameer Kankute 8f7ea945f1 add cached token pricing 2025-12-17 11:20:00 +05:30
Sameer Kankute fabd832a39 Add gpt-image-1.5-2025-12-16 in model cost map 2025-12-17 11:16:22 +05:30
0e2fd78ccc Update GCS bucket logging links to new observability docs (#18104)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-12-17 08:18:53 +04:00
yuneng-jiangandGitHub 1c5f16fb6e Merge pull request #18034 from BerriAI/litellm_ui_spend_logs_overhead
[Feature] UI -  Show LiteLLM Overhead in Logs
2025-12-16 14:52:26 -08:00
yuneng-jiangandGitHub f316caa088 Merge pull request #18033 from BerriAI/litellm_ui_logs_overhead
[Feature] Add LiteLLM Overhead to Logs
2025-12-16 14:51:50 -08:00
Ishaan Jaffer cdcbccb30d fix interactions API 2025-12-17 02:28:38 +04:00
Ishaan Jaffer 53b47289ce init interactions API 2025-12-17 02:27:54 +04:00
Ishaan Jaffer f80628502d init docs 2025-12-17 02:27:54 +04:00
Ishaan Jaffer 0052953fc9 docs init 2025-12-17 02:27:54 +04:00
YutaSaitoandGitHub 20cd637f74 Merge pull request #18082 from BerriAI/docs/vault_mount
docs: add documentation describing configurable Hashicorp Vault mount…
2025-12-17 07:24:34 +09:00
Jorge Yero SalazarandGitHub 48a3a741e5 Allow base_model for non Azure providers in proxy (#18038)
* Allow base_model for non Azure providers in proxy

* Add tests
2025-12-17 02:24:12 +04:00
Yuta Saito c3d6f8b900 docs: add documentation describing configurable Hashicorp Vault mount and path options 2025-12-17 07:23:30 +09:00
Ishaan JaffandGitHub 424363fb1d [Feat] Add New Google Interactions API on AI Gateway (#18081)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate

* add google interctions routes

* init interactions api

* init interactions api

* new routes

* fix config

* working streaming interactons api
2025-12-17 02:20:23 +04:00
Ishaan JaffandGitHub c727c8216f [Feat] New Endpoint - Google Interactions API - added on litellm SDK (#18079)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate
2025-12-17 02:18:51 +04:00
codgicianandGitHub 58e081b6e0 feat: add github_copilot model info (#17858) 2025-12-17 02:15:13 +04:00
yuneng-jiang c2f79681b6 Fixing test 2 2025-12-16 13:44:53 -08:00
Emerson GomesandGitHub 8df713b887 Add Azure DeepSeek V3.2 versions (#18019) 2025-12-17 01:01:57 +04:00
yuneng-jiang 0e5b56eddf Fixing tests 2025-12-16 12:51:44 -08:00
Ishaan JaffandGitHub 77b8004ab1 add brazil pii patterns (#18076) 2025-12-17 00:47:10 +04:00
Alexsander HamirandGitHub 233e89976a Lazy load OpenAILikeChatConfig to avoid heavy import (#18075)
- Remove direct import of OpenAILikeChatConfig from llms.openai_like.chat.handler
- Add OpenAILikeChatConfig to LLM_CONFIG_NAMES for lazy loading
- Add handler in _lazy_import_llm_configs() to lazy load when accessed
- Add OpenAILikeChatConfig to TYPE_CHECKING block for type hints

This defers the import until OpenAILikeChatConfig is actually needed, improving import time.
2025-12-16 12:43:42 -08:00
Alexsander HamirandGitHub 9b440caac2 Lazy load ImageEditRequestUtils in images/main.py to avoid heavy import (#18074)
- Remove direct import of ImageEditRequestUtils from images.utils
- Add __getattr__ handler to lazy load ImageEditRequestUtils when accessed
- Create _get_ImageEditRequestUtils() helper function with caching
- Use importlib instead of sys to avoid importing sys inside functions
- Update image_edit() to use helper function for accessing ImageEditRequestUtils
- Add TYPE_CHECKING import for proper type hints

This defers the heavy import from images.utils until ImageEditRequestUtils is actually needed, improving import time when from .images.main import * is executed.
2025-12-16 12:28:33 -08:00
Alexsander HamirandGitHub 80d445a96f feat: lazy load GuardrailItem following existing patterns (#18072)
- Add TYPES_NAMES tuple and _lazy_import_types function in _lazy_imports.py
- Remove direct import of GuardrailItem from __init__.py
- Add lazy loading handler in __getattr__ to dispatch type imports
- Add type stub for GuardrailItem in TYPE_CHECKING block
- Add test_types_lazy_imports test to verify lazy loading works
- Use from __future__ import annotations for forward reference support
- Follows same pattern as DOTPROMPT_NAMES and LLM_CONFIG_NAMES for consistency
2025-12-16 11:48:36 -08:00
yuneng-jiangandGitHub d918c7b8a3 Merge pull request #18071 from BerriAI/litellm_ui_hide_add_models
[Feature] UI - Add Models Conditional Rendering
2025-12-16 11:38:50 -08:00
yuneng-jiang 975edbcab2 Fixing build 2025-12-16 11:26:45 -08:00
yuneng-jiang 0487c610b8 Add Model Tab Visibility Changes 2025-12-16 11:25:43 -08:00
Alexsander HamirandGitHub f177e4f1a3 [Refactor] litellm/init.py: lazy load encoding from main.py (#18070)
- Add __getattr__ in main.py to lazy load encoding when accessed
- Remove direct assignment of encoding = tiktoken.get_encoding() at module level
- Heavy tiktoken.get_encoding() call is now deferred until encoding is first accessed
- Follows existing lazy loading patterns
- All existing code using litellm.encoding continues to work
2025-12-16 11:19:59 -08:00
Alexsander HamirandGitHub 014c74fd06 [Refactor] litellm/init.py: lazy-load AmazonConverseConfig (#18069)
- Add LLM_CONFIG_NAMES tuple and _lazy_import_llm_configs function in _lazy_imports.py
- Remove direct import of AmazonConverseConfig from __init__.py
- Add lazy loading handler in __getattr__ to dispatch LLM config imports
- Add type stub for AmazonConverseConfig in TYPE_CHECKING block
- Add test_llm_config_lazy_imports test to verify lazy loading works
- Follows same pattern as DOTPROMPT_NAMES for consistency
2025-12-16 10:48:11 -08:00
Alexsander HamirandGitHub 8be2eac816 add warning about library imported on litellm/init (#18066) 2025-12-16 09:36:24 -08:00
Sameer KankuteandGitHub 2b495f84ab Merge pull request #18025 from BerriAI/litellm_staging_12_16_2025
Litellm staging 12 16 2025
2025-12-16 22:31:39 +05:30
Alexsander HamirandGitHub 06a499ccd0 [Refactor] litellm/init.py: lazy-load heavy client decorator imports (#18064) 2025-12-16 08:21:07 -08:00
Sameer KankuteandGitHub 343319889c Merge pull request #18063 from BerriAI/revert-17970-fix/auth-passthrough-enhancements
Revert "Fix get_model_from_request() to extract model ID from Vertex AI passthrough URLs"
2025-12-16 21:44:40 +05:30
Sameer KankuteandGitHub 3661f8010f Revert "fix(proxy): extract model from vertex ai passthrough url pattern (#17…"
This reverts commit ae7c994526.
2025-12-16 21:44:10 +05:30
Sameer KankuteandGitHub 20bdada900 Merge pull request #18046 from BerriAI/litellm_fix_managed_files_endpoint
Fix managed files endpoint
2025-12-16 21:39:34 +05:30
Sameer KankuteandGitHub 8864c6937c Merge pull request #18031 from BerriAI/litellm_anthropic_claude_skills_int
Add support for agent skills in chat completion
2025-12-16 21:39:11 +05:30
Sameer KankuteandGitHub 215857cce3 Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
Sameer Kankute 755f024087 remove print statments 2025-12-16 21:37:09 +05:30
Sameer KankuteandGitHub fc5c5d4dbe Merge pull request #18042 from BerriAI/litellm_embedding_default_omit
fix: Add none to encoding_format instead of omitting it
2025-12-16 21:35:29 +05:30
Sameer KankuteandGitHub abfa869030 Merge pull request #18049 from BerriAI/litellm_bedrock_ttl_issue
Remove ttl field when routing to bedrock
2025-12-16 21:34:57 +05:30
Sameer KankuteandGitHub 616417eaaa Merge pull request #18037 from BerriAI/litellm_fix_vertex_ai_headers
fix: skip adding beta headers for vertex ai as it is not suppported
2025-12-16 21:33:35 +05:30
Sameer KankuteandGitHub de5471e3cd Merge pull request #18036 from BerriAI/litellm_fix_responses_headers
Add custom headers in responses API
2025-12-16 21:30:59 +05:30
Sameer Kankute f23f157556 fix error: Incompatible types (expression has type dict[Any, Any] 2025-12-16 21:27:42 +05:30
Mateo Di LoretoandGitHub 107ea9043a [Feature] Download Prisma binaries at build time instead of at runtime for Security Restricted environments (#17695)
* Use config file to enable prometheus metrics

* Revert "Use config file to enable prometheus metrics"

This reverts commit 15ae36e1711791c0ac0a7aa84dcec142951717f5.

* Improve hardened stack and Prisma offline flow

* Document hardened compose usage

* Remove undesired change in fastapi-sso

* Restore dashboard lockfile

* Remove unecessary tempdirs

* Document hardened/offline Docker validation flow
2025-12-16 21:25:53 +05:30
Alexsander HamirandGitHub 8f976df651 [Refactor] litellm/init.py: lazy load default encoding from client decorator (#18059) 2025-12-16 07:45:24 -08:00
Alexsander HamirandGitHub f8168f5063 [Refactor] litellm/init.py: lazy load dotprompt integration (#18056) 2025-12-16 07:18:11 -08:00
Alexsander HamirandGitHub feb6924efe [Refactor] litellm/init.py: lazy load .types.utils (#18054) 2025-12-16 06:42:17 -08:00
Alexsander HamirandGitHub ea06fb70fb refactor: lazy load bedrock types (#18053) 2025-12-16 06:05:01 -08:00
Alexsander HamirandGitHub 6ca812130b [Refactor] litellm/init.py: lazy load LLMClientCache (#18008) 2025-12-16 05:44:06 -08:00
Sameer Kankute 0931d50461 Fix code quality check litellm_staging_12_16_2025 2025-12-16 16:30:41 +05:30