tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-19 06:18:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,900 Commits 2,072 Branches 1,425 Tags
d918c7b8a3052cb5e0fcddc5d466cd8ba2ea4aa8
Commit Graph
28900 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
yuneng-jiangandGitHub d918c7b8a3 Merge pull request #18071 from BerriAI/litellm_ui_hide_add_models 
[Feature] UI - Add Models Conditional Rendering
 2025-12-16 11:38:50 -08:00
yuneng-jiang 975edbcab2 Fixing build 2025-12-16 11:26:45 -08:00
yuneng-jiang 0487c610b8 Add Model Tab Visibility Changes 2025-12-16 11:25:43 -08:00
Alexsander HamirandGitHub f177e4f1a3 [Refactor] litellm/init.py: lazy load encoding from main.py (#18070) 
- Add __getattr__ in main.py to lazy load encoding when accessed
- Remove direct assignment of encoding = tiktoken.get_encoding() at module level
- Heavy tiktoken.get_encoding() call is now deferred until encoding is first accessed
- Follows existing lazy loading patterns
- All existing code using litellm.encoding continues to work
 2025-12-16 11:19:59 -08:00
Alexsander HamirandGitHub 014c74fd06 [Refactor] litellm/init.py: lazy-load AmazonConverseConfig (#18069) 
- Add LLM_CONFIG_NAMES tuple and _lazy_import_llm_configs function in _lazy_imports.py
- Remove direct import of AmazonConverseConfig from __init__.py
- Add lazy loading handler in __getattr__ to dispatch LLM config imports
- Add type stub for AmazonConverseConfig in TYPE_CHECKING block
- Add test_llm_config_lazy_imports test to verify lazy loading works
- Follows same pattern as DOTPROMPT_NAMES for consistency
 2025-12-16 10:48:11 -08:00
Alexsander HamirandGitHub 8be2eac816 add warning about library imported on litellm/init (#18066) 2025-12-16 09:36:24 -08:00
Sameer KankuteandGitHub 2b495f84ab Merge pull request #18025 from BerriAI/litellm_staging_12_16_2025 
Litellm staging 12 16 2025
 2025-12-16 22:31:39 +05:30
Alexsander HamirandGitHub 06a499ccd0 [Refactor] litellm/init.py: lazy-load heavy client decorator imports (#18064) 2025-12-16 08:21:07 -08:00
Sameer KankuteandGitHub 343319889c Merge pull request #18063 from BerriAI/revert-17970-fix/auth-passthrough-enhancements 
Revert "Fix get_model_from_request() to extract model ID from Vertex AI passthrough URLs"
 2025-12-16 21:44:40 +05:30
Sameer KankuteandGitHub 3661f8010f Revert "fix(proxy): extract model from vertex ai passthrough url pattern (#17…" 
This reverts commit ae7c994526.
 2025-12-16 21:44:10 +05:30
Sameer KankuteandGitHub 20bdada900 Merge pull request #18046 from BerriAI/litellm_fix_managed_files_endpoint 
Fix managed files endpoint
 2025-12-16 21:39:34 +05:30
Sameer KankuteandGitHub 8864c6937c Merge pull request #18031 from BerriAI/litellm_anthropic_claude_skills_int 
Add support for agent skills in chat completion
 2025-12-16 21:39:11 +05:30
Sameer KankuteandGitHub 215857cce3 Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
Sameer Kankute 755f024087 remove print statments 2025-12-16 21:37:09 +05:30
Sameer KankuteandGitHub fc5c5d4dbe Merge pull request #18042 from BerriAI/litellm_embedding_default_omit 
fix: Add none to encoding_format instead of omitting it
 2025-12-16 21:35:29 +05:30
Sameer KankuteandGitHub abfa869030 Merge pull request #18049 from BerriAI/litellm_bedrock_ttl_issue 
Remove ttl field when routing to bedrock
 2025-12-16 21:34:57 +05:30
Sameer KankuteandGitHub 616417eaaa Merge pull request #18037 from BerriAI/litellm_fix_vertex_ai_headers 
fix: skip adding beta headers for vertex ai as it is not suppported
 2025-12-16 21:33:35 +05:30
Sameer KankuteandGitHub de5471e3cd Merge pull request #18036 from BerriAI/litellm_fix_responses_headers 
Add custom headers in responses API
 2025-12-16 21:30:59 +05:30
Sameer Kankute f23f157556 fix error: Incompatible types (expression has type dict[Any, Any] 2025-12-16 21:27:42 +05:30
Mateo Di LoretoandGitHub 107ea9043a [Feature] Download Prisma binaries at build time instead of at runtime for Security Restricted environments (#17695) 
* Use config file to enable prometheus metrics

* Revert "Use config file to enable prometheus metrics"

This reverts commit 15ae36e1711791c0ac0a7aa84dcec142951717f5.

* Improve hardened stack and Prisma offline flow

* Document hardened compose usage

* Remove undesired change in fastapi-sso

* Restore dashboard lockfile

* Remove unecessary tempdirs

* Document hardened/offline Docker validation flow
 2025-12-16 21:25:53 +05:30
Alexsander HamirandGitHub 8f976df651 [Refactor] litellm/init.py: lazy load default encoding from client decorator (#18059) 2025-12-16 07:45:24 -08:00
Alexsander HamirandGitHub f8168f5063 [Refactor] litellm/init.py: lazy load dotprompt integration (#18056) 2025-12-16 07:18:11 -08:00
Alexsander HamirandGitHub feb6924efe [Refactor] litellm/init.py: lazy load .types.utils (#18054) 2025-12-16 06:42:17 -08:00
Alexsander HamirandGitHub ea06fb70fb refactor: lazy load bedrock types (#18053) 2025-12-16 06:05:01 -08:00
Alexsander HamirandGitHub 6ca812130b [Refactor] litellm/init.py: lazy load LLMClientCache (#18008) 2025-12-16 05:44:06 -08:00
Sameer Kankute 0931d50461 Fix code quality check litellm_staging_12_16_2025 2025-12-16 16:30:41 +05:30
Sameer Kankute 6ccfb8b45e Remove ttl fiedl when routing to bedrock 2025-12-16 16:20:19 +05:30
Krish DholakiaGitHubCursor Agent
 		e31d8a1cf6 Router order parameter documentation (#18045) 
* feat: Add deployment ordering for load balancing

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor docs to simplify load balancing and deployment ordering explanations

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2025-12-16 15:57:05 +05:30
Sameer Kankute 6a3f0a8baf Add output file id in managed objects for batches 2025-12-16 15:52:07 +05:30
Sameer Kankute 3222b4e3a8 Add batch output file in managed table 2025-12-16 15:44:30 +05:30
Sameer Kankute 8ffffb4d15 Fix model getting twice 2025-12-16 15:43:55 +05:30
Nicolai van der SmagtandGitHub 09ba89d4fe fix: add headers to metadata for guardrails on pass-through endpoints (#17992) 
Fixes #17477

Guardrails couldn't access request headers (like User-Agent) on Bedrock
pass-through endpoints because headers were only stored in
data["proxy_server_request"]["headers"] but not in data["metadata"]["headers"]
where guardrails typically look for them.

This fix adds headers to metadata in add_litellm_data_to_request() so
guardrails can access User-Agent, API keys, and other header-based checks
on all endpoints including Bedrock pass-through.

Test added to verify headers are available in metadata for guardrails.
 2025-12-16 13:41:34 +05:30
Sameer Kankute dbcae4aca5 fix: Add none to encoding_format instead of omitting it 2025-12-16 13:23:15 +05:30
Sameer Kankute 4c482186cd remove is_vertex param from request 2025-12-16 12:00:37 +05:30
Sameer Kankute 7a5e49a328 fix: skip adding beta headers for vertex ai as it is not suppported 2025-12-16 11:56:46 +05:30
Sameer Kankute 85907cebb5 Add custom headers in responses API 2025-12-16 11:31:15 +05:30
Krrish Dholakia 5e78ffd5fd fix: fix docker compose quick start 2025-12-16 11:26:38 +05:30
Krrish Dholakia 6041155de0 docs: cleanup 2025-12-16 11:21:41 +05:30
Sameer Kankute 1222d9e376 Add doc and tests for agent skils 2025-12-16 10:20:21 +05:30
Sameer Kankute bcfc77f683 Add beta headers for claude skills 2025-12-16 10:12:36 +05:30
Sameer Kankute 9802a6a19e Add container field in streaming response 2025-12-16 10:02:07 +05:30
yuneng-jiangandGitHub 0b5317c12b Merge pull request #18030 from BerriAI/litellm_ui_milvus 
[Feature] UI - Milvus Vector Store
 2025-12-15 20:22:38 -08:00
Krish DholakiaandGitHub 23e70dd90b Litellm dev 12 15 2025 p1 (#18028) 
* fix(openai/responses/guardrail_translation): fix basemodel import

ensures /v1/responses output is correctly processed by guardrail handler

* fix: fix linting error

* fix: fix linting errors
 2025-12-16 09:48:49 +05:30
yuneng-jiang 0eba879179 Add ability to add embedding model for milvus 2025-12-15 20:12:44 -08:00
Ishaan JaffandGitHub 244d83ff47 [Docs] Litellm add docs vertex ai engine (#18027) 
* new provider doc

* add to sidebar

* stash docs

* docs fix

* docs vertex agent engine
 2025-12-15 20:11:40 -08:00
Eric84626andGitHub 50606bf090 Added new step into rotate master key function for processing credentials table (#17952) 
* fix: Return 403 exception when calling GET responses api

* fix: added new step into rotate master key function for processing credentials table
 2025-12-16 09:40:22 +05:30
Cesar GarciaGitHubKrish Dholakia
 		13c0ab8985 Cleanup PR template: remove redundant fields (#17956) 
- Remove Title section (already in PR title)
- Remove screenshot requirement (CI validates tests)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
 2025-12-16 09:39:22 +05:30
Cesar GarciaandGitHub cd9b71093a Improve issue labeling: add component dropdown and more provider keywords (#17957) 
- Replace "ML Ops Team" dropdown with "What part of LiteLLM is this about?"
  with options: SDK, Proxy, UI Dashboard, Docs, Other
- Add component dropdown to feature_request.yml template
- Rename label-mlops.yml to label-component.yml and update to auto-label
  issues with sdk, proxy, ui-dashboard, or docs based on selection
- Add more provider keywords to issue-keyword-labeler: gemini, cohere,
  mistral, groq, ollama, deepseek
 2025-12-16 09:38:39 +05:30
Sameer Kankute e40ad5203e Add container field as provider specific field 2025-12-16 09:28:04 +05:30
Ishaan JaffandGitHub ce113f4e4b [Docs] Add docs on using pydantic ai agents with LiteLLM A2a gateway (#18026) 
* init A2AProviderConfigManager

* move file

* move file

* add pydnatic ai folder

* init providers

* test_pydantic_ai_non_streaming

* fix import

* INIT pydantic

* use_a2a_form_fields

* test_vertex_agent_engine_streaming

* add agent_engine

* init transform for agent engine

* init agent engine

* VertexAgentEngineSSEStreamIterator

* sample

* ui add new fields

* fix vertex_credentials

* working SSE iterator

* TestVertexAgentEngineTransformRequest

* fix code QA check

* stash docs

* docs fix

* fix logo

* docs fix

* doc pydantic ai

* docs pydantic ai

* new provider

* docs fix
 2025-12-15 19:43:12 -08:00