tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-10 16:22:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
23,860 Commits 2,072 Branches 1,425 Tags
70ddde22159db912f6eb4e0c4ea9d8ef3bdd4ebf
Commit Graph
23860 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff 70ddde2215 fix - remove dup model entries 2025-08-07 13:22:00 -07:00
Ishaan Jaff d9f9465bc2 fix models by provider 2025-08-07 13:20:28 -07:00
Ishaan Jaff b7ced315dd fix - publish new PIP / prisma migrations 2025-08-07 13:18:45 -07:00
Ishaan JaffandGitHub 08ac2aeb6d Revert "Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703)" (#13387) 
This reverts commit a752d7acc9.
 2025-08-07 13:13:05 -07:00
Ishaan JaffandGitHub 2e767c8faf [Feat] add azure/gpt-5 model family (#13385) 
* add azure/gpt-5 model family

* add azure gpt-5 model family

* fixes for gpt-5

* add azure/gpt-5 model family
 2025-08-07 12:50:37 -07:00
Ishaan JaffGitHubCole McIntosh
 		087a1a622c feat: Add GPT-5 model family with official OpenAI specifications (#13… (#13386) 
* feat: Add GPT-5 model family with official OpenAI specifications (#13378)

* Add GPT-5 model family support

Added four new GPT-5 models:
- gpt-5: Flagship model for logic and multi-step tasks
- gpt-5-mini: Cost-sensitive version for budget use cases
- gpt-5-nano: Speed-optimized version for low latency
- gpt-5-chat: Enterprise-focused version for advanced conversations

* Update GPT-5 models with official OpenAI specifications

- Add gpt-5-chat-latest with 400k context, 128k output tokens
- Add gpt-5-2025-08-07 with enhanced reasoning capabilities
- Add gpt-5-mini-2025-08-07 with cost-optimized pricing
- Add gpt-5-nano-2025-08-07 with ultra-fast performance
- Update existing gpt-5, gpt-5-mini, gpt-5-nano to match dated versions
- All models now support reasoning tokens and 400k context window
- Pricing updated per official OpenAI documentation

* fix conflicts

---------

Co-authored-by: Cole McIntosh <82463175+colesmcintosh@users.noreply.github.com>
 2025-08-07 11:58:37 -07:00
Ishaan JaffandGitHub 729e1f530a feat - add claude-opus-4-1 on cost map (#13384) 2025-08-07 11:52:44 -07:00
Low Jian ShengandGitHub 9e0ba10f23 Add GPT 5 models (#13377) 
* add gpt 5 modesl

* update max tokens
 2025-08-07 11:36:16 -07:00
Ishaan JaffandGitHub 4d941c914e [Feat] Responses API Session Handling - Multi media support (#13347) 
* rename ResponsesSessionHandler

* use ResponsesSessionHandler

* test session handler

* refactor ResponsesSessionHandler

* fix get_proxy_server_request_from_spend_log

* use constant for LITELLM_TRUNCATED_PAYLOAD_FIELD

* add _should_check_cold_storage_for_full_payload

* add get_class_type_for_custom_logger_name

* get_active_custom_logger_for_callback_name

* add get_proxy_server_request_from_cold_storage to CustomLogger

* add ColdStorageHandler

* start using cold storage integration

* add get_proxy_server_request_from_cold_storage

* fixes from manual testing

* s3 v2 fix getting region name

* ChatCompletionImageUrlObject

* use _get_configured_cold_storage_custom_logger

* fixes for _should_check_cold_storage_for_full_payload

* fix _download_object_from_s3

* test_s3_v2_with_cold_storage

* add cold_storage_object_key to StandardLoggingMetadata

* use get_proxy_server_request_from_cold_storage_with_object_key

* add cold_storage_object_key to SpendLogsMetadata

* add cold_storage_object_key

* get_proxy_server_request_from_cold_storage_with_object_key

* use get_proxy_server_request_from_cold_storage_with_object_key

* test responses API

* add get_proxy_server_request_from_cold_storage_with_object_key

* session handler fixes

* test session handler

* fix ruff checks

* _download_object_from_s3

* cleanup

* test

* lint fix

* test_e2e_cold_storage_successful_retrieval

* test_e2e_generate_cold_storage_object_key_successful

* test_async_gcs_pub_sub_v1

* test fix

* test fix

* test fix

* test_standard_logging_metadata_has_cold_storage_object_key_field

* test_sanitize_request_body_for_spend_logs_payload_basic

* test_transform_input_image_item_to_image_item_with_image_data
 2025-08-07 10:59:53 -07:00
breno-aumoandGitHub e8b4b25774 Update OCI docs (#13336) 
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs
 2025-08-07 09:45:17 -07:00
unique-jakubandGitHub f58807ff6e Add labels to migrations job template (#13343) 
* set labels on the migration job

* update comment to retrigger the pipeline
 2025-08-07 09:41:24 -07:00
Anand KhinvasaraandGitHub 96dca4eff8 fix: 12152 - Redacted sensitive information logged in bedrock guardrails (#13356) 2025-08-07 08:42:11 -07:00
Edward D'AmatoandGitHub 30fc5b871c feat(integrations): allow setting of braintrust callback base url (#13368) 
* feat(integrations): allow setting of braintrust callback base url

* chore(misc): remove extra additions due to merge
 2025-08-07 08:40:11 -07:00
tanjiroandGitHub 7d978f0ffc provider logos on usage page (#13372) 2025-08-07 07:41:30 -07:00
Ishaan Jaff dfada882f1 vtx test fix gemini-2.5-flash-lite 2025-08-07 00:11:10 -07:00
Ishaan JaffandGitHub 9c5e9d7362 add groq/openai/gpt-oss (#13363) 2025-08-07 00:08:18 -07:00
Jugal D. BhattandGitHub 043c12b11e added token breakdown in ui (#13357) 2025-08-06 19:03:58 -07:00
Jugal D. BhattandGitHub b7325f4765 [MCP Gateway] Added route check for internal users (#13350) 
* added route check

* fix ruff
 2025-08-06 15:32:21 -07:00
Jugal D. BhattandGitHub c3cc10387e added new migration files (#13345) 2025-08-06 13:12:39 -07:00
yeahyungandGitHub a92bf8173e Fix create, search vector store error (#13285) 
* (#13284) add avector_store_create to route_type which doesn't require model

* (#13284) exclude hidden params in metadata when create vector store

* (#13284) fix lint error

* (#13284) keep metadata None if metadata is None(not empty dict)

* (#13284) add test code

* (#13284) change test code name

* (#13284) add avector_store_search to route_type which doesn't require model
 2025-08-06 11:15:17 -07:00
Jugal D. BhattandGitHub b1a8968895 [MCP Gateway] fix auth on ui for bearer servers (#13312) 
* fix auth on ui for bearer servers

* add tests and fixes

* fix tests
 2025-08-06 09:46:10 -07:00
Ishaan JaffandGitHub 28a894cb06 [Feat] - New model - Add Bedrock gpt oss models - "openai.gpt-oss-20b-1:0", "openai.gpt-oss-120b-1:0" (#13342) 
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input
 2025-08-06 09:24:04 -07:00
Ishaan Jaff eeed03a78f test fix: gcp deprecated gemini-1.5-flash 2025-08-06 08:43:45 -07:00
Cole McIntoshandGitHub 596592599a feat: Add logo customization for LiteLLM admin UI (#12958) 
* feat: Add logo customization for LiteLLM admin UI

- Add simple logo customization page under Settings > UI Theme
- Support custom logo URL with instant preview
- Clean reset to default functionality
- Wrap app with ThemeProvider for proper context
- Backend properly handles null/empty logo URLs

* style: Update save button to use indigo color and 'Save Changes' text for consistency

* fix: Restore CloudZero background job initialization

Address PR review feedback by restoring the _initialize_spend_tracking_background_jobs method
that handles both CloudZero and Prometheus background job initialization. This ensures
critical spend tracking functionality is not lost while preserving the logo customization feature.

Changes:
- Restore _initialize_spend_tracking_background_jobs method
- Replace inline Prometheus initialization with proper method call
- Maintain CloudZero background job setup for cost tracking
 2025-08-06 08:10:08 -07:00
Krrish Dholakia f74d9f1963 fix(pyproject.toml): fix version 2025-08-05 22:03:47 -07:00
Krish DholakiaandGitHub 0da25fadc0 Exclude none fields on /chat/completion - fixes n8n bug + Allow calling /v1/models when end user over budget (#13320) 
* fix(proxy_server.py): exclude none fields before returning

Fixes https://github.com/BerriAI/litellm/issues/13055

* test: add unit tests

* feat(auth_checks.py): allow info routes to work when end user over budget

Fixes https://github.com/BerriAI/litellm/issues/13286
 2025-08-05 21:39:46 -07:00
zjx20andGitHub 92c525ddfe feat(JinaAI): support multimodal embedding models (#13181) 
* feat(JinaAI): support multimodal embedding models

* add test case

* add test

* fix test
 2025-08-05 19:21:56 -07:00
Krish DholakiaandGitHub 324cfe8bdc fix(streaming_handler.py): include cost in streaming usage object (#13319) 
Fixes https://github.com/BerriAI/litellm/issues/12689
 2025-08-05 18:38:31 -07:00
Krrish Dholakia 2e3f564a39 fix: fix map 2025-08-05 18:33:36 -07:00
Ishaan Jaff 50c4a32c7d docs claude-opus-4-1-20250805 2025-08-05 18:02:22 -07:00
Ishaan Jaff 4c1adeaf67 bump: version 1.75.1 → 1.75.2 2025-08-05 17:53:15 -07:00
Krrish Dholakia 352b7ae913 build(model_prices_and_context_window.json): add vertex ai claude-opus-4.1 
Add claude opus 4.1
 2025-08-05 17:52:35 -07:00
Ishaan Jaff da40b5ec47 bump litellm enterprise 2025-08-05 17:50:40 -07:00
Ishaan Jaff 0308a835b8 bump: version 0.1.17 → 0.1.18 2025-08-05 17:47:16 -07:00
Jugal D. BhattandGitHub b6fcda2f8a [LLM Translation] Fix model group on clientside auth with API calls (#13314) 
* fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses

* fix the client side auth to use correct metadata

* add more tests

* fix tests
 2025-08-05 17:46:47 -07:00
Ishaan JaffandGitHub b455ada161 [Bug Fix] [Bug]: New Databricks Foundation Models databricks-gpt-oss-20b and databricks-gpt-oss-120b failed with error: litellm.APIConnectionError: 'signature' (#13318) 
* test_transform_choices_without_signature

* fix ChatCompletionThinkingBlock

* extract_reasoning_content
 2025-08-05 17:46:40 -07:00
Ishaan JaffandGitHub dab8ba03e3 [Feat] - When using custom tags on prometheus allow using wildcard patterns (#13316) 
* _tag_matches_wildcard_configured_pattern

* test_get_custom_labels_from_tags_wildcard_patterns

* docs Custom Tags

* docs how custom tags work

* fix
 2025-08-05 17:46:13 -07:00
Ishaan JaffandGitHub 0ccc493455 [Bug]: Fix Mimetype Resolution Error in Bedrock Document Understanding (#13309) 
* fix _validate_format for BedrockImageProcessor

* add test

* fix _validate_format for bedrock

* _get_document_format

* test_bedrock_get_document_format_fallback_mimes

* fix: add fallback method for mime type detection
 2025-08-05 17:07:10 -07:00
Jugal D. BhattandGitHub b2146713e5 refactor mcp guardrails (#13238) 2025-08-05 16:26:36 -07:00
tanjiroandGitHub 2399fd49ab fix for baseurl ending with / (#13289) 2025-08-05 16:14:59 -07:00
Jugal D. BhattandGitHub 8b2478e7d6 [Proxy server] Add apscheduler log suppress (#13299) 
* Add log suppress

* Add log suppress
 2025-08-05 15:04:51 -07:00
Jugal D. BhattandGitHub 7524aa386c [Redis IAM] Change documentation (#13306) 
* change docs

* addde note
 2025-08-05 15:04:46 -07:00
Ishaan Jaff 475aa06117 anthropic.claude-opus-4 2025-08-05 14:08:21 -07:00
Jugal D. BhattandGitHub 32501c85f5 fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses (#13293) 2025-08-05 13:16:16 -07:00
tanjiroandGitHub fd92f3eaf1 team req for service acc (#13302) 2025-08-05 13:01:54 -07:00
Ishaan JaffandGitHub 2eef77d960 add fireworks gpt-oss-20b (#13303) 2025-08-05 12:30:09 -07:00
Ishaan JaffandGitHub 0db13acdc7 New models - add fireworks_ai/glm-4p5 model family (#13297) 
* add fireworks_ai/glm-4p5

* fix max output tokens
 2025-08-05 12:08:42 -07:00
Ishaan JaffandGitHub cc5c7aba03 [New model] add bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 (#13295) 
* add us.anthropic.claude-opus-4-1-20250805-v1:0 bedrock model

* fix BEDROCK_CONVERSE_MODELS
 2025-08-05 11:56:47 -07:00
Jugal D. BhattandGitHub 1b9dd9daee claude opus 4.1 support for anthropic provider (#13296) 2025-08-05 11:56:10 -07:00
Jugal D. BhattandGitHub 609fa9f5ca [LLM Translation + Coding tools] Added litellm claude code count tokens support (#13261) 
* Added litellm claude code count tokens support

* fix mypy

* create helper

* Revert construct

* revert construct

* fix return

* Add reutrn none

* change to factory approach

* refactor to BaseModelInfo

* enum fix
 2025-08-05 10:57:24 -07:00