Commit Graph
30881 Commits
Author SHA1 Message Date
Yuta Saito c00d83fea2 feat: add support focus export 2026-01-08 16:48:06 +09:00
Sameer Kankute c78bf8cfcd Add support for model id in bedrock passthrough 2026-01-08 13:03:58 +05:30
Sameer Kankute 7e98843d97 Fix: Incomplete usage in response object passed 2026-01-08 10:57:07 +05:30
Sameer Kankute e5c3fcbb52 fix mypy tests 2026-01-08 10:48:14 +05:30
yuneng-jiang 4c645c1ce3 Endpoint usage POC 2026-01-07 21:01:41 -08:00
Sameer Kankute c4bab70306 Fix: Add moonshot in get_bedrock_model_id 2026-01-08 10:21:38 +05:30
Sameer Kankute 2a4dc8e041 Fix: aws creds getting passed in req 2026-01-08 10:18:15 +05:30
Sameer Kankute af6883712e Add tests for kimi 2 bedrock model 2026-01-08 10:07:33 +05:30
Sameer Kankute ddd52e0e2f Add support for kimi2 model on bedrock 2026-01-08 09:51:34 +05:30
Yuta Saito 3af9bab6a5 feat: add focus schema 2026-01-08 12:17:14 +09:00
Yuta Saito 565a622cf9 feat: scaffold Focus export logging skeleton 2026-01-08 12:09:58 +09:00
Benedikt Óskarsson d3fdac8468 chore: fix formatting error 2026-01-08 02:04:52 +00:00
yuneng-jiang 51759424a6 Key and Team Routing Setting 2026-01-07 17:17:30 -08:00
Alexsander HamirandGitHub 2f803171d6 refactor(prometheus): skip metrics for invalid API key requests (#18788) 2026-01-07 17:14:14 -08:00
Benedikt Óskarsson 81fefc69c9 fix(bedrock): handle thinking with tool calls for Claude 4 models 2026-01-08 00:48:17 +00:00
yuneng-jiangandGitHub e285e2b91d Merge pull request #18675 from BerriAI/litellm_key_team_routing_config
[Feature] Allow Add and Update for router_settings on Keys and Teams
2026-01-07 16:24:04 -08:00
yuneng-jiang 33ac5dae2b linting 2026-01-07 15:24:49 -08:00
yuneng-jiang d01c48ec5e User metrics for promethus 2026-01-07 15:05:09 -08:00
Alexsander HamirandGitHub 98d7a428b6 Fix: Clarify database_connection_pool_limit applies per worker, not per instance (#18780) 2026-01-07 13:57:03 -08:00
Jack Temple ec16dbe09b fix: add allowClear to dropdown components for better UX 2026-01-07 14:16:29 -07:00
yuneng-jiang 797ab1d7f3 Adding docs for team 2026-01-07 12:43:27 -08:00
yuneng-jiang 611b85bfd8 Fixing mypy linting 2026-01-07 12:36:34 -08:00
yuneng-jiang 1c84af8ae4 normalize proxy config callbacks 2026-01-07 12:22:57 -08:00
Alexsander HamirandGitHub 1544e8f971 feat: Add line_profiler support for performance analysis and fix Windows CRLF issues in Docker builds (#18773) 2026-01-07 11:36:57 -08:00
Elkhan EminovandGitHub bae625bdc6 OpenRouter embeddings API support (#18391)
* support for OpenRouter embeddings

* add bearer

* add content header
2026-01-08 00:57:31 +05:30
Wen-Tien ChangandGitHub 5a4242e188 fix(braintrust): pass span_attributes in async logging and skip tags on non-root spans (#18409)
* fix(braintrust): handle tags and span attributes for non-root spans

* fix(braintrust): refactor span attributes handling and remove duplicate metrics assignment
2026-01-08 00:55:59 +05:30
ea8a94988f fix(bedrock): ensure toolUse.input is always a dict when converting from OpenAI format (#18414)
When some providers (like OpenRouter) return tool call arguments as '""'
(a JSON-encoded empty string), json.loads returns an empty string instead
of a dict. Since Bedrock requires toolUse.input to be a JSON object, this
causes a BedrockException.

This fix adds a type check after json.loads() to ensure the result is
always a dictionary.

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
2026-01-08 00:54:46 +05:30
yuneng-jiang a57f7bc9bf Fixing documentation 2026-01-07 11:24:15 -08:00
Danial KhanandGitHub f126f75995 feat: pass server_tool_use and tool_search_tool_result blocks to anthropic (#18770)
* feat: Allow message types of server_tool_use and tool_search_tool_result to reach anthropic

* test: anthropic server tool use pass through testing
2026-01-08 00:47:28 +05:30
yuneng-jiang eb9f5267b6 Adding builds 2026-01-07 11:11:46 -08:00
yuneng-jiang b2ebb5e1f1 adding migration 2026-01-07 11:10:59 -08:00
yuneng-jiang b6f5ba6205 bump: version 0.4.19 → 0.4.20 2026-01-07 11:10:26 -08:00
yuneng-jiang 140ce5fce2 Merge remote-tracking branch 'origin' into litellm_key_team_routing_config 2026-01-07 11:08:01 -08:00
yuneng-jiangandGitHub 19f323d7c9 Merge pull request #18729 from BerriAI/litellm_endpoint_usage_breakdown
[Feature] Add endpoint to Daily Activity Tables
2026-01-07 11:07:46 -08:00
c89a4115eb Update production proxy resource recommendations (#18771)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-01-08 00:37:12 +05:30
yuneng-jiang 943445dd0f Adding test 2026-01-07 11:00:07 -08:00
yuneng-jiang 9a49bb293f Merge remote-tracking branch 'origin' into litellm_key_team_routing_config 2026-01-07 10:55:38 -08:00
yuneng-jiang bc812672a1 Addressing comments, pending tests 2026-01-07 10:55:25 -08:00
yuneng-jiang 6523c8f233 Adding builds 2026-01-07 10:27:50 -08:00
yuneng-jiang ec6510c61b bump: version 0.4.18 → 0.4.19 2026-01-07 10:27:07 -08:00
yuneng-jiang 7da8d5fcd5 Merge remote-tracking branch 'origin' into litellm_endpoint_usage_breakdown 2026-01-07 10:25:43 -08:00
Ishaan JaffandGitHub 929af510fa [Feat] New provider - Add Azure BFL FLux for image edits (#18766)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs

* add Image Editing

* add azure ai image edits

* AzureFoundryFlux2ImageEditConfig

* TestAzureAIFlux2ImageEdit
2026-01-07 23:28:39 +05:30
Ishaan JaffandGitHub 3430325919 [Feat] Add Azure BFL - Flux 2 models (#18764)
* add azure_ai/flux.2-pro

* get_flux2_image_generation_url

* azure_client_params

* docs
2026-01-07 23:28:28 +05:30
vasilisazaykaandGitHub b4a39a9ea2 fix(sap): correct filtering of optional_params (#18716) 2026-01-07 21:48:29 +05:30
dc4ce7c5a2 feat: Add abliteration.ai provider (#18678)
* feat: Add abliteration.ai provider

* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
2026-01-07 21:46:54 +05:30
Wilson Marcílio JúniorandGitHub 8ce4eea88f make base_connection_pool_limit default value the same (#18721) 2026-01-07 21:43:55 +05:30
f7212d84d5 fix: prevent duplicate User-Agent tags in request_tags (#18723)
The `_get_request_tags` function was returning a reference to the
original tags list from metadata, then mutating it with `.extend()`.
This caused duplicate User-Agent tags when the function was called
multiple times during a single request lifecycle (e.g., by logging,
prometheus, and guardrails).

The fix uses `.copy()` to create a new list before extending, ensuring
the original metadata tags are not mutated.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-authored-by: Tianduo Zhai <tzhai@firsthandadmins-MacBook-Pro.local>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-07 21:42:27 +05:30
1b8708fccc Litellm embeddings calltype fix for guardrail precallhook (#18740)
* adding signoz integration to observability docs

* Fixing build

* Adding timeout for flaky test

* Fixing e2e

* add team member budget duration in team/update

* Reusable Duration Select and update team member budget UI

* feat: allow configuring project name for OpenTelemetry service name

* docs: sets ARIZE_PROJECT_NAME

* added valid callType for bedrock guardrail pre hook

This is to resolve the error when bedrock guardrails are enabled and invoke the embedding models.   {"error":{"message":"'embeddings' is not a valid CallTypes","type":"None","param":"None","code":"500"}}*

* updated the test case to reflect valid callType

---------

Co-authored-by: Goutham Karthi <goutham@signoz.io>
Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: YutaSaito <36355491+uc4w6c@users.noreply.github.com>
Co-authored-by: Yuta Saito <uc4w6c@bma.biglobe.ne.jp>
2026-01-07 21:40:36 +05:30
Ishaan Jaffer bbabc1089c litellm_mapped_tests_litellm_core_utils v1.80.12-nightly 2026-01-07 21:35:12 +05:30
Harshit JainandGitHub 92f7789f10 feat(prometheus): add caching metrics (#18755) 2026-01-07 21:29:04 +05:30