Commit Graph

33371 Commits

Author SHA1 Message Date
Julio Quinteros Pro fb8b11cc0a fix(tests): use counter-based mock for time.time in prisma self-heal test
The test used a fixed side_effect list for time.time(), but the number
of calls varies by Python version, causing StopIteration on 3.12 and
AssertionError on 3.14. Replace with an infinite counter-based callable
and assert the timestamp was updated rather than checking for an exact
value.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 13:25:02 -03:00
Krrish Dholakia a26f83fd3c fix: update calendly on repo 2026-02-23 06:13:59 -08:00
Sameer Kankute f97ee62fb0 Merge pull request #21909 from BerriAI/litellm_cost_tracking_gemini
Add  Priority PayGo cost tracking gemini/vertex ai
2026-02-23 18:58:57 +05:30
Sameer Kankute 61e63b6553 Merge pull request #21904 from BerriAI/litellm_fix_model_cost_map
fix model cost map for anthropic fast and inference_geo
2026-02-23 18:57:15 +05:30
Sameer Kankute 2f8d36be1b Fix test_aaamodel_prices_and_context_window_json_is_valid 2026-02-23 18:56:12 +05:30
Sameer Kankute 9b5bbee906 Merge pull request #21786 from BerriAI/litellm_oss_staging_02_21_2026
Litellm oss staging 02 21 2026
2026-02-23 18:51:55 +05:30
Sameer Kankute 8decf04d8a Merge pull request #21877 from BerriAI/litellm_oss_staging_02_22_2026
Litellm oss staging 02 22 2026
2026-02-23 18:50:47 +05:30
Sameer Kankute f6f46ae5ae Fix mypy issues 2026-02-23 18:46:25 +05:30
Sameer Kankute 37d45139f2 Merge pull request #21917 from BerriAI/litellm_fix_model_cost_map_wildcard
Fix: Anthropic model wildcard access issue
2026-02-23 18:45:49 +05:30
Sameer Kankute 16b25bd457 Merge pull request #21921 from Point72/ephrimstanley/batch-fixes-feb23
State management fixes for CheckBatchCost
2026-02-23 18:44:05 +05:30
Sameer Kankute 351921d5db Fix mypy issues 2026-02-23 18:41:28 +05:30
Sameer Kankute a3c01b7259 Fix code qa issues 2026-02-23 18:39:46 +05:30
Sameer Kankute 4934d89cc7 Merge pull request #21872 from BerriAI/litellm_dev_02_21_2026_p4
Litellm dev 02 19 2026 p2 (#21871)
2026-02-23 18:35:57 +05:30
TomAlon 99184c48d9 Add Noma guardrails v2 based on custom guardrails (#21400) 2026-02-23 05:05:27 -08:00
Sameer Kankute 88cd0d31ed fix mypy issues: 2026-02-23 18:28:42 +05:30
Ephrim Stanley 27a33565e7 State management fixes for CheckBatchCost - Address greptile comments 2026-02-23 07:52:58 -05:00
Sameer Kankute c7aafdf794 Merge pull request #21926 from BerriAI/main
merge main in oss 21 02
2026-02-23 18:17:30 +05:30
Sameer Kankute 57af8e6a93 Merge pull request #21924 from BerriAI/main
merge main in oss 22 02
2026-02-23 18:11:36 +05:30
Sameer Kankute f23e549cce Fix PR review comments 2026-02-23 18:04:32 +05:30
Ephrim Stanley 7b5dc3fb9c State management fixes for CheckBatchCost 2026-02-23 07:16:25 -05:00
Harshit Jain 4c487acdf0 Merge pull request #21918 from Harshit28j/litellm_arrival_time_fix
fix: ensure arrival_time is set before calculating queue time
2026-02-23 17:41:05 +05:30
Sameer Kankute 164cde9bf6 Readd tpm limit 2026-02-23 17:23:12 +05:30
Sameer Kankute eaf3900200 Fix name of title 2026-02-23 17:18:31 +05:30
Sameer Kankute 262235f266 Add ability to see which model cost map is getting used 2026-02-23 17:15:06 +05:30
Sameer Kankute 9b27cd8c0e Add incident report 2026-02-23 17:13:44 +05:30
Sameer Kankute 4ff1651699 Fix: Anthropic model wildcard access issue 2026-02-23 17:12:55 +05:30
Harshit Jain 9fc3c77c42 fix: ensure arrival_time is set before calculating queue time 2026-02-23 17:04:47 +05:30
Sameer Kankute 3561bfb96c Merge pull request #21640 from ta-stripe/feat/regional-sts-endpoint-for-auth_with_role_name
feat(bedrock): support optional regional STS endpoint in role assumption
2026-02-23 13:28:54 +05:30
Sameer Kankute 55ee8cdd56 Merge pull request #21701 from ta-stripe/fix/bedrock-openai-imported-model-name-encoding
fix(bedrock): encode model arns for OpenAI compatible bedrock imported models
2026-02-23 13:25:02 +05:30
Sameer Kankute 4d8f5097fb Add model pricing 2026-02-23 13:16:27 +05:30
Sameer Kankute 20023bdcfb Add support for Priority PayGo for vertex ai and gemini 2026-02-23 13:15:47 +05:30
Sameer Kankute f54fb9aeb1 Add tests for fast and us 2026-02-23 11:25:47 +05:30
Sameer Kankute 22bccc4f61 Fix entries with fast and us/ 2026-02-23 11:23:24 +05:30
Harshit Jain 6134984008 Merge pull request #21309 from BerriAI/litellm_fix_langfuse_otel_trace_v2
Litellm fix langfuse otel trace v2
2026-02-22 22:02:53 +05:30
Harshit Jain 304862175e Merge branch 'main' into litellm_fix_langfuse_otel_trace_v2 2026-02-22 19:54:05 +05:30
Harshit28j 1cc185eb16 fix: update opentelemetry with greptile review 2026-02-22 19:53:18 +05:30
Cesar Garcia b8cef1a4e5 docs: add OpenClaw integration tutorial (#21605)
* docs: add OpenClaw integration tutorial

* docs: simplify OpenClaw proxy start command

* docs: rewrite OpenClaw integration guide for clarity

- Use gpt-5 as default model
- Replace poetry run with standard litellm CLI
- Add prerequisites section and verification step
- Simplify onboarding instructions (table format)
- Move manual config and troubleshooting to bottom
- Add multi-model config (claude-sonnet, gemini-flash)

* docs: fix model name in OpenClaw manual config example

* docs: rewrite OpenClaw integration guide from scratch

Rewrote the guide based on hands-on testing of every command.
Key changes:
- Replace non-existent `openclaw chat` with verified commands
  (dashboard, tui, agent --agent main)
- Add 3 onboarding options: QuickStart, Manual, and non-interactive
- Fix health check (requires Bearer token)
- Remove misleading "Starting from scratch" section
- Use gpt-4o instead of gpt-5 as the example model
- Clarify that API keys can come from export, .env, or any method
- Add config reference section showing openclaw.json structure
- Add real troubleshooting based on issues found during testing
2026-02-21 20:16:27 -08:00
Krish Dholakia 76ccc9e844 Guardrail Policy Versioning (#21862)
* feat: initial commit, adding support for policy versioning on litellm

* fix(policy_registry): support policy versioning

* fix: multiple QA fixes for policy flow builder with guardrail versioning on litellm

* feat: ui improvements

* feat: add prisma migration

* fix: address greptile fixes
2026-02-21 20:14:31 -08:00
不做了睡大觉 41837ef694 fix: enable context-1m-2025-08-07 beta header for vertex_ai provider (#21867)
The context-1m-2025-08-07 beta header was incorrectly set to null for
vertex_ai in anthropic_beta_headers_config.json, causing the header to
be filtered out when users set extra_headers with anthropic-beta:
context-1m-2025-08-07 for Vertex AI requests.

Vertex AI supports the same beta headers as the Anthropic Messages API,
and other providers (bedrock_converse, azure_ai) already have this
header enabled. This fix aligns vertex_ai with the correct behavior.

Fixes #21861

Co-authored-by: stakeswky <stakeswky@users.noreply.github.com>
2026-02-21 20:12:23 -08:00
Krish Dholakia 52585eb2d7 Revert "fix(vertex_ai): enable context-1m-2025-08-07 beta header (#21870)" (#21876)
This reverts commit bce078a796.
2026-02-21 20:12:01 -08:00
Edwin Isac bce078a796 fix(vertex_ai): enable context-1m-2025-08-07 beta header (#21870)
* server root path regression doc

* fixing syntax

* fix: replace Zapier webhook with Google Form for survey submission (#21621)

* Replace Zapier webhook with Google Form for survey submission

* Add back error logging for survey submission debugging

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* Revert "Merge pull request #21140 from BerriAI/litellm_perf_user_api_key_auth"

This reverts commit 0e1db3f7e4, reversing
changes made to 7e2d6f2355.

* test_vertex_ai_gemini_2_5_pro_streaming

* UI new build

* fix rendering

* ui new build

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* release note docs

* docs

* adding image

* fix(vertex_ai): enable context-1m-2025-08-07 beta header

The `context-1m-2025-08-07` Anthropic beta header was set to `null` for vertex_ai,
causing it to be filtered out when users set `extra_headers: {anthropic-beta: context-1m-2025-08-07}`.

This prevented using Claude's 1M context window feature via Vertex AI, resulting in
`prompt is too long: 460500 tokens > 200000 maximum` errors.

Fixes #21861

---------

Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: milan-berri <milan@berri.ai>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2026-02-21 20:11:13 -08:00
The Mavik 4fc11f6fac fix: avoid mutating caller-owned dicts in SpendUpdateQueue aggregation (#21742) 2026-02-21 19:52:30 -08:00
Trevor Prater 66ccbe37cd Add gollem Go agent framework cookbook example (#21747)
Show how to use gollem, a production Go agent framework, with
LiteLLM proxy for multi-provider LLM access including tool use
and streaming.
2026-02-21 19:51:28 -08:00
Monesh Ram 083c8998e6 fix: add missing return type annotations to iterator protocol methods in streaming_handler (#21750)
* fix: add return type annotations to iterator protocol methods in streaming_handler

Add missing return type annotations to __iter__, __aiter__, __next__, and __anext__ methods in CustomStreamWrapper and related classes.

- __iter__(self) -> Iterator["ModelResponseStream"]
- __aiter__(self) -> AsyncIterator["ModelResponseStream"]
- __next__(self) -> "ModelResponseStream"
- __anext__(self) -> "ModelResponseStream"

Also adds AsyncIterator and Iterator to typing imports.

Fixes issue with PLR0915 noqa comments and ensures proper type checking support.
Related to: BerriAI/litellm#8304

* fix: add ruff PLR0915 noqa for files with too many statements
2026-02-21 19:50:38 -08:00
LeeJuOh 50f36d9ca6 fix(budget): fix timezone config lookup and replace hardcoded timezone map with ZoneInfo (#21754)
* fix(budget): fix timezone config lookup and replace hardcoded timezone map with ZoneInfo

* fix(budget): update stale docstring on get_budget_reset_time
2026-02-21 19:35:06 -08:00
Krrish Dholakia 9828b9929f fix(guardrails/usage_endpoints.py): fix usage dashboard 2026-02-21 19:33:50 -08:00
Krish Dholakia 886f1a3472 Litellm dev 02 19 2026 p2 (#21871)
* feat(ui/): new guardrails monitor 'demo

mock representation of what guardrails monitor looks like

* fix: ui updates

* style(ui/): fix styling

* feat: enable running ai monitor on individual guardrails

* feat: add backend logic for guardrail monitoring
2026-02-21 19:14:04 -08:00
yuneng-jiang d6bd917421 Merge pull request #21863 from BerriAI/litellm_yj_docs_feb21_release
[Docs] store_model_in_db Release Docs
2026-02-21 18:12:20 -08:00
yuneng-jiang 5bb52d0202 adding image 2026-02-21 18:09:18 -08:00
yuneng-jiang ea37f59de4 Merge remote-tracking branch 'origin' into litellm_yj_docs_feb21_release 2026-02-21 18:05:11 -08:00