tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-23 20:26:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
33,369 Commits 2,072 Branches 1,425 Tags
f97ee62fb086b88ca46db0faf9eb71600faeb96d
Commit Graph
33369 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sameer KankuteandGitHub f97ee62fb0 Merge pull request #21909 from BerriAI/litellm_cost_tracking_gemini 
Add  Priority PayGo cost tracking gemini/vertex ai
 2026-02-23 18:58:57 +05:30
Sameer KankuteandGitHub 61e63b6553 Merge pull request #21904 from BerriAI/litellm_fix_model_cost_map 
fix model cost map for anthropic fast and inference_geo
 2026-02-23 18:57:15 +05:30
Sameer Kankute 2f8d36be1b Fix test_aaamodel_prices_and_context_window_json_is_valid 2026-02-23 18:56:12 +05:30
Sameer KankuteandGitHub 9b5bbee906 Merge pull request #21786 from BerriAI/litellm_oss_staging_02_21_2026 
Litellm oss staging 02 21 2026
 2026-02-23 18:51:55 +05:30
Sameer KankuteandGitHub 8decf04d8a Merge pull request #21877 from BerriAI/litellm_oss_staging_02_22_2026 
Litellm oss staging 02 22 2026
 2026-02-23 18:50:47 +05:30
Sameer Kankute f6f46ae5ae Fix mypy issues 2026-02-23 18:46:25 +05:30
Sameer KankuteandGitHub 37d45139f2 Merge pull request #21917 from BerriAI/litellm_fix_model_cost_map_wildcard 
Fix: Anthropic model wildcard access issue
 2026-02-23 18:45:49 +05:30
Sameer KankuteandGitHub 16b25bd457 Merge pull request #21921 from Point72/ephrimstanley/batch-fixes-feb23 
State management fixes for CheckBatchCost
 2026-02-23 18:44:05 +05:30
Sameer Kankute 351921d5db Fix mypy issues 2026-02-23 18:41:28 +05:30
Sameer Kankute a3c01b7259 Fix code qa issues 2026-02-23 18:39:46 +05:30
Sameer KankuteandGitHub 4934d89cc7 Merge pull request #21872 from BerriAI/litellm_dev_02_21_2026_p4 
Litellm dev 02 19 2026 p2 (#21871)
 2026-02-23 18:35:57 +05:30
TomAlonandGitHub 99184c48d9 Add Noma guardrails v2 based on custom guardrails (#21400) 2026-02-23 05:05:27 -08:00
Sameer Kankute 88cd0d31ed fix mypy issues: 2026-02-23 18:28:42 +05:30
Ephrim Stanley 27a33565e7 State management fixes for CheckBatchCost - Address greptile comments 2026-02-23 07:52:58 -05:00
Sameer KankuteandGitHub c7aafdf794 Merge pull request #21926 from BerriAI/main 
merge main in oss 21 02
 2026-02-23 18:17:30 +05:30
Sameer KankuteandGitHub 57af8e6a93 Merge pull request #21924 from BerriAI/main 
merge main in oss 22 02
 2026-02-23 18:11:36 +05:30
Sameer Kankute f23e549cce Fix PR review comments 2026-02-23 18:04:32 +05:30
Ephrim Stanley 7b5dc3fb9c State management fixes for CheckBatchCost 2026-02-23 07:16:25 -05:00
Harshit JainandGitHub 4c487acdf0 Merge pull request #21918 from Harshit28j/litellm_arrival_time_fix 
fix: ensure arrival_time is set before calculating queue time
 2026-02-23 17:41:05 +05:30
Sameer Kankute 164cde9bf6 Readd tpm limit 2026-02-23 17:23:12 +05:30
Sameer Kankute eaf3900200 Fix name of title 2026-02-23 17:18:31 +05:30
Sameer Kankute 262235f266 Add ability to see which model cost map is getting used 2026-02-23 17:15:06 +05:30
Sameer Kankute 9b27cd8c0e Add incident report 2026-02-23 17:13:44 +05:30
Sameer Kankute 4ff1651699 Fix: Anthropic model wildcard access issue 2026-02-23 17:12:55 +05:30
Harshit Jain 9fc3c77c42 fix: ensure arrival_time is set before calculating queue time 2026-02-23 17:04:47 +05:30
Sameer KankuteandGitHub 3561bfb96c Merge pull request #21640 from ta-stripe/feat/regional-sts-endpoint-for-auth_with_role_name 
feat(bedrock): support optional regional STS endpoint in role assumption
 2026-02-23 13:28:54 +05:30
Sameer KankuteandGitHub 55ee8cdd56 Merge pull request #21701 from ta-stripe/fix/bedrock-openai-imported-model-name-encoding 
fix(bedrock): encode model arns for OpenAI compatible bedrock imported models
 2026-02-23 13:25:02 +05:30
Sameer Kankute 4d8f5097fb Add model pricing 2026-02-23 13:16:27 +05:30
Sameer Kankute 20023bdcfb Add support for Priority PayGo for vertex ai and gemini 2026-02-23 13:15:47 +05:30
Sameer Kankute f54fb9aeb1 Add tests for fast and us 2026-02-23 11:25:47 +05:30
Sameer Kankute 22bccc4f61 Fix entries with fast and us/ 2026-02-23 11:23:24 +05:30
Harshit JainandGitHub 6134984008 Merge pull request #21309 from BerriAI/litellm_fix_langfuse_otel_trace_v2 
Litellm fix langfuse otel trace v2
 2026-02-22 22:02:53 +05:30
Harshit JainandGitHub 304862175e Merge branch 'main' into litellm_fix_langfuse_otel_trace_v2 2026-02-22 19:54:05 +05:30
Harshit28j 1cc185eb16 fix: update opentelemetry with greptile review 2026-02-22 19:53:18 +05:30
Cesar GarciaandGitHub b8cef1a4e5 docs: add OpenClaw integration tutorial (#21605) 
* docs: add OpenClaw integration tutorial

* docs: simplify OpenClaw proxy start command

* docs: rewrite OpenClaw integration guide for clarity

- Use gpt-5 as default model
- Replace poetry run with standard litellm CLI
- Add prerequisites section and verification step
- Simplify onboarding instructions (table format)
- Move manual config and troubleshooting to bottom
- Add multi-model config (claude-sonnet, gemini-flash)

* docs: fix model name in OpenClaw manual config example

* docs: rewrite OpenClaw integration guide from scratch

Rewrote the guide based on hands-on testing of every command.
Key changes:
- Replace non-existent `openclaw chat` with verified commands
  (dashboard, tui, agent --agent main)
- Add 3 onboarding options: QuickStart, Manual, and non-interactive
- Fix health check (requires Bearer token)
- Remove misleading "Starting from scratch" section
- Use gpt-4o instead of gpt-5 as the example model
- Clarify that API keys can come from export, .env, or any method
- Add config reference section showing openclaw.json structure
- Add real troubleshooting based on issues found during testing
 2026-02-21 20:16:27 -08:00
Krish DholakiaandGitHub 76ccc9e844 Guardrail Policy Versioning (#21862) 
* feat: initial commit, adding support for policy versioning on litellm

* fix(policy_registry): support policy versioning

* fix: multiple QA fixes for policy flow builder with guardrail versioning on litellm

* feat: ui improvements

* feat: add prisma migration

* fix: address greptile fixes
 2026-02-21 20:14:31 -08:00
不做了睡大觉GitHubstakeswky
 		41837ef694 fix: enable context-1m-2025-08-07 beta header for vertex_ai provider (#21867) 
The context-1m-2025-08-07 beta header was incorrectly set to null for
vertex_ai in anthropic_beta_headers_config.json, causing the header to
be filtered out when users set extra_headers with anthropic-beta:
context-1m-2025-08-07 for Vertex AI requests.

Vertex AI supports the same beta headers as the Anthropic Messages API,
and other providers (bedrock_converse, azure_ai) already have this
header enabled. This fix aligns vertex_ai with the correct behavior.

Fixes #21861

Co-authored-by: stakeswky <stakeswky@users.noreply.github.com>
 2026-02-21 20:12:23 -08:00
Krish DholakiaandGitHub 52585eb2d7 Revert "fix(vertex_ai): enable context-1m-2025-08-07 beta header (#21870)" (#21876) 
This reverts commit bce078a796.
 2026-02-21 20:12:01 -08:00
Edwin IsacGitHubyuneng-jiangmilan-berriIshaan Jaff
 		bce078a796 fix(vertex_ai): enable context-1m-2025-08-07 beta header (#21870) 
* server root path regression doc

* fixing syntax

* fix: replace Zapier webhook with Google Form for survey submission (#21621)

* Replace Zapier webhook with Google Form for survey submission

* Add back error logging for survey submission debugging

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* Revert "Merge pull request #21140 from BerriAI/litellm_perf_user_api_key_auth"

This reverts commit 0e1db3f7e4, reversing
changes made to 7e2d6f2355.

* test_vertex_ai_gemini_2_5_pro_streaming

* UI new build

* fix rendering

* ui new build

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* docs fix

* release note docs

* docs

* adding image

* fix(vertex_ai): enable context-1m-2025-08-07 beta header

The `context-1m-2025-08-07` Anthropic beta header was set to `null` for vertex_ai,
causing it to be filtered out when users set `extra_headers: {anthropic-beta: context-1m-2025-08-07}`.

This prevented using Claude's 1M context window feature via Vertex AI, resulting in
`prompt is too long: 460500 tokens > 200000 maximum` errors.

Fixes #21861

---------

Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
Co-authored-by: milan-berri <milan@berri.ai>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2026-02-21 20:11:13 -08:00
The MavikandGitHub 4fc11f6fac fix: avoid mutating caller-owned dicts in SpendUpdateQueue aggregation (#21742) 2026-02-21 19:52:30 -08:00
Trevor PraterandGitHub 66ccbe37cd Add gollem Go agent framework cookbook example (#21747) 
Show how to use gollem, a production Go agent framework, with
LiteLLM proxy for multi-provider LLM access including tool use
and streaming.
 2026-02-21 19:51:28 -08:00
Monesh RamandGitHub 083c8998e6 fix: add missing return type annotations to iterator protocol methods in streaming_handler (#21750) 
* fix: add return type annotations to iterator protocol methods in streaming_handler

Add missing return type annotations to __iter__, __aiter__, __next__, and __anext__ methods in CustomStreamWrapper and related classes.

- __iter__(self) -> Iterator["ModelResponseStream"]
- __aiter__(self) -> AsyncIterator["ModelResponseStream"]
- __next__(self) -> "ModelResponseStream"
- __anext__(self) -> "ModelResponseStream"

Also adds AsyncIterator and Iterator to typing imports.

Fixes issue with PLR0915 noqa comments and ensures proper type checking support.
Related to: BerriAI/litellm#8304

* fix: add ruff PLR0915 noqa for files with too many statements
 2026-02-21 19:50:38 -08:00
LeeJuOhandGitHub 50f36d9ca6 fix(budget): fix timezone config lookup and replace hardcoded timezone map with ZoneInfo (#21754) 
* fix(budget): fix timezone config lookup and replace hardcoded timezone map with ZoneInfo

* fix(budget): update stale docstring on get_budget_reset_time
 2026-02-21 19:35:06 -08:00
Krrish Dholakia 9828b9929f fix(guardrails/usage_endpoints.py): fix usage dashboard 2026-02-21 19:33:50 -08:00
Krish DholakiaandGitHub 886f1a3472 Litellm dev 02 19 2026 p2 (#21871) 
* feat(ui/): new guardrails monitor 'demo

mock representation of what guardrails monitor looks like

* fix: ui updates

* style(ui/): fix styling

* feat: enable running ai monitor on individual guardrails

* feat: add backend logic for guardrail monitoring
 2026-02-21 19:14:04 -08:00
yuneng-jiangandGitHub d6bd917421 Merge pull request #21863 from BerriAI/litellm_yj_docs_feb21_release 
[Docs] store_model_in_db Release Docs
 2026-02-21 18:12:20 -08:00
yuneng-jiang 5bb52d0202 adding image 2026-02-21 18:09:18 -08:00
yuneng-jiang ea37f59de4 Merge remote-tracking branch 'origin' into litellm_yj_docs_feb21_release 2026-02-21 18:05:11 -08:00
Ishaan Jaffer 84b572d719 docs 2026-02-21 18:00:38 -08:00
yuneng-jiang cb4b638958 Merge branch 'doc_yj_feb21' of github.com:BerriAI/litellm into litellm_yj_docs_feb21 2026-02-21 17:58:44 -08:00