tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-29 14:21:40 +00:00
Code Issues Packages Projects Releases Wiki Activity
19,787 Commits 2,072 Branches 1,425 Tags
d25693b96cecddc4c3ebdc38eb4e61337b1345cc
Commit Graph
19787 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
omrishiv d25693b96c update test 
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
 2025-03-10 20:34:52 -07:00
omrishiv 338722beba add test 
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
 2025-03-10 20:28:55 -07:00
omrishiv 12e730885b encode bedrock model id 
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
 2025-03-10 20:14:35 -07:00
Ishaan Jaff 60d3cb10bc openweb tutorial 2025-03-10 08:10:07 -07:00
Krrish Dholakia 0fa3ec98ab bump: version 1.63.4 → 1.63.5 2025-03-09 20:47:51 -07:00
Krrish Dholakia 574f5056c8 fix(utils.py): fix linting error 2025-03-09 20:47:12 -07:00
Krish DholakiaandGitHub f899b828cf Support openrouter reasoning_content on streaming (#9094) 
* feat(convert_dict_to_response.py): support openrouter format of reasoning content

* fix(transformation.py): fix openrouter streaming with reasoning content

Fixes https://github.com/BerriAI/litellm/issues/8193#issuecomment-270892962

* fix: fix type error
 2025-03-09 20:03:59 -07:00
5aaee9andGitHub 42b7921ca1 fix: perplexity return both delta and message cause OpenWebUI repect text (#9081) 2025-03-09 19:46:31 -07:00
Krish DholakiaGitHubyou-n-g
 		65ef65d360 feat: prioritize api_key over tenant_id for more Azure AD token provi… (#8701) 
* feat: prioritize api_key over tenant_id for more Azure AD token provider (#8318)

* fix: prioritize api_key over tenant_id for Azure AD token provider

* test: Add test for Azure AD token provider in router

* fix: fix linting error

---------

Co-authored-by: you-n-g <you-n-g@users.noreply.github.com>
 2025-03-09 18:59:37 -07:00
Krish DholakiaandGitHub e00d4fb18c Litellm dev 03 08 2025 p3 (#9089) 
* feat(ollama_chat.py): pass down http client to ollama_chat

enables easier testing

* fix(factory.py): fix passing images to ollama's `/api/generate` endpoint

Fixes https://github.com/BerriAI/litellm/issues/6683

* fix(factory.py): fix ollama pt to handle templating correctly
 2025-03-09 18:20:56 -07:00
Krrish Dholakia 93273723cd docs(index.md): add git diff to release notes 2025-03-08 19:14:56 -08:00
Krrish Dholakia ac3e57a501 docs: add images to release notes 2025-03-08 17:39:24 -08:00
Ishaan Jaff b6eee01381 Revert "experimental - track anthropic messages as mode" 
This reverts commit 22b3862e0d.
 2025-03-08 17:38:24 -08:00
Ishaan Jaff 22b3862e0d experimental - track anthropic messages as mode 2025-03-08 17:33:35 -08:00
Ishaan Jaff 83062b892b fix test_list_key_helper_team_filtering 2025-03-08 17:21:32 -08:00
Krrish Dholakia de0467b8e6 docs: cleanup 2025-03-08 16:43:42 -08:00
Krrish Dholakia b0ae49a53d docs(index.md): cleanup 2025-03-08 16:37:01 -08:00
Krrish Dholakia 4e5893ef65 docs(index.md): cleanup 2025-03-08 16:36:36 -08:00
Ishaan Jaff 6e3b21775f test_cost_azure_openai_prompt_caching 2025-03-08 16:19:28 -08:00
Krish DholakiaandGitHub 09d0144711 New stable release notes (#9085) 
* docs: stable release notes

* docs: additional doc improvements

* docs(anthropic_unified.md): add doc on unified anthropic endpoint

* docs: update docs
 2025-03-08 16:19:07 -08:00
Ishaan JaffandGitHub b41311bb21 (UI) - Fix show correct count of internal user keys on Users Page (#9082) 
* get_user_key_counts

* fix get_user_key_counts

* fix get_user_key_counts

* test_get_users_filters_dashboard_keys

* remove unused func
 2025-03-08 16:13:18 -08:00
Ishaan JaffandGitHub 73df319f4e (Clean up) - Allow switching off storing Error Logs in DB (#9084) 
* fix - cleanup, dont store ErrorLogs in 2 tables

* async_post_call_failure_hook

* docs disable error logs

* disable_error_logs
 2025-03-08 16:12:03 -08:00
Ishaan JaffandGitHub a7f6a95dd9 (UI) - Fix, Allow Filter Keys by Team Alias, Key Alias and Org (#9083) 
* working team, key, org filters

* fix size of filter

* all keys filter

* 1 file for filter logic

* remove key alias check
 2025-03-08 15:58:29 -08:00
Krish DholakiaandGitHub 4330ef8e81 Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077) 
* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test
 2025-03-08 11:47:25 -08:00
Teja VishwanadhaandGitHub 8c049dfffc support bytes.IO for audio transcription (#9071) 2025-03-08 08:47:15 -08:00
Ishaan JaffandGitHub b5ad968e8a (UI) - Minor improvements to logs page (#9076) 
* logs - make sure all cols have max width

* fix missing data message

* fix toggle handle responsive logs
 2025-03-07 21:38:45 -08:00
Ishaan JaffandGitHub e2d612efd9 Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070) 
* _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* test_strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* testing

* _strip_sse_data_from_chunk
 2025-03-07 21:06:39 -08:00
Krrish Dholakia 2163d5c3e9 fix(transform_request.tsx): allow dev to file translation error 2025-03-07 19:43:49 -08:00
Krish DholakiaandGitHub 0e3caf92b9 UI - new API Playground for testing LiteLLM translation (#9073) 
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
 2025-03-07 19:39:31 -08:00
Ishaan JaffandGitHub 1cf6f53a6c (UI) - Allow adding Cerebras, Sambanova, Perplexity, Fireworks, Openrouter, TogetherAI Models on Admin UI (#9069) 
* allow adding cerebras on litellm ui

* add perplexity

* add openrouter, fireworks, together
 2025-03-07 17:01:53 -08:00
Ishaan JaffandGitHub b5eeafdd72 (Docs) OpenWeb x LiteLLM Docker compose + Instructions on spend tracking + logging (#9059) 
* docs improve open web ui litellm doc

* docs openweb show teams + keys

* docs open web ui litellm
 2025-03-07 17:01:39 -08:00
Ishaan JaffandGitHub e753f61231 fix logs page selected log (#9061) 2025-03-07 17:01:11 -08:00
Ishaan JaffandGitHub 0e7fd162f4 (UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064) 
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
 2025-03-07 15:43:10 -08:00
Krrish Dholakia 36f3276d8c docs: update docs 2025-03-07 11:00:12 -08:00
Minh DucandGitHub d3ececfc20 Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha BesteandGitHub ecef36d02c docs: Add project page for pgai (#8576) 
* docs: Add project page for pgai

* Add pgai to sidebar.js
 2025-03-07 08:08:01 -08:00
Ishaan JaffandGitHub 7f70bdd99b (Feat) - add pricing for eu.amazon.nova models (#9056) 
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
 2025-03-07 07:06:17 -08:00
Krrish Dholakia 995fc001e0 docs(release_cycle.md): add stable tag info to release cycle 2025-03-06 23:22:45 -08:00
Krrish Dholakia 754b699b07 docs: add doc for rotating master key 2025-03-06 23:22:01 -08:00
Krrish Dholakia a0746a6da9 bump: version 1.63.3 → 1.63.4 2025-03-06 23:14:35 -08:00
Krish DholakiaandGitHub 5591354309 Support master key rotations (#9041) 
* feat(key_management_endpoints.py): adding support for rotating master key

* feat(key_management_endpoints.py): support decryption-re-encryption of models in db, when master key rotated

* fix(user_api_key_auth.py): raise valid token is None error earlier

enables easier debugging with api key hash in error message

* feat(key_management_endpoints.py): rotate any env vars

* fix(key_management_endpoints.py): uncomment check

* fix: fix linting error
 2025-03-06 23:13:30 -08:00
Krish DholakiaandGitHub 52de1949ef build(model_prices_and_context_window.json): update azure o1 mini pricing (#9046) 2025-03-06 22:28:06 -08:00
Krish DholakiaandGitHub 274147bc5e fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 
* fix(team_endpoints.py): ensure 404 raised when team not found

* fix(key_management_endpoints.py): fix adding tags to key when metadata is empty

* fix(key_management_endpoints.py): refactor set metadata field to use common function across keys + teams

reduces scope for errors + easier testing

* fix: fix linting error
 2025-03-06 22:04:36 -08:00
Ishaan Jaff 6dc83135ab bump: version 1.63.2 → 1.63.3 v1.63.3-nightly 2025-03-06 21:23:25 -08:00
Ishaan Jaff 0fed8bcefd ui new build 2025-03-06 21:22:58 -08:00
Ishaan JaffandGitHub 73448412e1 ui allow ui or eu api base adding model (#9042) 2025-03-06 21:22:03 -08:00
Ishaan Jaff 2a377b161d _create_redis_cache 2025-03-06 21:15:48 -08:00
Mandana VaziriandGitHub 55294bc9ef Added PDL project (#8925) 
* Added PDL project

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* Added PDL to projects sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* change to sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

---------

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>
 2025-03-06 21:13:39 -08:00
Ishaan JaffandGitHub 958e71b906 (Docs) connect litellm to open web ui (#9040) 
* init doc

* working thinking tutorial

* docs open web ui with litellm

* minor edits

* docs one tab for tutorials
 2025-03-06 21:13:00 -08:00
Ishaan JaffandGitHub 04e839d846 (AWS Secret Manager) - Using K/V pairs in 1 AWS Secret (#9039) 
* fixes for primary_secret_kv_pairs

* _parse_primary_secret

* Using K/V pairs in 1 AWS Secret

* test_primary_secret_functionality
 2025-03-06 19:30:18 -08:00