tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-02 14:22:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
19,773 Commits 2,072 Branches 1,425 Tags
83062b892bb8e2a48d9268cf6ef3d66dc6df5bd1
Commit Graph
19773 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff 83062b892b fix test_list_key_helper_team_filtering 2025-03-08 17:21:32 -08:00
Krrish Dholakia de0467b8e6 docs: cleanup 2025-03-08 16:43:42 -08:00
Krrish Dholakia b0ae49a53d docs(index.md): cleanup 2025-03-08 16:37:01 -08:00
Krrish Dholakia 4e5893ef65 docs(index.md): cleanup 2025-03-08 16:36:36 -08:00
Ishaan Jaff 6e3b21775f test_cost_azure_openai_prompt_caching 2025-03-08 16:19:28 -08:00
Krish DholakiaandGitHub 09d0144711 New stable release notes (#9085) 
* docs: stable release notes

* docs: additional doc improvements

* docs(anthropic_unified.md): add doc on unified anthropic endpoint

* docs: update docs
 2025-03-08 16:19:07 -08:00
Ishaan JaffandGitHub b41311bb21 (UI) - Fix show correct count of internal user keys on Users Page (#9082) 
* get_user_key_counts

* fix get_user_key_counts

* fix get_user_key_counts

* test_get_users_filters_dashboard_keys

* remove unused func
 2025-03-08 16:13:18 -08:00
Ishaan JaffandGitHub 73df319f4e (Clean up) - Allow switching off storing Error Logs in DB (#9084) 
* fix - cleanup, dont store ErrorLogs in 2 tables

* async_post_call_failure_hook

* docs disable error logs

* disable_error_logs
 2025-03-08 16:12:03 -08:00
Ishaan JaffandGitHub a7f6a95dd9 (UI) - Fix, Allow Filter Keys by Team Alias, Key Alias and Org (#9083) 
* working team, key, org filters

* fix size of filter

* all keys filter

* 1 file for filter logic

* remove key alias check
 2025-03-08 15:58:29 -08:00
Krish DholakiaandGitHub 4330ef8e81 Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077) 
* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test
 2025-03-08 11:47:25 -08:00
Teja VishwanadhaandGitHub 8c049dfffc support bytes.IO for audio transcription (#9071) 2025-03-08 08:47:15 -08:00
Ishaan JaffandGitHub b5ad968e8a (UI) - Minor improvements to logs page (#9076) 
* logs - make sure all cols have max width

* fix missing data message

* fix toggle handle responsive logs
 2025-03-07 21:38:45 -08:00
Ishaan JaffandGitHub e2d612efd9 Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070) 
* _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* test_strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* testing

* _strip_sse_data_from_chunk
 2025-03-07 21:06:39 -08:00
Krrish Dholakia 2163d5c3e9 fix(transform_request.tsx): allow dev to file translation error 2025-03-07 19:43:49 -08:00
Krish DholakiaandGitHub 0e3caf92b9 UI - new API Playground for testing LiteLLM translation (#9073) 
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
 2025-03-07 19:39:31 -08:00
Ishaan JaffandGitHub 1cf6f53a6c (UI) - Allow adding Cerebras, Sambanova, Perplexity, Fireworks, Openrouter, TogetherAI Models on Admin UI (#9069) 
* allow adding cerebras on litellm ui

* add perplexity

* add openrouter, fireworks, together
 2025-03-07 17:01:53 -08:00
Ishaan JaffandGitHub b5eeafdd72 (Docs) OpenWeb x LiteLLM Docker compose + Instructions on spend tracking + logging (#9059) 
* docs improve open web ui litellm doc

* docs openweb show teams + keys

* docs open web ui litellm
 2025-03-07 17:01:39 -08:00
Ishaan JaffandGitHub e753f61231 fix logs page selected log (#9061) 2025-03-07 17:01:11 -08:00
Ishaan JaffandGitHub 0e7fd162f4 (UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064) 
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
 2025-03-07 15:43:10 -08:00
Krrish Dholakia 36f3276d8c docs: update docs 2025-03-07 11:00:12 -08:00
Minh DucandGitHub d3ececfc20 Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha BesteandGitHub ecef36d02c docs: Add project page for pgai (#8576) 
* docs: Add project page for pgai

* Add pgai to sidebar.js
 2025-03-07 08:08:01 -08:00
Ishaan JaffandGitHub 7f70bdd99b (Feat) - add pricing for eu.amazon.nova models (#9056) 
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
 2025-03-07 07:06:17 -08:00
Krrish Dholakia 995fc001e0 docs(release_cycle.md): add stable tag info to release cycle 2025-03-06 23:22:45 -08:00
Krrish Dholakia 754b699b07 docs: add doc for rotating master key 2025-03-06 23:22:01 -08:00
Krrish Dholakia a0746a6da9 bump: version 1.63.3 → 1.63.4 2025-03-06 23:14:35 -08:00
Krish DholakiaandGitHub 5591354309 Support master key rotations (#9041) 
* feat(key_management_endpoints.py): adding support for rotating master key

* feat(key_management_endpoints.py): support decryption-re-encryption of models in db, when master key rotated

* fix(user_api_key_auth.py): raise valid token is None error earlier

enables easier debugging with api key hash in error message

* feat(key_management_endpoints.py): rotate any env vars

* fix(key_management_endpoints.py): uncomment check

* fix: fix linting error
 2025-03-06 23:13:30 -08:00
Krish DholakiaandGitHub 52de1949ef build(model_prices_and_context_window.json): update azure o1 mini pricing (#9046) 2025-03-06 22:28:06 -08:00
Krish DholakiaandGitHub 274147bc5e fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 
* fix(team_endpoints.py): ensure 404 raised when team not found

* fix(key_management_endpoints.py): fix adding tags to key when metadata is empty

* fix(key_management_endpoints.py): refactor set metadata field to use common function across keys + teams

reduces scope for errors + easier testing

* fix: fix linting error
 2025-03-06 22:04:36 -08:00
Ishaan Jaff 6dc83135ab bump: version 1.63.2 → 1.63.3 v1.63.3-nightly 2025-03-06 21:23:25 -08:00
Ishaan Jaff 0fed8bcefd ui new build 2025-03-06 21:22:58 -08:00
Ishaan JaffandGitHub 73448412e1 ui allow ui or eu api base adding model (#9042) 2025-03-06 21:22:03 -08:00
Ishaan Jaff 2a377b161d _create_redis_cache 2025-03-06 21:15:48 -08:00
Mandana VaziriandGitHub 55294bc9ef Added PDL project (#8925) 
* Added PDL project

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* Added PDL to projects sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* change to sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

---------

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>
 2025-03-06 21:13:39 -08:00
Ishaan JaffandGitHub 958e71b906 (Docs) connect litellm to open web ui (#9040) 
* init doc

* working thinking tutorial

* docs open web ui with litellm

* minor edits

* docs one tab for tutorials
 2025-03-06 21:13:00 -08:00
Ishaan JaffandGitHub 04e839d846 (AWS Secret Manager) - Using K/V pairs in 1 AWS Secret (#9039) 
* fixes for primary_secret_kv_pairs

* _parse_primary_secret

* Using K/V pairs in 1 AWS Secret

* test_primary_secret_functionality
 2025-03-06 19:30:18 -08:00
Ishaan JaffandGitHub b02af305de [Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek) (#9029) 
* if merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* stash changes

* working merge_reasoning_content_in_choices with bedrock

* fix litellm_params accessor

* fix streaming handler

* merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* test_bedrock_stream_thinking_content_openwebui

* merge_reasoning_content_in_choices

* fix for _optional_combine_thinking_block_in_choices

* linting error fix
 2025-03-06 18:32:58 -08:00
Ogun OzGitHubOgün Öz
 		85d1427710 Fix: Create RedisClusterCache when startup nodes provided in cache args of router (#9010) 
Co-authored-by: Ogün Öz <ogun.oz@cobrainer.com>
 2025-03-06 17:14:32 -08:00
Krrish Dholakia d883b4639a docs(sidebars.js): add supported_endpoints slug 2025-03-06 14:46:50 -08:00
Ishaan Jaff cca71b41b3 test_e2e_batches_files v1.63.2-nightly 2025-03-06 08:42:17 -08:00
Ishaan Jaff 3d87bf9fe6 test fix await_batch_completion 2025-03-06 08:15:45 -08:00
Ishaan Jaff 1d2a9e423c test - remove anthropic_adapter tests. no longer used 2025-03-06 06:47:35 -08:00
Ishaan Jaff 29dc67a2aa test fix anthopic completion 2025-03-06 06:42:26 -08:00
Ishaan Jaff 1de33f3443 bump: version 1.63.1 → 1.63.2 2025-03-06 00:44:05 -08:00
Ishaan JaffandGitHub f47987e673 (Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013) 
* anthropic_messages_handler v0

* fix /messages

* working messages with router methods

* test_anthropic_messages_handler_litellm_router_non_streaming

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* AnthropicMessagesConfig

* _handle_anthropic_messages_response_logging

* working with /v1/messages endpoint

* working /v1/messages endpoint

* refactor to use router factory function

* use aanthropic_messages

* use BaseConfig for Anthropic /v1/messages

* track api key, team on /v1/messages endpoint

* fix get_logging_payload

* BaseAnthropicMessagesTest

* align test config

* test_anthropic_messages_with_thinking

* test_anthropic_streaming_with_thinking

* fix - display anthropic url for debugging

* test_bad_request_error_handling

* test_anthropic_messages_router_streaming_with_bad_request

* fix ProxyException

* test_bad_request_error_handling_streaming

* use provider_specific_header

* test_anthropic_messages_with_extra_headers

* test_anthropic_messages_to_wildcard_model

* fix gcs pub sub test

* standard_logging_payload

* fix unit testing for anthopic /v1/messages support

* fix pass through anthropic messages api

* delete dead code

* fix anthropic pass through response

* revert change to spend tracking utils

* fix get_litellm_metadata_from_kwargs

* fix spend logs payload json

* proxy_pass_through_endpoint_tests

* TestAnthropicPassthroughBasic

* fix pass through tests

* test_async_vertex_proxy_route_api_key_auth

* _handle_anthropic_messages_response_logging

* vertex_credentials

* test_set_default_vertex_config

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* test_ageneric_api_call_with_fallbacks_basic

* test__aadapter_completion
 2025-03-06 00:43:08 -08:00
Krrish Dholakia 31c5ea74ab docs: cleanup 2025-03-06 00:22:57 -08:00
Krrish Dholakia d030fb668a docs: cleanup docs 2025-03-06 00:16:32 -08:00
Krrish Dholakia 5e71dbbf8b docs: cleanup doc 2025-03-06 00:16:15 -08:00
Krrish Dholakia 320cb1d51a docs: cleanup 'signature_delta' from docs 2025-03-05 23:53:38 -08:00
Krrish Dholakia 823f4dcd9d docs(index.md): add release note for anthropic update 2025-03-05 23:50:26 -08:00