tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-05 06:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
19,762 Commits 2,072 Branches 1,425 Tags
b5ad968e8a84658abc4725f7a8a4b2c86263b045
Commit Graph
19762 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan JaffandGitHub b5ad968e8a (UI) - Minor improvements to logs page (#9076) 
* logs - make sure all cols have max width

* fix missing data message

* fix toggle handle responsive logs
 2025-03-07 21:38:45 -08:00
Ishaan JaffandGitHub e2d612efd9 Bug fix - String data: stripped from entire content in streamed Gemini responses (#9070) 
* _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* use _strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* test_strip_sse_data_from_chunk

* _strip_sse_data_from_chunk

* testing

* _strip_sse_data_from_chunk
 2025-03-07 21:06:39 -08:00
Krrish Dholakia 2163d5c3e9 fix(transform_request.tsx): allow dev to file translation error 2025-03-07 19:43:49 -08:00
Krish DholakiaandGitHub 0e3caf92b9 UI - new API Playground for testing LiteLLM translation (#9073) 
* feat: initial commit - enable dev to see translated request

* feat(utils.py): expose new endpoint - `/utils/transform_request` to see the raw request sent by litellm

* feat(transform_request.tsx): allow user to see their transformed request

* refactor(litellm_logging.py): return raw request in 3 parts - api_base, headers, request body

easier to render each individually on UI vs. extracting from combined string

* feat: transform_request.tsx

working e2e raw request viewing

* fix(litellm_logging.py): fix transform viewing for bedrock models

* fix(litellm_logging.py): don't return sensitive headers in raw request headers

prevent accidental leak

* feat(transform_request.tsx): style improvements
 2025-03-07 19:39:31 -08:00
Ishaan JaffandGitHub 1cf6f53a6c (UI) - Allow adding Cerebras, Sambanova, Perplexity, Fireworks, Openrouter, TogetherAI Models on Admin UI (#9069) 
* allow adding cerebras on litellm ui

* add perplexity

* add openrouter, fireworks, together
 2025-03-07 17:01:53 -08:00
Ishaan JaffandGitHub b5eeafdd72 (Docs) OpenWeb x LiteLLM Docker compose + Instructions on spend tracking + logging (#9059) 
* docs improve open web ui litellm doc

* docs openweb show teams + keys

* docs open web ui litellm
 2025-03-07 17:01:39 -08:00
Ishaan JaffandGitHub e753f61231 fix logs page selected log (#9061) 2025-03-07 17:01:11 -08:00
Ishaan JaffandGitHub 0e7fd162f4 (UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064) 
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
 2025-03-07 15:43:10 -08:00
Krrish Dholakia 36f3276d8c docs: update docs 2025-03-07 11:00:12 -08:00
Minh DucandGitHub d3ececfc20 Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha BesteandGitHub ecef36d02c docs: Add project page for pgai (#8576) 
* docs: Add project page for pgai

* Add pgai to sidebar.js
 2025-03-07 08:08:01 -08:00
Ishaan JaffandGitHub 7f70bdd99b (Feat) - add pricing for eu.amazon.nova models (#9056) 
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
 2025-03-07 07:06:17 -08:00
Krrish Dholakia 995fc001e0 docs(release_cycle.md): add stable tag info to release cycle 2025-03-06 23:22:45 -08:00
Krrish Dholakia 754b699b07 docs: add doc for rotating master key 2025-03-06 23:22:01 -08:00
Krrish Dholakia a0746a6da9 bump: version 1.63.3 → 1.63.4 2025-03-06 23:14:35 -08:00
Krish DholakiaandGitHub 5591354309 Support master key rotations (#9041) 
* feat(key_management_endpoints.py): adding support for rotating master key

* feat(key_management_endpoints.py): support decryption-re-encryption of models in db, when master key rotated

* fix(user_api_key_auth.py): raise valid token is None error earlier

enables easier debugging with api key hash in error message

* feat(key_management_endpoints.py): rotate any env vars

* fix(key_management_endpoints.py): uncomment check

* fix: fix linting error
 2025-03-06 23:13:30 -08:00
Krish DholakiaandGitHub 52de1949ef build(model_prices_and_context_window.json): update azure o1 mini pricing (#9046) 2025-03-06 22:28:06 -08:00
Krish DholakiaandGitHub 274147bc5e fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 
* fix(team_endpoints.py): ensure 404 raised when team not found

* fix(key_management_endpoints.py): fix adding tags to key when metadata is empty

* fix(key_management_endpoints.py): refactor set metadata field to use common function across keys + teams

reduces scope for errors + easier testing

* fix: fix linting error
 2025-03-06 22:04:36 -08:00
Ishaan Jaff 6dc83135ab bump: version 1.63.2 → 1.63.3 v1.63.3-nightly 2025-03-06 21:23:25 -08:00
Ishaan Jaff 0fed8bcefd ui new build 2025-03-06 21:22:58 -08:00
Ishaan JaffandGitHub 73448412e1 ui allow ui or eu api base adding model (#9042) 2025-03-06 21:22:03 -08:00
Ishaan Jaff 2a377b161d _create_redis_cache 2025-03-06 21:15:48 -08:00
Mandana VaziriandGitHub 55294bc9ef Added PDL project (#8925) 
* Added PDL project

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* Added PDL to projects sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* change to sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

---------

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>
 2025-03-06 21:13:39 -08:00
Ishaan JaffandGitHub 958e71b906 (Docs) connect litellm to open web ui (#9040) 
* init doc

* working thinking tutorial

* docs open web ui with litellm

* minor edits

* docs one tab for tutorials
 2025-03-06 21:13:00 -08:00
Ishaan JaffandGitHub 04e839d846 (AWS Secret Manager) - Using K/V pairs in 1 AWS Secret (#9039) 
* fixes for primary_secret_kv_pairs

* _parse_primary_secret

* Using K/V pairs in 1 AWS Secret

* test_primary_secret_functionality
 2025-03-06 19:30:18 -08:00
Ishaan JaffandGitHub b02af305de [Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek) (#9029) 
* if merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* stash changes

* working merge_reasoning_content_in_choices with bedrock

* fix litellm_params accessor

* fix streaming handler

* merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* test_bedrock_stream_thinking_content_openwebui

* merge_reasoning_content_in_choices

* fix for _optional_combine_thinking_block_in_choices

* linting error fix
 2025-03-06 18:32:58 -08:00
Ogun OzGitHubOgün Öz
 		85d1427710 Fix: Create RedisClusterCache when startup nodes provided in cache args of router (#9010) 
Co-authored-by: Ogün Öz <ogun.oz@cobrainer.com>
 2025-03-06 17:14:32 -08:00
Krrish Dholakia d883b4639a docs(sidebars.js): add supported_endpoints slug 2025-03-06 14:46:50 -08:00
Ishaan Jaff cca71b41b3 test_e2e_batches_files v1.63.2-nightly 2025-03-06 08:42:17 -08:00
Ishaan Jaff 3d87bf9fe6 test fix await_batch_completion 2025-03-06 08:15:45 -08:00
Ishaan Jaff 1d2a9e423c test - remove anthropic_adapter tests. no longer used 2025-03-06 06:47:35 -08:00
Ishaan Jaff 29dc67a2aa test fix anthopic completion 2025-03-06 06:42:26 -08:00
Ishaan Jaff 1de33f3443 bump: version 1.63.1 → 1.63.2 2025-03-06 00:44:05 -08:00
Ishaan JaffandGitHub f47987e673 (Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013) 
* anthropic_messages_handler v0

* fix /messages

* working messages with router methods

* test_anthropic_messages_handler_litellm_router_non_streaming

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* AnthropicMessagesConfig

* _handle_anthropic_messages_response_logging

* working with /v1/messages endpoint

* working /v1/messages endpoint

* refactor to use router factory function

* use aanthropic_messages

* use BaseConfig for Anthropic /v1/messages

* track api key, team on /v1/messages endpoint

* fix get_logging_payload

* BaseAnthropicMessagesTest

* align test config

* test_anthropic_messages_with_thinking

* test_anthropic_streaming_with_thinking

* fix - display anthropic url for debugging

* test_bad_request_error_handling

* test_anthropic_messages_router_streaming_with_bad_request

* fix ProxyException

* test_bad_request_error_handling_streaming

* use provider_specific_header

* test_anthropic_messages_with_extra_headers

* test_anthropic_messages_to_wildcard_model

* fix gcs pub sub test

* standard_logging_payload

* fix unit testing for anthopic /v1/messages support

* fix pass through anthropic messages api

* delete dead code

* fix anthropic pass through response

* revert change to spend tracking utils

* fix get_litellm_metadata_from_kwargs

* fix spend logs payload json

* proxy_pass_through_endpoint_tests

* TestAnthropicPassthroughBasic

* fix pass through tests

* test_async_vertex_proxy_route_api_key_auth

* _handle_anthropic_messages_response_logging

* vertex_credentials

* test_set_default_vertex_config

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* test_ageneric_api_call_with_fallbacks_basic

* test__aadapter_completion
 2025-03-06 00:43:08 -08:00
Krrish Dholakia 31c5ea74ab docs: cleanup 2025-03-06 00:22:57 -08:00
Krrish Dholakia d030fb668a docs: cleanup docs 2025-03-06 00:16:32 -08:00
Krrish Dholakia 5e71dbbf8b docs: cleanup doc 2025-03-06 00:16:15 -08:00
Krrish Dholakia 320cb1d51a docs: cleanup 'signature_delta' from docs 2025-03-05 23:53:38 -08:00
Krrish Dholakia 823f4dcd9d docs(index.md): add release note for anthropic update 2025-03-05 23:50:26 -08:00
Krrish Dholakia 4b80bf0f14 bump: version 1.63.0 → 1.63.1 2025-03-05 23:41:40 -08:00
Krish DholakiaandGitHub 744e10b0f0 Litellm dev 03 05 2025 p3 (#9023) 
* fix(invoke_handler.py): fix converse streaming - return signature + ensure consistency with anthropic api response

* build(model_prices_and_context_window.json): fix anthropic api claude-3-7 max output tokens

with beta header this is 128k

Resolves https://github.com/BerriAI/litellm/issues/8964

* feat(handler.py): handle new anthropic 'thinking_delta' block on streaming

Fixes https://github.com/BerriAI/litellm/issues/8825
 2025-03-05 22:31:39 -08:00
Krish DholakiaandGitHub f6535ae6ad Support format param for specifying image type (#9019) 
* fix(transformation.py): support a 'format' parameter for image's

allow user to specify mime type

* fix: pass mimetype via 'format' param

* feat(gemini/chat/transformation.py): support 'format' param for gemini

* fix(factory.py): support 'format' param on sync bedrock converse calls

* feat(bedrock/converse_transformation.py): support 'format' param for bedrock async calls

* refactor(factory.py): move to supporting 'format' param in base helper

ensures consistency in param support

* feat(gpt_transformation.py): filter out 'format' param

don't send invalid param to openai

* fix(gpt_transformation.py): fix translation

* fix: fix translation error
v1.63.0-nightly 		2025-03-05 19:52:53 -08:00
Krrish Dholakia a27129798c bump: version 1.62.4 → 1.63.0 2025-03-05 19:34:53 -08:00
Krish DholakiaGitHubMartin Krasser
 		ec4f665e29 Return signature on anthropic streaming + migrate to signature field instead of signature_delta [MINOR bump] (#9021) 
* Fix missing signature_delta in thinking blocks when streaming from Claude 3.7 (#8797)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* test: update test to enforce signature found

* feat(refactor-signature-param-to-be-'signature'-instead-of-'signature_delta'): keeps it in sync with anthropic

* fix: fix linting error

---------

Co-authored-by: Martin Krasser <krasserm@googlemail.com>
 2025-03-05 19:33:54 -08:00
Krish DholakiaGitHubsubnet.dev
 		17efbf0ee9 Fix #7629 - Add tzdata package to Dockerfile (#8915) (#9009) 
* Add tzdata package to Dockerfile

* Move tzdata to python requirement.txt

Co-authored-by: subnet.dev <50828879+subnet-dev@users.noreply.github.com>
 2025-03-05 14:45:19 -08:00
Krrish Dholakia 4578e5e620 bump: version 1.62.4 → 1.62.5 v1.62.4-nightly 2025-03-05 10:12:28 -08:00
Krrish Dholakia 3be3b802c8 fix: fix linting error 2025-03-05 10:10:53 -08:00
Ishaan Jaff 8d6815ce98 Revert "(UI) - Security Improvement, move to JWT Auth for Admin UI Sessions (#8995)" 
This reverts commit 01a44a4e47.
 2025-03-05 08:49:20 -08:00
Ishaan Jaff 207f41cbea docs fix router default settings 2025-03-05 08:29:21 -08:00
Krrish Dholakia 313b315791 fix: fix linting error 2025-03-05 08:26:26 -08:00