tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-17 00:26:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
19,756 Commits 2,072 Branches 1,425 Tags
fb4ebf0fd435d1ff6dadf46f113d75d5f48fa0a1
Commit Graph
19756 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Manuel Cañete fb4ebf0fd4 ci: add helm unittest 2025-03-08 01:29:25 +01:00
Ishaan JaffandGitHub 0e7fd162f4 (UI) - Keys Page - Show 100 Keys Per Page, Use full height, increase width of key alias (#9064) 
* show 100 keys + increase height of keys

* fix key_alias

* litellm show key alias full width
 2025-03-07 15:43:10 -08:00
Krrish Dholakia 36f3276d8c docs: update docs 2025-03-07 11:00:12 -08:00
Minh DucandGitHub d3ececfc20 Mark several Claude models as being able to accept PDF inputs (#9054) 2025-03-07 10:05:57 -08:00
Jascha BesteandGitHub ecef36d02c docs: Add project page for pgai (#8576) 
* docs: Add project page for pgai

* Add pgai to sidebar.js
 2025-03-07 08:08:01 -08:00
Ishaan JaffandGitHub 7f70bdd99b (Feat) - add pricing for eu.amazon.nova models (#9056) 
* add pricing for eu.amazon.nova models

* fix typo in key management endpoints.py
 2025-03-07 07:06:17 -08:00
Krrish Dholakia 995fc001e0 docs(release_cycle.md): add stable tag info to release cycle 2025-03-06 23:22:45 -08:00
Krrish Dholakia 754b699b07 docs: add doc for rotating master key 2025-03-06 23:22:01 -08:00
Krrish Dholakia a0746a6da9 bump: version 1.63.3 → 1.63.4 2025-03-06 23:14:35 -08:00
Krish DholakiaandGitHub 5591354309 Support master key rotations (#9041) 
* feat(key_management_endpoints.py): adding support for rotating master key

* feat(key_management_endpoints.py): support decryption-re-encryption of models in db, when master key rotated

* fix(user_api_key_auth.py): raise valid token is None error earlier

enables easier debugging with api key hash in error message

* feat(key_management_endpoints.py): rotate any env vars

* fix(key_management_endpoints.py): uncomment check

* fix: fix linting error
 2025-03-06 23:13:30 -08:00
Krish DholakiaandGitHub 52de1949ef build(model_prices_and_context_window.json): update azure o1 mini pricing (#9046) 2025-03-06 22:28:06 -08:00
Krish DholakiaandGitHub 274147bc5e fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 
* fix(team_endpoints.py): ensure 404 raised when team not found

* fix(key_management_endpoints.py): fix adding tags to key when metadata is empty

* fix(key_management_endpoints.py): refactor set metadata field to use common function across keys + teams

reduces scope for errors + easier testing

* fix: fix linting error
 2025-03-06 22:04:36 -08:00
Ishaan Jaff 6dc83135ab bump: version 1.63.2 → 1.63.3 v1.63.3-nightly 2025-03-06 21:23:25 -08:00
Ishaan Jaff 0fed8bcefd ui new build 2025-03-06 21:22:58 -08:00
Ishaan JaffandGitHub 73448412e1 ui allow ui or eu api base adding model (#9042) 2025-03-06 21:22:03 -08:00
Ishaan Jaff 2a377b161d _create_redis_cache 2025-03-06 21:15:48 -08:00
Mandana VaziriandGitHub 55294bc9ef Added PDL project (#8925) 
* Added PDL project

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* Added PDL to projects sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

* change to sidebar

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>

---------

Signed-off-by: Mandana Vaziri <mvaziri@us.ibm.com>
 2025-03-06 21:13:39 -08:00
Ishaan JaffandGitHub 958e71b906 (Docs) connect litellm to open web ui (#9040) 
* init doc

* working thinking tutorial

* docs open web ui with litellm

* minor edits

* docs one tab for tutorials
 2025-03-06 21:13:00 -08:00
Ishaan JaffandGitHub 04e839d846 (AWS Secret Manager) - Using K/V pairs in 1 AWS Secret (#9039) 
* fixes for primary_secret_kv_pairs

* _parse_primary_secret

* Using K/V pairs in 1 AWS Secret

* test_primary_secret_functionality
 2025-03-06 19:30:18 -08:00
Ishaan JaffandGitHub b02af305de [Feat] - Display thinking tokens on OpenWebUI (Bedrock, Anthropic, Deepseek) (#9029) 
* if merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* stash changes

* working merge_reasoning_content_in_choices with bedrock

* fix litellm_params accessor

* fix streaming handler

* merge_reasoning_content_in_choices

* _optional_combine_thinking_block_in_choices

* test_bedrock_stream_thinking_content_openwebui

* merge_reasoning_content_in_choices

* fix for _optional_combine_thinking_block_in_choices

* linting error fix
 2025-03-06 18:32:58 -08:00
Ogun OzGitHubOgün Öz
 		85d1427710 Fix: Create RedisClusterCache when startup nodes provided in cache args of router (#9010) 
Co-authored-by: Ogün Öz <ogun.oz@cobrainer.com>
 2025-03-06 17:14:32 -08:00
Krrish Dholakia d883b4639a docs(sidebars.js): add supported_endpoints slug 2025-03-06 14:46:50 -08:00
Ishaan Jaff cca71b41b3 test_e2e_batches_files v1.63.2-nightly 2025-03-06 08:42:17 -08:00
Ishaan Jaff 3d87bf9fe6 test fix await_batch_completion 2025-03-06 08:15:45 -08:00
Ishaan Jaff 1d2a9e423c test - remove anthropic_adapter tests. no longer used 2025-03-06 06:47:35 -08:00
Ishaan Jaff 29dc67a2aa test fix anthopic completion 2025-03-06 06:42:26 -08:00
Ishaan Jaff 1de33f3443 bump: version 1.63.1 → 1.63.2 2025-03-06 00:44:05 -08:00
Ishaan JaffandGitHub f47987e673 (Refactor) /v1/messages to follow simpler logic for Anthropic API spec (#9013) 
* anthropic_messages_handler v0

* fix /messages

* working messages with router methods

* test_anthropic_messages_handler_litellm_router_non_streaming

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* AnthropicMessagesConfig

* _handle_anthropic_messages_response_logging

* working with /v1/messages endpoint

* working /v1/messages endpoint

* refactor to use router factory function

* use aanthropic_messages

* use BaseConfig for Anthropic /v1/messages

* track api key, team on /v1/messages endpoint

* fix get_logging_payload

* BaseAnthropicMessagesTest

* align test config

* test_anthropic_messages_with_thinking

* test_anthropic_streaming_with_thinking

* fix - display anthropic url for debugging

* test_bad_request_error_handling

* test_anthropic_messages_router_streaming_with_bad_request

* fix ProxyException

* test_bad_request_error_handling_streaming

* use provider_specific_header

* test_anthropic_messages_with_extra_headers

* test_anthropic_messages_to_wildcard_model

* fix gcs pub sub test

* standard_logging_payload

* fix unit testing for anthopic /v1/messages support

* fix pass through anthropic messages api

* delete dead code

* fix anthropic pass through response

* revert change to spend tracking utils

* fix get_litellm_metadata_from_kwargs

* fix spend logs payload json

* proxy_pass_through_endpoint_tests

* TestAnthropicPassthroughBasic

* fix pass through tests

* test_async_vertex_proxy_route_api_key_auth

* _handle_anthropic_messages_response_logging

* vertex_credentials

* test_set_default_vertex_config

* test_anthropic_messages_litellm_router_non_streaming_with_logging

* test_ageneric_api_call_with_fallbacks_basic

* test__aadapter_completion
 2025-03-06 00:43:08 -08:00
Krrish Dholakia 31c5ea74ab docs: cleanup 2025-03-06 00:22:57 -08:00
Krrish Dholakia d030fb668a docs: cleanup docs 2025-03-06 00:16:32 -08:00
Krrish Dholakia 5e71dbbf8b docs: cleanup doc 2025-03-06 00:16:15 -08:00
Krrish Dholakia 320cb1d51a docs: cleanup 'signature_delta' from docs 2025-03-05 23:53:38 -08:00
Krrish Dholakia 823f4dcd9d docs(index.md): add release note for anthropic update 2025-03-05 23:50:26 -08:00
Krrish Dholakia 4b80bf0f14 bump: version 1.63.0 → 1.63.1 2025-03-05 23:41:40 -08:00
Krish DholakiaandGitHub 744e10b0f0 Litellm dev 03 05 2025 p3 (#9023) 
* fix(invoke_handler.py): fix converse streaming - return signature + ensure consistency with anthropic api response

* build(model_prices_and_context_window.json): fix anthropic api claude-3-7 max output tokens

with beta header this is 128k

Resolves https://github.com/BerriAI/litellm/issues/8964

* feat(handler.py): handle new anthropic 'thinking_delta' block on streaming

Fixes https://github.com/BerriAI/litellm/issues/8825
 2025-03-05 22:31:39 -08:00
Krish DholakiaandGitHub f6535ae6ad Support format param for specifying image type (#9019) 
* fix(transformation.py): support a 'format' parameter for image's

allow user to specify mime type

* fix: pass mimetype via 'format' param

* feat(gemini/chat/transformation.py): support 'format' param for gemini

* fix(factory.py): support 'format' param on sync bedrock converse calls

* feat(bedrock/converse_transformation.py): support 'format' param for bedrock async calls

* refactor(factory.py): move to supporting 'format' param in base helper

ensures consistency in param support

* feat(gpt_transformation.py): filter out 'format' param

don't send invalid param to openai

* fix(gpt_transformation.py): fix translation

* fix: fix translation error
v1.63.0-nightly 		2025-03-05 19:52:53 -08:00
Krrish Dholakia a27129798c bump: version 1.62.4 → 1.63.0 2025-03-05 19:34:53 -08:00
Krish DholakiaGitHubMartin Krasser
 		ec4f665e29 Return signature on anthropic streaming + migrate to signature field instead of signature_delta [MINOR bump] (#9021) 
* Fix missing signature_delta in thinking blocks when streaming from Claude 3.7 (#8797)

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* test: update test to enforce signature found

* feat(refactor-signature-param-to-be-'signature'-instead-of-'signature_delta'): keeps it in sync with anthropic

* fix: fix linting error

---------

Co-authored-by: Martin Krasser <krasserm@googlemail.com>
 2025-03-05 19:33:54 -08:00
Krish DholakiaGitHubsubnet.dev
 		17efbf0ee9 Fix #7629 - Add tzdata package to Dockerfile (#8915) (#9009) 
* Add tzdata package to Dockerfile

* Move tzdata to python requirement.txt

Co-authored-by: subnet.dev <50828879+subnet-dev@users.noreply.github.com>
 2025-03-05 14:45:19 -08:00
Krrish Dholakia 4578e5e620 bump: version 1.62.4 → 1.62.5 v1.62.4-nightly 2025-03-05 10:12:28 -08:00
Krrish Dholakia 3be3b802c8 fix: fix linting error 2025-03-05 10:10:53 -08:00
Ishaan Jaff 8d6815ce98 Revert "(UI) - Security Improvement, move to JWT Auth for Admin UI Sessions (#8995)" 
This reverts commit 01a44a4e47.
 2025-03-05 08:49:20 -08:00
Ishaan Jaff 207f41cbea docs fix router default settings 2025-03-05 08:29:21 -08:00
Krrish Dholakia 313b315791 fix: fix linting error 2025-03-05 08:26:26 -08:00
Krish DholakiaandGitHub c69ec66dc5 fix(base_aws_llm.py): remove region name before sending in args (#8998) 
* fix(base_aws_llm.py): remove region name before sending in args

* fix(base_aws_llm.py): fix optional param pop position

* fix: fix linting error
 2025-03-04 23:05:28 -08:00
Krrish Dholakia e715c376b9 fix: fix linting error 2025-03-04 22:34:07 -08:00
Krrish Dholakia f89f50463c bump: version 1.62.3 → 1.62.4 2025-03-04 22:10:07 -08:00
Krish DholakiaandGitHub 5e386c28b2 Litellm dev 03 04 2025 p3 (#8997) 
* fix(core_helpers.py): handle litellm_metadata instead of 'metadata'

* feat(batches/): ensure batches logs are written to db

makes batches response dict compatible

* fix(cost_calculator.py): handle batch response being a dictionary

* fix(batches/main.py): modify retrieve endpoints to use @client decorator

enables logging to work on retrieve call

* fix(batches/main.py): fix retrieve batch response type to be 'dict' compatible

* fix(spend_tracking_utils.py): send unique uuid for retrieve batch call type

create batch and retrieve batch share the same id

* fix(spend_tracking_utils.py): prevent duplicate retrieve batch calls from being double counted

* refactor(batches/): refactor cost tracking for batches - do it on retrieve, and within the established litellm_logging pipeline

ensures cost is always logged to db

* fix: fix linting errors

* fix: fix linting error
 2025-03-04 21:58:03 -08:00
Ishaan JaffandGitHub 01a44a4e47 (UI) - Security Improvement, move to JWT Auth for Admin UI Sessions (#8995) 
* (UI) - Improvements to session handling logic  (#8970)

* add cookieUtils

* use utils for clearing cookies

* on logout use clearTokenCookies

* ui use correct clearTokenCookies

* navbar show userEmail on UserID page

* add timestamp on token cookie

* update generate_authenticated_redirect_response

* use common getAuthToken

* fix clearTokenCookies

* fixes for get auth token

* fix invitation link sign in logic

* Revert "fix invitation link sign in logic"

This reverts commit 30e5308cb3223981c715e723cdd3a6d2ee3aaa4b.

* fix getAuthToken

* update setAuthToken

* fix ui session handling

* fix ui session handler

* bug fix stop generating LiteLLM Virtual keys for access

* working JWT insert into cookies

* use central place to build UI JWT token

* add _validate_ui_token

* fix ui session handler

* fix fetchWithCredentials

* check allowed routes for ui session tokens

* expose validate_session endpoint

* validate session endpoint

* call sso/session/validate

* getUISessionDetails

* ui move to getUISessionDetails

* /sso/session/validate

* fix cookie utils

* use getUISessionDetails

* use ui_session_id

* "/spend/logs/ui" in spend_tracking_routes

* working sign in JWT flow for proxy admin

* allow proxy admin to access ui routes

* use check_route_access

* update types

* update login method

* fixes to ui session handler

* working flow for admin and internal users

* fixes for invite links

* use JWTs for SSO sign in

* fix /invitation/new flow

* fix code quality checks

* fix _get_ui_session_token_from_cookies

* /organization/list

* ui sso sign in

* TestUISessionHandler

* TestUISessionHandler
 2025-03-04 21:48:23 -08:00
Ishaan JaffandGitHub 42931638df (bug fix) - Fix Cache Health Check for Redis when redis_version is float (#8979) 
* fix allow flexible types for redis version

* test_cache_ping_with_redis_version_float

* test_cache_ping_with_redis_version_float
 2025-03-04 21:26:18 -08:00