Commit Graph
23817 Commits
Author SHA1 Message Date
Jugal D. BhattandGitHub 32501c85f5 fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses (#13293) 2025-08-05 13:16:16 -07:00
tanjiroandGitHub fd92f3eaf1 team req for service acc (#13302) 2025-08-05 13:01:54 -07:00
Ishaan JaffandGitHub 2eef77d960 add fireworks gpt-oss-20b (#13303) 2025-08-05 12:30:09 -07:00
Ishaan JaffandGitHub 0db13acdc7 New models - add fireworks_ai/glm-4p5 model family (#13297)
* add fireworks_ai/glm-4p5

* fix max output tokens
2025-08-05 12:08:42 -07:00
Ishaan JaffandGitHub cc5c7aba03 [New model] add bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 (#13295)
* add us.anthropic.claude-opus-4-1-20250805-v1:0 bedrock model

* fix BEDROCK_CONVERSE_MODELS
2025-08-05 11:56:47 -07:00
Jugal D. BhattandGitHub 1b9dd9daee claude opus 4.1 support for anthropic provider (#13296) 2025-08-05 11:56:10 -07:00
Jugal D. BhattandGitHub 609fa9f5ca [LLM Translation + Coding tools] Added litellm claude code count tokens support (#13261)
* Added litellm claude code count tokens support

* fix mypy

* create helper

* Revert construct

* revert construct

* fix return

* Add reutrn none

* change to factory approach

* refactor to BaseModelInfo

* enum fix
2025-08-05 10:57:24 -07:00
Jugal D. BhattandGitHub 29a8c583c2 added redis iam auth (#13275) 2025-08-05 10:56:34 -07:00
Ishaan JaffandGitHub 7c42659a98 Revert "Fix: Langfuse reporting "client closed" error due to httpx client TTL…" (#13291)
This reverts commit 1c6be9bdad.
v1.75.0-nightly
2025-08-05 09:58:57 -07:00
Ishaan Jaff 5a02eb473b test_function_calling_with_tool_response 2025-08-05 09:55:47 -07:00
Krish DholakiaandGitHub 416da066eb fix(main.py): handle tool being a pydantic object (#13274)
* fix(main.py): handle tool being a pydantic object

Fixes https://github.com/BerriAI/litellm/issues/13064

* fix(prompt_templates/common_utils.py): fix unpack defs deepcopy issue

Fixes https://github.com/BerriAI/litellm/issues/13151

* fix(utils.py): handle tools is none
2025-08-04 23:44:02 -07:00
Krish DholakiaandGitHub eb49f987de Ensure disable_llm_api_endpoints works + Add wildcard model support for 'team-byok' model (#13278)
* fix(route_checks.py): ensure disable llm api endpoints is correctly set

* fix(route_checks.py): raise httpexception

raise expected exceptions

* fix(router.py): handle team only wildcard models

fixes issue where team only wildcard models were not considered during auth checks

* fix(router.py): handle team only wildcard models

fixes issue where team only wildcard models were not considered during auth checks
2025-08-04 23:19:51 -07:00
Krish DholakiaandGitHub af67c3576f fix OCI linting errors (#13279)
* fix(types/llms/oci.py): fix linting errors

* fix(oci.py): fix linting error

* fix(oci.py): fix linting errors

* fix: fix linting error

* fix: fix linting error
2025-08-04 23:10:46 -07:00
Ishaan JaffandGitHub ec205fec35 [UI] - Add ability to set model alias per key/team (#13276)
* update model alias on keys

* team model aliases

* fix model aliases

* fixes for teams
2025-08-04 21:47:39 -07:00
Jugal D. BhattandGitHub efd34966dc [LLM Translation] Support /v1/models/{model_id} retrieval (#13268)
* added model id endpoint

* fix test

* add route to internal users

* make the functions reusable

* fixed mypy
2025-08-04 18:03:59 -07:00
Jugal D. BhattandGitHub de7108b5f8 input cost per token higher than 1 test (#13270) 2025-08-04 18:02:03 -07:00
Ishaan Jaff ad26cba8b6 add litellm-enterprise==0.1.17 2025-08-04 17:26:50 -07:00
Ishaan Jaff 8314227a60 bump: version 1.75.0 → 1.75.1 2025-08-04 17:24:40 -07:00
Ishaan Jaff d948b47dba bump: version 1.74.15 → 1.75.0 2025-08-04 17:23:55 -07:00
Ishaan JaffandGitHub ba1882fdd5 [Bug Fix] Prometheus - fix for litellm_input_tokens_metric, litellm_output_tokens_metric - Note this updates the metric name (#13271)
* fixes for litellm_tokens_metric

* test_prometheus_token_metrics_with_prometheus_config
2025-08-04 17:22:21 -07:00
Krrish Dholakia 37cb443010 refactor(oci/chat/transformation.py): lazy load package imports 2025-08-04 17:12:36 -07:00
Jugal D. BhattandGitHub 368c9b75b9 add correct pricing (#13269) 2025-08-04 17:00:16 -07:00
PerlingandGitHub 1c6be9bdad Fix: Langfuse reporting "client closed" error due to httpx client TTL (#13045)
* Fix: Langfuse reporting "client closed" error due to httpx client TTL

* remove log
2025-08-04 16:12:51 -07:00
Pascal BroandGitHub a17d483c89 Add GCS bucket caching support (#13122) 2025-08-04 16:09:33 -07:00
breno-aumoandGitHub 056b60a9fa Support OCI provider (#13206)
* create OCI required files

* request and response conversion for non-streaming chat

* support tool calling with OCI generic API without streaming

* adaptation of api call for generic and cohere format

* include tool calls and responses in generic api and dropping support for cohere

* fix invalid content-length error

* support streaming for generic api

* fix auth error when using acompletion with streaming

* refactor: use base_llm_http_handler and include API type definitions

* update types and add type safety in different methods

* fix OCIFunction format

* create custom stream wrapper for decoding OCI stream

* remove unused files

* create unit tests for OCI

* lint the code

* remove manual test

* docs: update the docs to include OCI
2025-08-04 15:59:25 -07:00
Ishaan JaffandGitHub 849f5e0ba0 [Bug Fix] Fix Server root path regression on UI when using "Login" (#13267)
* bug fix serve_login_page

* test_serve_login_page_server_root_path
2025-08-04 15:58:28 -07:00
Benjamin BartelsandGitHub 779579a604 Update model_prices_and_context_window.json (#13244) 2025-08-04 15:56:36 -07:00
Krrish Dholakia 747467c819 docs(user_keys.md): add litellm python sdk tab 2025-08-04 15:14:13 -07:00
Krrish Dholakia bfecab2cc5 docs(index.md): cleanup tag 2025-08-04 14:18:04 -07:00
Ishaan JaffandGitHub f3749709b8 Bug Fix - Responses API raises error with Gemini Tool Calls in input (#13260)
* add _transform_responses_api_function_call_to_chat_completion_message

* test_responses_api_with_tool_calls

* TestFunctionCallTransformation

* fixes for responses API testing google ai studio

* TestGoogleAIStudioResponsesAPITest

* test_responses_api_with_tool_calls

* test_responses_api_with_tool_calls

* test_basic_openai_responses_streaming_delete_endpoint
2025-08-04 12:01:33 -07:00
Ishaan JaffandGitHub dae72003a7 [Bug Fix] OpenAI / Azure Responses API - Add service_tier , safety_identifier supported params (#13258)
* test_aresponses_service_tier_and_safety_identifier

* add service_tier + safety_identifier

* fix get_supported_openai_params

* add safety_identifier + service_tier for responses()
2025-08-04 10:51:53 -07:00
Jugal D. BhattandGitHub b318f55faa [UI] Add team deletion check for teams with keys (#12953)
* added check option

* Add underline

* make less verbosE
2025-08-04 08:42:06 -07:00
Jugal D. BhattandGitHub 36229dc69f [LLM Translation] Fix Model Usage not having text tokens (#13234)
* fix + test

* remove test comments

* fix mypy

* fix mypy

* fix tests
2025-08-04 21:06:49 +05:30
Krrish Dholakia 98102e2804 docs(index.md): cleanup 2025-08-02 23:06:46 -07:00
Krrish Dholakia 2ee8513763 fix(key_management_endpoints.py): fix check 2025-08-02 23:03:57 -07:00
Krrish Dholakia 271fce9f39 build: update poetry 2025-08-02 23:01:46 -07:00
Jugal D. BhattandGitHub 9aeca96c16 fix openshift (#13239) 2025-08-02 22:37:02 -07:00
Krish DholakiaandGitHub 3119064e94 Prompt Management - add prompts on UI (#13240)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information

* feat(prompt_endpoints.py): support converting dotprompt to json structure + accept json structure in promptmanager

allows prompt manager to work with api endpoints

* test(test_prompt_manager.py): add unit tests for json data input

* feat(dotprompt/__init__.py): add prompt data to dotpromptmanager

* fix(prompt_endpoints.py): working crud endpoints for prompt management

* feat(prompts/): support `prompt_file` for dotprompt

allows to precisely point to the prompt file a prompt should use

* feat(proxy/utils.py): resolve prompt id correctly

resolves user sent prompt id with internal prompt id

* feat(schema.prisma): initial pr with db schema for prompt management table

allows post endpoints to work with backend

* feat(prompt_endpoints.py): use db in patch_prompt endpoint

* feat(prompt_endpoints.py): use db for update_prompt endpoint

* feat(prompt_endpoints.py): use db on prompt delete endpoint

* build(schema.prisma): add prompt tale to schema.prisma in litellm-proxy-extras

* build(migration.sql): add new sql migration file

* fix(init_prompts.py): fix init

* feat(prompt_info_view.tsx): show the raw prompt template on ui

allows developer to know the prompt template they'll be calling

* feat(add_prompt_form.tsx): working ui add prompt flow

allows user to add prompts to litellm via ui

* build(ui/): styling fixes

* build(ui/): prompts.tsx

styling improvements

* fix(add_prompt_form.tsx): styling improvements

* build(prompts.tsx): styling improvements

* build(ui/): styling improvements

* build(ui/): fix ui error

* fix: fix ruff check

* docs: document new api params

* test: update tests
2025-08-02 22:33:37 -07:00
Krish DholakiaandGitHub e47b30a76d Prompt Management - Add table + prompt info page to UI (#13232)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* feat(prompts.tsx): add new ui component to view created prompts

enables viewing prompts created on config

* feat(prompt_info.tsx): add component for viewing the prompt information
2025-08-02 19:34:18 -07:00
Krish DholakiaandGitHub b79f55eec0 UI - Add giving keys prompt access (#13233)
* fix(create_key_button.tsx): add prompts on UI

* feat(key_management_endpoints.py): support adding prompt to key via `/key/update`

* fix(key_info_view.tsx): show existing prompts on key in key_info_view.tsx

* fix(key_edit_view.tsx): UX - disable premium feature for non-premium users

prevent accidental clicking

* fix(create_key_button.tsx): disable premium features behind flag, prevent errors

* fix(key_management_endpoints.py): fix key update logic \

* fix: fix check

* docs: document new params
2025-08-02 19:33:17 -07:00
Ishaan Jaff 4c217c66f5 docs User Agent Activity Tracking 2025-08-02 17:26:40 -07:00
Ishaan Jaff 2ee4e84406 docs fix 2025-08-02 16:47:44 -07:00
Ishaan Jaff 06856b4d37 docs fix 2025-08-02 15:47:09 -07:00
Ishaan Jaff 0f9f5f7a6c docs fix 2025-08-02 15:44:59 -07:00
Ishaan Jaff 69a360429c agent 4.png 2025-08-02 15:34:14 -07:00
Ishaan Jaff e32169dc37 docs cost tracking coding 2025-08-02 15:29:44 -07:00
Ishaan Jaff 340b64a46a docs - Track Usage for Coding Tools 2025-08-02 15:18:04 -07:00
Ishaan Jaff 9b029c35be docs RC 2025-08-02 15:06:12 -07:00
Ishaan Jaff 8d6b333909 docs computer use 2025-08-02 15:00:48 -07:00
Ishaan JaffandGitHub e306fb6eee [docs release notes] (#13237)
* docs release notes

* docs release notes

* docs rnotes

* docs api version

* fixes docs

* docs rn
2025-08-02 14:15:10 -07:00