Commit Graph

23118 Commits

Author SHA1 Message Date
Ishaan Jaff 4b3b4f8dff bump: version 1.73.7 → 1.74.0 v1.74.0-nightly 2025-07-04 18:31:26 -07:00
Ishaan Jaff c31a7d3ab7 fix new utils tests 2025-07-04 18:30:50 -07:00
Ishaan Jaff 19e26a5c60 test_default_api_base 2025-07-04 18:26:54 -07:00
Ishaan Jaff c615b60121 ui new build 2025-07-04 18:24:42 -07:00
Ishaan Jaff 31198e0ab9 [Feat] UI - Allow setting Logging Callback Setting per Key (#12333)
* allow adding logging settings on a key

* add ability to edit key logging settings

* dont leak api keys on ui

* fix order

* add langsmith settings
2025-07-04 18:19:22 -07:00
Ishaan Jaff 090f847bd9 [Feat] QA - Arize Team based logging (#12331)
* add _get_tracer_with_dynamic_headers

* fix construct_dynamic_arize_headers

* [Feat] UI - Allow Viewing/Editing Team Based Callbacks (#12329)

* add logging settings view on UI

* fix change ordering

* add construct_dynamic_otel_headers for arize

* refactor common code

* test_construct_dynamic_arize_headers

* otel unit tests

* test_arize_dynamic_params

* test_arize_dynamic_headers_in_grpc_requests
2025-07-04 18:17:09 -07:00
Ishaan Jaff cf8ce11fb8 test fix - import loc 2025-07-04 17:38:44 -07:00
Ishaan Jaff bd480bea07 fix type error 2025-07-04 17:35:37 -07:00
Ishaan Jaff 78ee153545 [Feat] UI - Allow Viewing/Editing Team Based Callbacks (#12329)
* add logging settings view on UI

* fix change ordering
2025-07-04 16:14:46 -07:00
Jugal D. Bhatt 6f27385edf Ensure message redaction works for responses API logging (#12291)
* add fixes to choice implementation redaction

* add isInstance check on responses API

* change datadog to revert back

* change datadog to revert back

* fix type errors

* Redaction test changes

* Redaction test changes

* Redaction test changes - remove changes
2025-07-04 15:11:20 -07:00
Ishaan Jaff ff7dd1756a [Security Bug Fix] Ensure only LLM API route fails get logged on Langfuse (and other loggers) (#12308)
* _is_proxy_only_llm_api_error

* test_proxy_only_error_true_for_llm_route

* add not on change

* Update tests/test_litellm/proxy/test_proxy_utils.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* add test_post_call_failure_hook_auth_error_key_info_route

* test fix _is_proxy_only_llm_api_error

* test_chat_completion_request_with_redaction

* test_post_call_failure_hook_auth_error_llm_api_route

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-04 14:42:42 -07:00
Ishaan Jaff 2f96fa6c4d feat - add new banner on startup (#12328) 2025-07-04 14:14:59 -07:00
Jugal D. Bhatt b2464a2b33 ssl_cert_error (#12327) 2025-07-04 13:21:29 -07:00
Ishaan Jaff 9da97eb939 add new env vars to docs 2025-07-04 13:13:34 -07:00
Ishaan Jaff c3e673b627 [Feat] Add github co-pilot as a new LLM API provider (#12325)
* Litellm dev 03 05 2025 contributor prs (#9079)

* feat: add support for copilot provider

* test: add tests for github copilot

* chore: clean up github copilot authenticator

* test: add test for github copilot authenticator

* test: add test for github copilot for sonnet 3.7 thought model

* Fix #7629 - Add tzdata package to Dockerfile (#8915)

* Add tzdata package to Dockerfile

* Move tzdata to python requirement.txt

* feat: add support for copilot provider (#8577)

* feat: add support for copilot provider

* test: add tests for github copilot

* chore: clean up github copilot authenticator

* test: add test for github copilot authenticator

* test: add test for github copilot for sonnet 3.7 thought model

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* feat: add model information for copilot models

* fix: fix linting errors

* test: remove integration test for github_copilot + fix misisng mock

* fix: use print to make sure the logger message shown

* test: remove debug print

* fix lint (#11112)

* Add init files to make test directories Python packages and update import paths in test_token_counter.py (#11119)

* Update litellm/model_prices_and_context_window_backup.json

Co-authored-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>

---------

Co-authored-by: Son H. Nguyen <nhs.000.dev@gmail.com>
Co-authored-by: subnet.dev <50828879+subnet-dev@users.noreply.github.com>
Co-authored-by: Son H. Nguyen <33925625+nhs000@users.noreply.github.com>
Co-authored-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* refactor github copilot

* test_github_copilot_transformation.py

* test_github_copilot_authenticator.py

* add GitHub Copilot

* fix order

* doc fix

---------

Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
Co-authored-by: Son H. Nguyen <nhs.000.dev@gmail.com>
Co-authored-by: subnet.dev <50828879+subnet-dev@users.noreply.github.com>
Co-authored-by: Son H. Nguyen <33925625+nhs000@users.noreply.github.com>
Co-authored-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
2025-07-04 13:12:16 -07:00
Joost van Doorn 453591ed7c Fix: Fix custom ca bundle support in aiohttp transport (#12281)
* Unify usage of get_ssl_configuration

* Fix doc
2025-07-04 12:48:20 -07:00
Ishaan Jaff 203a10a705 [Bug Fix] /generateContent API - Only pass supported params when using OpenAI models (#12297)
* fix - only pass GenericLiteLLMParams

* test_google_generate_content_with_openai
2025-07-04 12:08:10 -07:00
Jugal D. Bhatt 62946e58d2 Segregate MCP tools on connections using headers (#12296)
* Add get tools segregation

* add ui changes (#12302)

* resolve comments

* add mapped tests

* remove advanced settings (#12323)
2025-07-04 11:45:51 -07:00
tanjiro 8bf94b9090 Comma separated spend and budget (#12317)
* all_keys_table, key_info_view, organizations

* teams

* the whole usage page

* teams page

* users table

* user info

* more commas

* some more commas
2025-07-04 11:14:39 -07:00
Ishaan Jaff 3d71b49d11 [Feat] Add failure logging support for s3 logger (#12299)
* add async_log_failure_event

* test_basic_s3_v2_logging_failure
2025-07-04 11:11:30 -07:00
Krrish Dholakia 11947c1e04 docs(opentelemetry_integration.md): add otel debug flag to docs
help people debug their traces easily
2025-07-04 10:10:40 -07:00
Ishaan Jaff 666f14dc02 ci/cd new release v1.73.7-nightly 2025-07-04 10:07:05 -07:00
Ishaan Jaff f285765862 add code_qa_check_tests 2025-07-04 10:06:40 -07:00
Ishaan Jaff b4f45e838a add test 2025-07-04 10:06:40 -07:00
Ishaan Jaff ab13edd155 check_for_litellm_module_deletion 2025-07-04 10:06:40 -07:00
Ishaan Jaff 39955129f5 fix mapped tests (#12320)
* fix - use flush llm client cache

* faster mapped tests

* test_async_multiple_response_ids_routing

* fix tests

* test_ateam_member_update_admin_requires_premium

* regular mapped tests

* Revert "Fix: Initialize JSON logging for all loggers when JSON_LOGS=True (#12206)"

This reverts commit 2c60c316ec.

* reset num workers
2025-07-04 10:04:43 -07:00
Low Jian Sheng c2d5682a90 Fix gemini tool call sequence (#11999)
* fix gemini tool call sequence

* modify tests
2025-07-04 07:29:39 -07:00
Ishaan Jaff 4854482af4 ci/cd new build 2025-07-03 23:05:38 -07:00
Ishaan Jaff d774b08766 test_arouter_filter_team_based_models 2025-07-03 23:05:03 -07:00
Krish Dholakia a03390ccc7 Litellm dev 07 03 2025 p2 (#12301)
* fix(langfuse_prompt_management.py): add langfuse prompt version param support

Adds prompt versioning support

* test(test_langfuse_prompt_management.py): add unit test

* fix: fix linting errors

* fix: add prompt_version instrumentation

* fix(langfuse_otel.py): correctly read env var

* docs(langfuse_integration.md): clarify v3 recommendation is to use langfuse_otel

Closes https://github.com/BerriAI/litellm/issues/11500

* docs(langfuse_otel_integration.md): cleanup docs

* test: fix test

* test: update tests

* fix: fix linting error
2025-07-03 22:40:21 -07:00
Ishaan Jaff 33dabbfefc ci/cd run again 2025-07-03 22:37:25 -07:00
Ishaan Jaff 467dc4fa38 test router 2025-07-03 22:37:25 -07:00
Krrish Dholakia bc6b60e5ab docs(index.md): cleanup release 2025-07-03 22:35:37 -07:00
Ishaan Jaff 7319d6b003 test llamafile 2025-07-03 22:35:22 -07:00
Krrish Dholakia 38dcb85e9a docs(index.md): cleanup doc 2025-07-03 22:35:07 -07:00
Ishaan Jaff 0835011388 test fix creds test 2025-07-03 22:01:52 -07:00
Takashi Ishida 773717d57c improve readme: replace claude-3-sonnet because it will be retired soon (#12239)
* improve readme: replace claude-3-sonnet-20240229 because it will be retired soon

* update the readme example to claude sonnet 4
2025-07-03 21:50:39 -07:00
Cole McIntosh b6589a72c9 fix: Add size parameter support for Vertex AI image generation (#12292)
- Added 'size' to supported parameters for vertex_ai in get_optional_params_image_gen
- Implemented mapping from OpenAI size format (e.g., '1024x1024') to Vertex AI aspectRatio format (e.g., '1:1')
- Supports common aspect ratios: 1:1 (square), 16:9 (landscape), 9:16 (portrait)
- Added comprehensive test coverage for the size parameter mapping

Fixes LIT-279: Vertex AI Image Generation Aspect Ratio Support
2025-07-03 21:43:37 -07:00
Krish Dholakia 3362503927 fix(guardrails): add azure content safety guardrails to the UI (#12309) 2025-07-03 21:35:20 -07:00
Ishaan Jaff c83f86f8cb ci/cd new release 2025-07-03 21:16:49 -07:00
Ishaan Jaff 9c8619ed10 test fix 2025-07-03 21:16:26 -07:00
Ishaan Jaff 81d96b9ffe fix test models 2025-07-03 21:16:26 -07:00
Krish Dholakia f755b70528 fix(factory.py): support optional args for bedrock (#12287)
* fix(factory.py): support optional args for bedrock

Closes https://github.com/BerriAI/litellm/pull/12276

* test(main.py): Support async await on mock_delay

Closes https://github.com/BerriAI/litellm/issues/12282
2025-07-03 21:15:10 -07:00
Ishaan Jaff bffe5bec7d test fix cli credentials 2025-07-03 21:08:35 -07:00
Ishaan Jaff e03686de5f tests fix use correct import responses 2025-07-03 21:06:31 -07:00
Ishaan Jaff 4293dd2c2a test: stabilize credentials CLI patch (#12305) 2025-07-03 18:09:32 -07:00
Krrish Dholakia 35ecfb7737 docs(index.md): cleanup 2025-07-03 17:35:49 -07:00
Ishaan Jaff 3ad6b36ffc test: patch CredentialsManagementClient in CLI (#12304) 2025-07-03 17:01:50 -07:00
Ishaan Jaff 005de79dd5 Fix Deepeval logger debug formatting (#12303) 2025-07-03 16:45:38 -07:00
Ishaan Jaff e7374e3909 test_gemini_url_context 2025-07-03 16:13:44 -07:00