Commit Graph
27004 Commits
Author SHA1 Message Date
Krrish Dholakia 6637beb247 fix: minor fixes + dep updates 2025-11-01 13:45:42 -07:00
Sameer KankuteandGitHub 2337d150e4 Fix azure doesn't accept extra body param (#16116)
* Fix azure doesn't accept extra body param

* add test issue
2025-11-01 13:31:40 -07:00
Sameer KankuteandGitHub f804ab6de5 Add LLM provider response headers to Responses API (#16091)
* Add llm headers to responses api

* fix mock test
2025-11-01 13:25:56 -07:00
Sameer KankuteandGitHub 887b2e2d98 Add support for empty assitant message in between messages (#15850) 2025-11-01 13:25:21 -07:00
steve-gore-snapdocsandGitHub ef2000bfb7 Remove minimum validation for cache control injection index (#16149) 2025-11-01 13:22:24 -07:00
Alexsander HamirandGitHub 542378e604 add: minimum resource requirement (#16146) 2025-11-01 13:17:37 -07:00
Alexsander HamirandGitHub 1dc7d197e7 fix: resolve memory leak caused by Pydantic 2.11+ deprecation warnings (#16110)
- Access model_fields on class instead of instance to avoid deprecation warnings
- Add warning filter to suppress Pydantic instance attribute access warnings
- Fix affects streaming operations where warnings accumulate over time
- Updated cost_calculator.py, core_helpers.py, and model_response_utils.py

The previous implementation accessed model_fields on Pydantic model instances,
which triggers deprecation warnings in Pydantic 2.11+. These warnings accumulate
during streaming operations, causing memory leaks. Now accessing model_fields
via type(instance).model_fields to prevent warning generation.
2025-11-01 13:16:32 -07:00
Krrish Dholakia ef7d81865b build: update dependencies 2025-11-01 12:58:39 -07:00
Krrish Dholakia 0ae74aca88 build: add new migration file 2025-11-01 12:37:40 -07:00
Krrish Dholakia e01fe0ed95 docs: document milvus endpoints 2025-11-01 12:17:02 -07:00
058b6a66eb Add custom_llm_provider support for video endpoints (non-generation) (#16121)
* fix model error for apis which don't need model

* fix print statments:

* fix mypy lint errors

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-11-01 12:09:11 -07:00
Krish DholakiaandGitHub 43aacf2dc0 (feat) Azure AI Vector Stores - support "virtual" indexes + create vector store on passthrough API (#16160)
* feat(vector_store_endpoints/endpoints.py): add new index_create endpoint

allows admin to create a virtual index, to do permission management for

* feat(key_management_endpoints.py): enable setting allowed_vector_store_indexes on keys

proxy admin can enable dev to create an index on a vector stor

* feat: initial commit adding vector store index passthrough logic to litellm

* feat: add vector store table

* fix(azure_ai/transformation.py): fix headers

* feat: track read/write endpoints by vector store integration

enables permissions by index to work

* fix: azure_ai/vector_stores/search

document the vector store endpoints correctly

 ensures permission management works as expected

* fix(proxy/utils.py): improve error message

* docs(azure_ai_vector_stores_passthrough.md): document azure ai passthrough vector store support

* docs(create.md): document azure ai support via passthrough for vector store create

* fix: fix code qa errors

* fix: document new allowed_vector_store_indexes endpoint
2025-11-01 12:01:32 -07:00
Krish DholakiaandGitHub b02be1ba70 (feat) Milvus - search vector store support + (fix) Passthrough Endpoints - support multi-part form data on passthrough (#16035)
* feat(milvus/): initial commit adding milvus vector store support to LiteLLM

allows querying milvus vector store through litellm

* feat(bedrock/vector_stores): support translating openai filters param to aws kb

adds filtering to aws kb

* feat(milvus/): add milvus vector store unified search support

allows calling milvus vector store in through chat completions

* docs(milvus_vector_stores.md): document new milvus vector search integration

* feat(pass_through_endpoints.py): support passing form data through to a passthrough endpoint

Closes LIT-1147

* fix: fix linting errors
2025-11-01 12:00:29 -07:00
Ishaan Jaffer 22d35e2552 docs fix 2025-11-01 11:13:25 -07:00
Ishaan Jaffer 3c0d530197 test_async_vertexai_response_basic v1.79.1-nightly v1.79.1.rc.1 2025-11-01 10:58:48 -07:00
Ishaan Jaffer a188e5f8e4 test_litellm_anthropic_prompt_caching_system 2025-11-01 10:51:15 -07:00
Ishaan Jaffer 27502cfdfd fix PROXY_BATCH_WRITE_AT 2025-11-01 10:48:52 -07:00
Ishaan Jaffer 2608d37e8e test prompt caching ant 2025-11-01 10:36:22 -07:00
Ishaan Jaffer b41ad66e38 ant test prompt caching 2025-11-01 10:09:01 -07:00
Ishaan Jaffer 99ebd8f95a fix: fix batch_writing_interval 2025-11-01 10:01:55 -07:00
Ishaan Jaffer a45e2049f3 test_tool_call_with_empty_enum_property 2025-11-01 09:27:05 -07:00
yuneng-jiangandGitHub 31a4ab4780 Building UI (#16158) 2025-11-01 09:26:52 -07:00
Ishaan Jaffer 978c52291f test_rerank_custom_callbacks 2025-11-01 09:25:29 -07:00
Ishaan Jaffer bf934c0799 test_anthropic_api_prompt_caching_basic_with_cache_creation 2025-11-01 09:21:42 -07:00
Ishaan Jaffer 9632b96df7 mypy lint fix 2025-11-01 09:21:25 -07:00
Ishaan Jaffer 14543324af test_team_budget_metrics 2025-11-01 09:21:17 -07:00
Ishaan Jaffer 4f47680cbe fix test fixes 2025-10-31 21:00:31 -07:00
Ishaan Jaffer f2b5a5f832 test google endpoints 2025-10-31 20:50:31 -07:00
Ishaan Jaffer cd379c1321 test_anthropic_websearch 2025-10-31 20:43:07 -07:00
Ishaan Jaffer b18cef300a undo test_anthropic_websearch change 2025-10-31 20:39:24 -07:00
Ishaan Jaffer 290e608818 get_computer_tool_beta_header 2025-10-31 20:38:37 -07:00
Ishaan Jaffer a401055975 get_computer_tool_beta_header 2025-10-31 20:38:30 -07:00
Ishaan Jaffer 5e4da65664 fail ai test fix 2025-10-31 20:32:44 -07:00
Ishaan Jaffer 014362cace fix ocr test 2025-10-31 20:32:03 -07:00
Ishaan Jaffer 8388319863 fix _extract_usage_for_ocr_call 2025-10-31 20:31:53 -07:00
Ishaan Jaffer a964e7f24c test_stream_token_counting_anthropic_with_include_usage 2025-10-31 20:24:58 -07:00
Ishaan Jaffer 2f1e947c44 test_anthropic_api_prompt_caching_basic 2025-10-31 19:32:46 -07:00
Ishaan Jaffer 27a98de600 test_health_and_chat_completion 2025-10-31 19:28:59 -07:00
Ishaan Jaffer cd9cf2e6bd test fix 2025-10-31 19:23:08 -07:00
Ishaan Jaffer af73879659 db_migration_disable_update_check 2025-10-31 19:23:08 -07:00
Ishaan Jaffer c918dafb32 test_router_fallbacks_with_custom_model_costs 2025-10-31 19:23:08 -07:00
eeda5ab84e requirements update (#16054)
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2025-10-31 19:18:03 -07:00
Ishaan Jaffer 6be9b97d15 test_stream_token_counting_anthropic_with_include_usage 2025-10-31 19:15:07 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
1bc88b5fc9 build(deps): bump starlette from 0.47.2 to 0.49.1 (#16027)
Bumps [starlette](https://github.com/Kludex/starlette) from 0.47.2 to 0.49.1.
- [Release notes](https://github.com/Kludex/starlette/releases)
- [Changelog](https://github.com/Kludex/starlette/blob/main/docs/release-notes.md)
- [Commits](https://github.com/Kludex/starlette/compare/0.47.2...0.49.1)

---
updated-dependencies:
- dependency-name: starlette
  dependency-version: 0.49.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-10-31 19:13:11 -07:00
Ishaan Jaffer 6e46824939 test_streaming_response 2025-10-31 19:10:38 -07:00
Ishaan Jaffer 515ae9680e test_anthropic_tool_use 2025-10-31 19:08:32 -07:00
Ishaan Jaffer f173cb0f54 test_anthropic_text_editor 2025-10-31 19:07:46 -07:00
Ishaan Jaffer 928fddb3be test_anthropic_structured_output 2025-10-31 19:06:45 -07:00
Ishaan Jaffer 7f79abb552 test_aastreaming_tool_calls_valid_json_str 2025-10-31 19:05:31 -07:00
Ishaan Jaffer 2cd57540a4 fix test fixes 2025-10-31 18:31:00 -07:00