Ishaan Jaff c9ab104445 [Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305) ...

* Implement pass-through route registration and removal to prevent duplicates and memory leaks

* fix MYPY linting

* fix InitPassThroughEndpointHelpers

* fix test_aaparallel_function_call

---------

Co-authored-by: Jugal Bhatt <jugalbhatt3@gmail.com>

2025-09-06 19:22:25 -07:00

..

llm_provider_handlers

unit test oai pass through

2025-09-06 14:54:34 -07:00

test_llm_pass_through_endpoints.py

fix application inference profile for pass-through endpoints for bedrock

2025-08-20 00:40:43 -07:00

test_pass_through_endpoints.py

[Fix] Perf fix: Heavy RAM Usage over time when using Passthrough Routes (#14305)

2025-09-06 19:22:25 -07:00

test_passthrough_endpoints_common_utils.py

test fix location of encode bedrock runtime modelid arn

2025-08-22 17:34:09 -07:00