2 Commits

Author	SHA1	Message	Date
Krish Dholakia	dd92b1a0ac	Refactor: bedrock passthrough fixes - migrate to Passthrough SDK (#12089) ... * feat: initial commit adding bedrock support via the new sdk passthrough logic ensures correct sequencing of tasks (pre call checks etc. can run before signing request) * fix(route_llm_requests.py): passthrough to allm_passthrough_route if no model found * feat(bedrock/passthrough): working bedrock passthrough via sdk support * fix(passthrough/main.py): re-add data and json * feat(passthrough/main): support async passthrough calls to bedrock * feat(passthrough/main.py): async streaming + completion support * feat(llm_passthrough_endpoints.py): migrate bedrock passthrough calls to to new bedrock passthrough sdk Enables calls to work correctly * fix: fix linting errors * test: update test	2025-06-26 22:51:35 -07:00
Krrish Dholakia	51f716c762	build(VLLM-Passthrough-with-loadbalancing-support-(enables-using-model-list-for-VLLM-/classify-endpoint)): Closes #11205	2025-05-31 09:00:04 -07:00