tests/entrypoints/sagemaker/test_sagemaker_handler_overrides.py · bca74e32b7ef03515cda508ba88151e2e547bdc9 · OpenDAS / vllm_cscc

[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session... · bca74e32

Zuyi Zhao authored Nov 10, 2025


[Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892)
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

bca74e32

test_sagemaker_handler_overrides.py 25.1 KB

Replace test_sagemaker_handler_overrides.py