vllm/compilation/vllm_inductor_pass.py · 690fe019f046c03978ebe728770e5200d4e9d5f2 · OpenDAS / vllm_cscc

[Feature] support sequence parallelism using compilation pass (#16155) · 690fe019

cascade authored Apr 27, 2025


Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

690fe019

vllm_inductor_pass.py 2.4 KB

Replace vllm_inductor_pass.py