vllm/compilation/sequence_parallelism.py · 690fe019f046c03978ebe728770e5200d4e9d5f2 · OpenDAS / vllm_cscc

[Feature] support sequence parallelism using compilation pass (#16155) · 690fe019

cascade authored Apr 27, 2025


Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

690fe019

sequence_parallelism.py 9.41 KB

Replace sequence_parallelism.py