vllm/executor/cpu_executor.py · 539aa9926007d4896397ca3fa83d48da492b4831 · OpenDAS / vllm_cscc

"cacheflow/core/block_manager.py" did not exist on "c128c2ed0309dd1ff684ac0da2f8fc7ea5994b77"

[Core][Bugfix][Perf] Introduce `MQLLMEngine` to avoid `asyncio` OH (#8157) · 7c7714d8

Alexander Matveev authored Sep 18, 2024


Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>

7c7714d8

cpu_executor.py 14.1 KB

Replace cpu_executor.py