vllm/spec_decode/spec_decode_worker.py · 8344f7742b794ca6ec9bcb891c178cd0551f23d0 · OpenDAS / vllm_cscc

leiwen83 authored May 08, 2024


Co-authored-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

8344f774

spec_decode_worker.py 19.9 KB