vllm/spec_decode/top1_proposer.py · b12518d3cf4326dfcd10a09780913b86c19fcf1a · OpenDAS / vllm_cscc

"vllm/lora/model_manager.py" did not exist on "ca76486a16fbf9659a80e8b34b919e0065108f25"

[Model] MLPSpeculator speculative decoding support (#4947) · b12518d3

Joshua Rosenkranz authored Jun 20, 2024


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
Co-authored-by: Davis Wertheimer <Davis.Wertheimer@ibm.com>

b12518d3

top1_proposer.py 11.6 KB

Replace top1_proposer.py