vllm/v1/spec_decode/extract_hidden_states.py · 757068dc65f6760fec1692ae587d8be13e100ee2 · OpenDAS / vllm_cscc

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556) · 757068dc

Matthew Bonanni authored Mar 31, 2026


Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>

757068dc

extract_hidden_states.py 15.4 KB

Replace extract_hidden_states.py