tests/spec_decode/test_dynamic_spec_decode.py · 14f91fe67c2342f2fe859dc6a5c40810df0e1c61 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both... · 14f91fe6
sroy745 authored Jul 20, 2024
```
[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)
```
14f91fe6

test_dynamic_spec_decode.py 3.73 KB