Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
9d43afcc538645625ea5fc2bca01d3697dd0595c
Switch branch/tag
vllm_cscc
vllm
spec_decode
spec_decode_worker.py
Find file
Blame
History
Permalink
[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)
· 9d43afcc
Nicolò Lucchesi
authored
Nov 07, 2024
Signed-off-by:
NickLucche
<
nlucches@redhat.com
>
9d43afcc
spec_decode_worker.py
52.1 KB
Edit
Web IDE
Replace spec_decode_worker.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace spec_decode_worker.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
NickLucche <nlucches@redhat.com>