Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
faf71bcd4b11b6d350431f432af08ccd9f30016f
Switch branch/tag
vllm_cscc
tests
spec_decode
test_dynamic_spec_decode.py
05 Jun, 2024
1 commit
[Speculative Decoding] Add `ProposerWorkerBase` abstract class (#5252)
· faf71bcd
Nick Hill
authored
Jun 05, 2024
faf71bcd
25 May, 2024
1 commit
[Dynamic Spec Decoding] Minor fix for disabling speculative decoding (#5000)
· d5a16977
Lily Liu
authored
May 25, 2024
d5a16977
08 May, 2024
1 commit
[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592)
· f942efb5
Cody Yu
authored
May 08, 2024
Co-authored-by:
Cade Daniel
<
edacih@gmail.com
>
f942efb5
Cade Daniel <edacih@gmail.com>
Cade Daniel <edacih@gmail.com>