Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8b798eec75cde6eb6fe65b5d673dd9bd4eaef799
Switch branch/tag
vllm_cscc
vllm
spec_decode
util.py
16 Apr, 2024
1 commit
[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)
· e95cd879
Cade Daniel
authored
Apr 16, 2024
e95cd879
25 Mar, 2024
1 commit
[CI] Try introducing isort. (#3495)
· 01bfb22b
SangBin Cho
authored
Mar 25, 2024
01bfb22b
09 Mar, 2024
1 commit
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103)
· 8437bae6
Cade Daniel
authored
Mar 08, 2024
8437bae6
