Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e0624a14d1348768018a579eed4f36bb871e9477
Switch branch/tag
vllm_cscc
vllm
zero_overhead
llm_engine.py
09 May, 2025
9 commits
pause speculative decoding with zero overhead scheduling, develop tbo first
· 0ee425a6
lizhigong
authored
May 08, 2025
0ee425a6
debug spec decode zero overhead
· 0ecda6d1
lizhigong
authored
May 08, 2025
0ecda6d1
add spec decode zero overhead
· 01c30741
lizhigong
authored
Apr 27, 2025
01c30741
delete triton kernel ,use tensor indices
· b01c8270
lizhigong
authored
Apr 27, 2025
b01c8270
fix zero scheduler on v0.8.4
· 1ed30424
lizhigong
authored
Apr 27, 2025
1ed30424
fix stop remote worker bug
· 351d607d
lizhigong
authored
Apr 27, 2025
351d607d
add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic
· 9076ef2b
lizhigong
authored
Apr 15, 2025
9076ef2b
debug v0 zero overhead schedule
· 4ff58b66
lizhigong
authored
Apr 14, 2025
4ff58b66
add v0 zero overhead
· 54294854
lizhigong
authored
Apr 11, 2025
54294854
