Commits · a495fc3b8ab482f5060a31e9060da6c994e5a9be · OpenDAS / vllm_cscc · GitLab

10 Jul, 2025 1 commit
- fix zero overhead to support chunk prefill · a495fc3b
  zhuwenwen authored Jul 10, 2025
  
  a495fc3b
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
09 May, 2025 10 commits
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464
- pause speculative decoding with zero overhead scheduling, develop tbo first · 0ee425a6
  lizhigong authored May 08, 2025
  
  0ee425a6
- debug spec decode zero overhead · 0ecda6d1
  lizhigong authored May 08, 2025
  
  0ecda6d1
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- delete triton kernel ,use tensor indices · b01c8270
  lizhigong authored Apr 27, 2025
  
  b01c8270
- fix zero scheduler on v0.8.4 · 1ed30424
  lizhigong authored Apr 27, 2025
  
  1ed30424
- fix stop remote worker bug · 351d607d
  lizhigong authored Apr 27, 2025
  
  351d607d
- add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic · 9076ef2b
  lizhigong authored Apr 15, 2025
  
  9076ef2b
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854