Commits · a495fc3b8ab482f5060a31e9060da6c994e5a9be · OpenDAS / vllm_cscc

10 Jul, 2025 1 commit
- fix zero overhead to support chunk prefill · a495fc3b
  zhuwenwen authored Jul 10, 2025
  
  a495fc3b
26 May, 2025 1 commit
- Update sequence.py fix assert error。 · d82fa156
  lizhg1 authored May 26, 2025
  
  d82fa156
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929
09 May, 2025 11 commits
- debug on v0.8.5 · cf1d8464
  lizhigong authored May 09, 2025
  
  cf1d8464
- pause speculative decoding with zero overhead scheduling, develop tbo first · 0ee425a6
  lizhigong authored May 08, 2025
  
  0ee425a6
- rm debug log · 7d224eb2
  lizhigong authored May 08, 2025
  
  7d224eb2
- debug spec decode zero overhead · 0ecda6d1
  lizhigong authored May 08, 2025
  
  0ecda6d1
- add spec decode zero overhead · 01c30741
  lizhigong authored Apr 27, 2025
  
  01c30741
- delete triton kernel ,use tensor indices · b01c8270
  lizhigong authored Apr 27, 2025
  
  b01c8270
- fix zero scheduler on v0.8.4 · 1ed30424
  lizhigong authored Apr 27, 2025
  
  1ed30424
- fix stop remote worker bug · 351d607d
  lizhigong authored Apr 27, 2025
  
  351d607d
- add VLLM_ZERO_DISABLE_AUTO_THREAD VLLM_ZERO_NO_THREAD change zero scheduling logic · 9076ef2b
  lizhigong authored Apr 15, 2025
  
  9076ef2b
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
- add v0 zero overhead · 54294854
  lizhigong authored Apr 11, 2025
  
  54294854