Commits · 91ccb1cc83301d42f117d576ad2a0322461841f3 · OpenDAS / vllm_cscc

26 Aug, 2025 1 commit
- v1 engine eager tbo support mla attention · 91ccb1cc
  lizhigong authored Aug 26, 2025
  
  91ccb1cc
04 Aug, 2025 1 commit
- add tbo on v1 engine · 20e75ed6
  lizhigong authored Aug 02, 2025
  
  20e75ed6
11 Jul, 2025 1 commit
- tbo debug fix error · 957096ce
  lizhigong authored Jul 11, 2025
  
  957096ce
10 Jul, 2025 1 commit
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
12 Jun, 2025 1 commit
- add VLLM_TBO_DECODE_BS to support and setting the min bs on tbo decode · aa906d98
  lizhigong authored Jun 12, 2025
  
  aa906d98
06 Jun, 2025 1 commit
- fix 修改tbo的线程管理和线程释放方式，减少对其他模块的影响 · 59488cc9
  lizhigong authored Jun 06, 2025
  
  59488cc9
05 Jun, 2025 1 commit
- 过滤重复创建thread · 87ef4618
  lizhigong authored Jun 05, 2025
  
  87ef4618
04 Jun, 2025 1 commit
- fix tbo to support pipeline-parallel · 1a906ab9
  lizhigong authored Jun 04, 2025
  
  1a906ab9
26 May, 2025 2 commits
- debug and fix tbo error in mtp · bf790acd
  lizhigong authored May 26, 2025
  
  bf790acd
- fix tbo support deepseek mtp · 7124e74d
  lizhigong authored May 26, 2025
  
  7124e74d
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 1 commit
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
19 May, 2025 2 commits
- 优化stream的初始化和warmup方式 · 828aeaae
  lizhigong authored May 19, 2025
  
  828aeaae
- 调试tbo正确性 · 56ffc380
  lizhigong authored May 19, 2025
  
  56ffc380
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929