Commits · ba29eebb9660946892b6fd7f72bc70532f4ae2ac · OpenDAS / vllm_cscc

11 Aug, 2025 1 commit
- add v1 engine zero overhead · 59e80222
  lizhigong authored Aug 11, 2025
  
  59e80222
05 Aug, 2025 1 commit
- merge and debug tbo on 0.9.2 · 3f8b2afe
  lizhigong authored Aug 05, 2025
  
  3f8b2afe
04 Aug, 2025 1 commit
- add tbo on v1 engine · 20e75ed6
  lizhigong authored Aug 02, 2025
  
  20e75ed6
11 Jul, 2025 1 commit
- tbo debug fix error · 957096ce
  lizhigong authored Jul 11, 2025
  
  957096ce
10 Jul, 2025 1 commit
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
12 Jun, 2025 1 commit
- add VLLM_TBO_DECODE_BS to support and setting the min bs on tbo decode · aa906d98
  lizhigong authored Jun 12, 2025
  
  aa906d98
06 Jun, 2025 1 commit
- fix 修改tbo的线程管理和线程释放方式，减少对其他模块的影响 · 59488cc9
  lizhigong authored Jun 06, 2025
  
  59488cc9
05 Jun, 2025 1 commit
- 过滤重复创建thread · 87ef4618
  lizhigong authored Jun 05, 2025
  
  87ef4618
04 Jun, 2025 1 commit
- fix tbo to support pipeline-parallel · 1a906ab9
  lizhigong authored Jun 04, 2025
  
  1a906ab9
26 May, 2025 2 commits
- debug and fix tbo error in mtp · bf790acd
  lizhigong authored May 26, 2025
  
  bf790acd
- fix tbo support deepseek mtp · 7124e74d
  lizhigong authored May 26, 2025
  
  7124e74d
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 1 commit
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
19 May, 2025 2 commits
- 优化stream的初始化和warmup方式 · 828aeaae
  lizhigong authored May 19, 2025
  
  828aeaae
- 调试tbo正确性 · 56ffc380
  lizhigong authored May 19, 2025
  
  56ffc380
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929