Commits · d805c59c2ab5c5abb6ee108f7bdd28cdcc01b615 · OpenDAS / vllm_cscc

12 Jun, 2025 1 commit
- add VLLM_TBO_DECODE_BS to support and setting the min bs on tbo decode · aa906d98
  lizhigong authored Jun 12, 2025
  
  aa906d98
06 Jun, 2025 1 commit
- fix 修改tbo的线程管理和线程释放方式，减少对其他模块的影响 · 59488cc9
  lizhigong authored Jun 06, 2025
  
  59488cc9
05 Jun, 2025 1 commit
- 过滤重复创建thread · 87ef4618
  lizhigong authored Jun 05, 2025
  
  87ef4618
04 Jun, 2025 1 commit
- fix tbo to support pipeline-parallel · 1a906ab9
  lizhigong authored Jun 04, 2025
  
  1a906ab9
26 May, 2025 2 commits
- debug and fix tbo error in mtp · bf790acd
  lizhigong authored May 26, 2025
  
  bf790acd
- fix tbo support deepseek mtp · 7124e74d
  lizhigong authored May 26, 2025
  
  7124e74d
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 1 commit
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
19 May, 2025 2 commits
- 优化stream的初始化和warmup方式 · 828aeaae
  lizhigong authored May 19, 2025
  
  828aeaae
- 调试tbo正确性 · 56ffc380
  lizhigong authored May 19, 2025
  
  56ffc380
16 May, 2025 1 commit
- 修复zero-overhead首字正确性问题，zero-overhead不使用默认流调整，增加two-batch-overlap功能 · 2a935929
  lizhigong authored May 16, 2025
  
  2a935929