Commits · 1bd3ae330425c16478524015a8e95e4c48fb8c15 · OpenDAS / vllm_cscc

10 Jul, 2025 1 commit
- add two batch overlap decude support muti-stream cuda-graph · fe1c4016
  zhuwenwen authored Jul 10, 2025
  
  fe1c4016
04 Jun, 2025 1 commit
- fix tbo to support pipeline-parallel · 1a906ab9
  lizhigong authored Jun 04, 2025
  
  1a906ab9
26 May, 2025 2 commits
- debug and fix tbo error in mtp · bf790acd
  lizhigong authored May 26, 2025
  
  bf790acd
- fix tbo support deepseek mtp · 7124e74d
  lizhigong authored May 26, 2025
  
  7124e74d
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 1 commit
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880