Commits · 8824ae6aa83c87fd35e5973001e3df3c94c3358d · OpenDAS / vllm_cscc

17 Sep, 2025 2 commits
- merge 092-dev分支近期修改 · f9f1887d
  王敏 authored Sep 17, 2025
  
  f9f1887d
- fix the performance issue of tbo pd separation · f8985b96
  lizhigong authored Sep 17, 2025
  
  f8985b96
16 Sep, 2025 3 commits
- 修改mori最大输入token数 · 3c08fbc1
  王敏 authored Sep 16, 2025
  
  3c08fbc1
- 接入新的concat算子，包含decode和prefill，并根据size的不同进行选择 · 2233e3d0
  王敏 authored Sep 16, 2025
  
  2233e3d0
- 添加mori ep · 1a56d6cb
  王敏 authored Sep 16, 2025
  
  1a56d6cb
15 Sep, 2025 2 commits
- remove logger.warning · 5eec6110
  zhuwenwen authored Sep 15, 2025
  
  5eec6110
- update moe_align_block_size · d251d4f3
  zhuwenwen authored Sep 15, 2025
  
  d251d4f3
14 Sep, 2025 4 commits
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · fc443d52
  wujl5 authored Sep 14, 2025
  
  fc443d52
- [P/D][Feature]添加pd分离p实例对tbo的支持 · fc0e53fe
  xuxzh1 authored Sep 14, 2025
  
  fc0e53fe
- 完善释放包括cpu和tensor_id释放 · bfe12894
  xuxzh1 authored Sep 14, 2025
  
  bfe12894
- [fix]修复eagle 创建cu_num_tokens类型错误问题 · b4610c06
  王敏 authored Sep 14, 2025
  
  b4610c06
13 Sep, 2025 3 commits
- add VLLM_USE_MERGE_ATTN_STATES_OPT to control merge_attn_states support · 2071c380
  zhuwenwen authored Sep 13, 2025
  
  2071c380
- set VLLM_HAS_CONTEXT_DEFAULT=1 · 48b4c41d
  zhuwenwen authored Sep 13, 2025
  
  48b4c41d
- update triton cat scheduling · b1329ff2
  zhuwenwen authored Sep 13, 2025
```
update the default values of VLLM_USE_TRITON_CAT and VLLM_USE_LIGHT_OP to True
```
  b1329ff2
12 Sep, 2025 1 commit
- update the cat implementation of triton's non contiguous memory for the decode phase · 2c169409
  zhuwenwen authored Sep 12, 2025
  
  2c169409
11 Sep, 2025 3 commits
- 新增dpsk-v3.1-awq的支持 · e5f51b79
  yangql authored Sep 11, 2025
  
  e5f51b79
- update fa interface · bf3d75f4
  zhuwenwen authored Sep 11, 2025
  
  bf3d75f4
- fix: w4a8 marlin 中 weight重排接入lightop算子 · 082d41a1
  jujl1 authored Sep 10, 2025
  
  082d41a1
10 Sep, 2025 9 commits
- add rocm merge_attn_states · f6324f60
  zhuwenwen authored Sep 10, 2025
  
  f6324f60
- update triton kernel to optimize torch cat for ds prefill · 90e40f49
  zhuwenwen authored Sep 10, 2025
  
  90e40f49
- support cascade_attention · ead74dfa
  zhuwenwen authored Sep 10, 2025
  
  ead74dfa
- update the conditions for pad_v on v0 · d6dc122f
  zhuwenwen authored Sep 10, 2025
  
  d6dc122f
- update the conditions for pad_v · aaa89e82
  zhuwenwen authored Sep 10, 2025
  
  aaa89e82
- 临时添加mori代码 · 3cb11400
  王敏 authored Sep 10, 2025
  
  3cb11400
- update flash-attn interface of apply_rotary_emb · 37707203
  zhuwenwen authored Sep 10, 2025
  
  37707203
- update VLLM_USE_TRITON_CAT during the prefill phase · 7d959770
  zhuwenwen authored Sep 10, 2025
  
  7d959770
- use VLLM_USE_TRITON_CAT during the prefill phase · 072d4638
  zhuwenwen authored Sep 10, 2025
  
  072d4638
09 Sep, 2025 6 commits
- update flashmla.py · ff090f36
  zhuwenwen authored Sep 09, 2025
  
  ff090f36
- import concatv3Tritonfinal · 5973c805
  zhuwenwen authored Sep 09, 2025
  
  5973c805
- add VLLM_USE_TRITON_CAT to opt torch cat · 379315a0
  zhuwenwen authored Sep 09, 2025
  
  379315a0
- update qwen2_vl and qwen2_5_vl conv layout · 71cb74ff
  zhuwenwen authored Sep 09, 2025
  
  71cb74ff
- update flash-attn interface to support keye · 4d53d14c
  zhuwenwen authored Sep 09, 2025
  
  4d53d14c
- fix: 优化w4a8 marlin 中 weight重排耗时 · ffab74dd
  jujl1 authored Sep 09, 2025
  
  ffab74dd
08 Sep, 2025 1 commit
- update op.moe_fused_gate · bc9aee38
  zhuwenwen authored Sep 08, 2025
  
  bc9aee38
07 Sep, 2025 2 commits
- add VLLM_USE_LIGHT_OP to optimize moe_align_block_size and moe_fused_gate · a54ab95d
  zhuwenwen authored Sep 07, 2025
  
  a54ab95d
- 临时添加cudagraph代码，目前还有问题 · fe70dcb2
  王敏 authored Sep 07, 2025
  
  fe70dcb2
06 Sep, 2025 4 commits
- Update version.py · 59a345ac
  gaoqiong authored Sep 06, 2025
  
  59a345ac
- 回退修改的version.py · 4e471b8a
  gaoqiong authored Sep 06, 2025
  
  4e471b8a
- [P/D][Feature]显存调度优化，及时释放tensor · ed392378
  zhuwenwen authored Sep 06, 2025
  
  ed392378
- [fix]fix tests of neuron, quantization etc · dc2aff4c
  zhuwenwen authored Sep 06, 2025
  
  dc2aff4c