Commits · 913249f9078076ff2f11f38ce09f80b5d08de68c · OpenDAS / vllm_cscc

30 Sep, 2025 7 commits
- fix Z100L&K100 precision error · 913249f9
  zhuwenwen authored Sep 30, 2025
  
  913249f9
- fix pp error and update min_block_size · d95de221
  zhuwenwen authored Sep 30, 2025
  
  d95de221
- when v1 is set to block_size 16, switch to triton implementation · 083ff6ec
  zhuwenwen authored Sep 30, 2025
  
  083ff6ec
- update cat kernel · a4fc4d7e
  zhuwenwen authored Sep 30, 2025
  
  a4fc4d7e
- DeepSeek-R1-Channel-INT8调用rmsquant融合 · 9f087f8b
  zhuwenwen authored Sep 30, 2025
  
  9f087f8b
- [kernels] add rotary_embedding_deepseek_fuse · 1e911dbd
  zhuwenwen authored Sep 30, 2025
```
off rotary_embedding_deepseek_fuse
```
  1e911dbd
- feat: moe_align_block_size 更新lightop 接口,加入对ep的支持 · 63f1c793
  zhuwenwen authored Sep 30, 2025
  
  63f1c793
26 Sep, 2025 5 commits
- update op · dfe1a844
  zhuwenwen authored Sep 26, 2025
  
  dfe1a844
- add PD P do pp · dbce493a
  zhuwenwen authored Sep 26, 2025
  
  dbce493a
- update layer.py · cbaa3d62
  zhuwenwen authored Sep 26, 2025
  
  cbaa3d62
- [fix] pp+mtp bs 1 correctness · df49168d
  zhuwenwen authored Sep 26, 2025
  
  df49168d
- update VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · f8cf43ae
  zhuwenwen authored Sep 26, 2025
  
  f8cf43ae
25 Sep, 2025 2 commits
- update VLLM_USE_LIGHTOP and VLLM_USE_OPT_CAT · f70d0ec6
  zhuwenwen authored Sep 25, 2025
  
  f70d0ec6
- Merge remote-tracking branch 'origin/v0.10.2-dev-longcat' into v0.10.2-dev · f6a1053c
  zhuwenwen authored Sep 25, 2025
  
  f6a1053c
24 Sep, 2025 1 commit
- fix scheduler issu in pp + mtp · ad477f82
  zhuwenwen authored Sep 24, 2025
  
  ad477f82
23 Sep, 2025 5 commits
- add convert_vertical_slash_indexes and convert_vertical_slash_indexes_mergehead · 1e636721
  zhuwenwen authored Sep 23, 2025
  
  1e636721
- 修复W4A8 PP8崩溃问题 · d70425b2
  zhuwenwen authored Sep 23, 2025
  
  d70425b2
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3155bf9e
  zhuwenwen authored Sep 23, 2025
  
  3155bf9e
- 修改P等待问题 · 98cf1a9e
  zhuwenwen authored Sep 23, 2025
  
  98cf1a9e
- Update layernorm.py · 5dc2dc0d
  zhuwenwen authored Sep 23, 2025
  
  5dc2dc0d
22 Sep, 2025 2 commits
- update glm4.5v conv layout · dcaa837c
  zhuwenwen authored Sep 22, 2025
  
  dcaa837c
- update tp_size · dc6f80a5
  zhuwenwen authored Sep 22, 2025
  
  dc6f80a5
18 Sep, 2025 5 commits
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
- update common.py · a441a5d9
  zhuwenwen authored Sep 18, 2025
  
  a441a5d9
- fix the performance issue of tbo pd separation · 109c414a
  zhuwenwen authored Sep 18, 2025
  
  109c414a
- 接入新的concat算子，包含decode和prefill，并根据size的不同进行选择 · e37d6cc3
  zhuwenwen authored Sep 18, 2025
  
  e37d6cc3
- [fix]fix tests of engine · 7f7e2f5a
  zhuwenwen authored Sep 18, 2025
  
  7f7e2f5a
16 Sep, 2025 1 commit
- update activation args · e808fae2
  zhuwenwen authored Sep 16, 2025
  
  e808fae2
15 Sep, 2025 5 commits
- remove logger.warning · 9682758b
  zhuwenwen authored Sep 15, 2025
  
  9682758b
- update moe_align_block_size · 8e2b79b4
  zhuwenwen authored Sep 15, 2025
  
  8e2b79b4
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · 9f201bc1
  zhuwenwen authored Sep 15, 2025
  
  9f201bc1
- [P/D][Feature]添加pd分离p实例对tbo的支持 · 243b2f0c
  zhuwenwen authored Sep 15, 2025
  
  243b2f0c
- 完善释放包括cpu和tensor_id释放 · 5865aaba
  zhuwenwen authored Sep 15, 2025
  
  5865aaba
14 Sep, 2025 5 commits
- update deepseek_v2.py · 2743daa4
  zhuwenwen authored Sep 14, 2025
  
  2743daa4
- update lora args · badc34b9
  zhuwenwen authored Sep 14, 2025
  
  badc34b9
- Merge tag 'v0.10.2' into v0.10.2-dev · 8d56d7a5
  zhuwenwen authored Sep 14, 2025
  
  8d56d7a5
- add VLLM_USE_MERGE_ATTN_STATES_OPT to control merge_attn_states support · 55ddae82
  zhuwenwen authored Sep 14, 2025
  
  55ddae82
- update triton cat scheduling · ede0aa39
  zhuwenwen authored Sep 14, 2025
```
update the default values of VLLM_USE_TRITON_CAT, VLLM_USE_LIGHT_OP and VLLM_HAS_CONTEXT_DEFAULT to True
```
  ede0aa39
13 Sep, 2025 2 commits
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 26b999c7
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  26b999c7
- [Compilation Bug] Fix Inductor Graph Output with Shape Issue (#24772) · da3fa78d
  Wentao Ye authored Sep 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  da3fa78d