Commits · a02a1c83b33a6fee7424530d2a1f22a0e753044c · OpenDAS / vllm_cscc · GitLab

11 Sep, 2025 6 commits
- remove redundant routed_scaling_factor · a02a1c83
  zhuwenwen authored Sep 11, 2025
  
  a02a1c83
- remove unused code · a053add9
  zhuwenwen authored Sep 11, 2025
  
  a053add9
- update fa interface · 2b84890b
  zhuwenwen authored Sep 11, 2025
  
  2b84890b
- skip moe_fused_gate · 9c663e50
  zhuwenwen authored Sep 11, 2025
  
  9c663e50
- fix: w4a8 marlin 中 weight重排接入lightop算子 · 4f6c0cd4
  zhuwenwen authored Sep 11, 2025
  
  4f6c0cd4
- add rocm merge_attn_states · 2b8d795b
  zhuwenwen authored Sep 11, 2025
  
  2b8d795b
10 Sep, 2025 8 commits
- update triton kernel to optimize torch cat for ds prefill · f572ca96
  zhuwenwen authored Sep 10, 2025
  
  f572ca96
- support cascade_attention · 787c2557
  zhuwenwen authored Sep 10, 2025
  
  787c2557
- update awq_marlin.py · 533af8ef
  zhuwenwen authored Sep 10, 2025
  
  533af8ef
- update the conditions for pad_v on v0 · 1f9aadcf
  zhuwenwen authored Sep 10, 2025
  
  1f9aadcf
- update the conditions for pad_v · 5f09420d
  zhuwenwen authored Sep 10, 2025
  
  5f09420d
- update setup.py · e005bce5
  zhuwenwen authored Sep 10, 2025
  
  e005bce5
- update flash-attn interface of apply_rotary_emb · 6c0a30bc
  zhuwenwen authored Sep 10, 2025
  
  6c0a30bc
- add VLLM_USE_TRITON_CAT to opt torch cat · b0dfa004
  zhuwenwen authored Sep 10, 2025
  
  b0dfa004
09 Sep, 2025 1 commit
- Merge tag 'v0.10.2rc1' into v0.10.2rc1-dev · a99300bd
  zhuwenwen authored Sep 09, 2025
  
  a99300bd
07 Sep, 2025 4 commits
- [P/D][Feature]显存调度优化，及时释放tensor · cc3e01c7
  zhuwenwen authored Sep 07, 2025
  
  cc3e01c7
- [fix]fix tests of neuron, quantization etc · 82e6b864
  zhuwenwen authored Sep 07, 2025
  
  82e6b864
- fix precision issue in mtp · 9ebe3034
  zhuwenwen authored Sep 07, 2025
  
  9ebe3034
- 增加reduce修改 · 3cec42d1
  zhuwenwen authored Sep 07, 2025
  
  3cec42d1
06 Sep, 2025 4 commits
- [fix]fix tests of core, samplers and tokenization etc. · 1825007b
  zhuwenwen authored Sep 06, 2025
  
  1825007b
- fix performance issues caused by enabling TBO · 5692ab61
  zhuwenwen authored Sep 06, 2025
  
  5692ab61
- fix bugs in zero overhead and tbo · 533c4cbf
  zhuwenwen authored Sep 06, 2025
  
  533c4cbf
- 暂时去掉profilling标志位，避免影响其他模型 · f42ed372
  zhuwenwen authored Sep 06, 2025
  
  f42ed372
04 Sep, 2025 2 commits
- add glm-4.5-air-tp8 nn moe configs · 81301303
  zhuwenwen authored Sep 04, 2025
  
  81301303
- [fix]fix tests of async_engine and compile · 9531829c
  zhuwenwen authored Sep 04, 2025
  
  9531829c
03 Sep, 2025 2 commits
- [fix]fix tests of v1 and worker · b2d58051
  zhuwenwen authored Sep 03, 2025
  
  b2d58051
- fix deepseek pp + mtp issue · bfd0c5b8
  zhuwenwen authored Sep 03, 2025
  
  bfd0c5b8
02 Sep, 2025 1 commit
- [fix]fix tests of kernels · af7b564d
  zhuwenwen authored Sep 02, 2025
  
  af7b564d
01 Sep, 2025 12 commits
- [Misc] add hash_function doc string (#24014) · 5438967f
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5438967f
- [Bugfix] Add support for `<tool_call>` format in streaming mode for XLAM Tool Parser (#22769) · 422e793f
  Code Jesus authored Aug 31, 2025
```
Signed-off-by: Devon Peroutky <devon@kindo.ai>
```
  422e793f
- [Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>
```
  1cb39dbc
- Migrate Phi4 inputs to TensorSchema (#23471) · 437c3ce0
  Benji Beck authored Aug 31, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  437c3ce0
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357) · ff0e59d8
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ff0e59d8
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- Fix the bug related to loading GPTP INT3 weights. (#23328) · acc1a6e1
  Jun-Howie authored Sep 01, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  acc1a6e1
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- [BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096
  JartX authored Sep 01, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  183a7096
- add dca and sparse attention support on rocm · 1faa2c78
  zhuwenwen authored Sep 01, 2025
  
  1faa2c78
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b