Commits · 74c6e2189da105223a187f96e7b71c0185258cee · OpenDAS / vllm_cscc · GitLab

20 Nov, 2025 2 commits
- DS_v2_w4a8_CRQ增加slilu_mul_quant支持 · 075841f3
  wujl5 authored Nov 20, 2025
  
  075841f3
- MLA模块CRQ融合分支增加rms_cuda_opt · 8c646ebe
  wujl5 authored Nov 20, 2025
  
  8c646ebe
18 Nov, 2025 1 commit
- deepseekv2-w4a8支持custom-rms-quant融合 · 3e6729e0
  wujl5 authored Nov 18, 2025
  
  3e6729e0
04 Nov, 2025 1 commit
- add contiguous+rmsnorm to replace triton_ · 2afbdacb
  zhuwenwen authored Nov 04, 2025
  
  2afbdacb
24 Oct, 2025 1 commit
- set USE_FUSED_RMS_QUANT=0 and USE_FUSED_SILU_MUL_QUANT=0 · 46dd30e7
  zhuwenwen authored Oct 24, 2025
```
add VLLM_USE_LIGHTOP_MOE_SUM_MUL_ADD
```
  46dd30e7
15 Oct, 2025 1 commit
- 删除DPSK_FP16_QUICK，以及增加awq和blockwiseint8的shared_output接口 · 50cb9270
  yangql authored Oct 15, 2025
  
  50cb9270
13 Oct, 2025 2 commits
- 去掉all2all ep相关代码 · 0b467604
  王敏 authored Oct 13, 2025
  
  0b467604
- support dsv32 · 633f8199
  zhuwenwen authored Oct 13, 2025
  
  633f8199
25 Sep, 2025 1 commit
- [kernels] add fused_rms_norm_contiguous and rotary_embedding_deepseek_fuse · 49810c37
  zhuwenwen authored Sep 25, 2025
```
[kernels] update moe_align_block_size and moe_sum interface
```
  49810c37
24 Sep, 2025 1 commit
- [kernel] add lightop's moe_sum(mul+add) fusion operator for deepseek · 8d2cac26
  zhuwenwen authored Sep 24, 2025
```
[FIX] 修复mtp和VLLM_USE_TRITON_CAT不能一起开的bug
```
  8d2cac26
22 Sep, 2025 1 commit
- deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3964e019
  wujl5 authored Sep 22, 2025
  
  3964e019
14 Sep, 2025 1 commit
- deepseek-r1-w4a8使用rmsquant融合算子及横向融合 · fc443d52
  wujl5 authored Sep 14, 2025
  
  fc443d52
01 Sep, 2025 2 commits
- [feat]添加all2all ep · ffa325e0
  王敏 authored Sep 01, 2025
  
  ffa325e0
- [BugFix]支持v1 engine pp deepseek · 4a946680
  zhuwenwen authored Sep 01, 2025
  
  4a946680
29 Aug, 2025 1 commit
- 修复residual FP16 overflow，解决mtp采样率和数据集精度的冲突 · 080ed180
  yangql authored Aug 29, 2025
  
  080ed180
25 Jul, 2025 1 commit
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
15 Jul, 2025 1 commit
- 修复在fp16下的数值越界导致的精度问题 · 18f030d9
  zhuwenwen authored Jul 15, 2025
  
  18f030d9
30 Jun, 2025 2 commits
- 修复channelwise w8a8 预热没有区分卡造成的triton kernel崩溃问题，另外增加block-int8的moe 拿到config步骤 · c0c0eb69
  gaoqiong authored Jun 30, 2025
  
  c0c0eb69
- [BUGFIX][DEEPSEEK][MODEL_LOAD] fix w13, w2 weight not initialized assert (#20202) · 5a52f389
  Chendi.Xue authored Jun 29, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  5a52f389
26 Jun, 2025 1 commit
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
13 Jun, 2025 1 commit
- 解耦w8a8 的gemm以及moe算子相关实现 · 942368c7
  gaoqiong authored Jun 13, 2025
  
  942368c7
05 Jun, 2025 2 commits
- 新增qwen3 fusemoe优化支持 · 1cb37dab
  yangql authored Jun 05, 2025
  
  1cb37dab
- 修改deepseelk block-int8 权重处理流程，增加per-channel bestconfig配置以及首次triton warmup代码 · 40b94473
  gaoqiong authored Jun 05, 2025
  
  40b94473
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 2 commits
- [feat]适配sgl moe_fused_gate kernel · 0b229519
  王敏 authored May 27, 2025
  
  0b229519
- 修复0.8.5 config找不到的bug · 823b3332
  gaoqiong authored May 27, 2025
  
  823b3332
23 May, 2025 1 commit
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
22 May, 2025 2 commits
- 优化awq权重转换的方式，修复可能会导致蒸馏模型加载时报错的bug · a94ed3ea
  yangql authored May 22, 2025
  
  a94ed3ea
- fix tbo to support deepseek · 0cc7c880
  lizhigong authored May 22, 2025
  
  0cc7c880
15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
14 May, 2025 1 commit
- Modularize fused experts and integrate PPLX kernels (#15956) · f9c069c8
  bnellnm authored May 14, 2025
  
  f9c069c8
09 May, 2025 1 commit
- [Attention] MLA move rotary embedding to cuda-graph region (#17668) · 5e6f9394
  Lucas Wilkinson authored May 08, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  5e6f9394
02 May, 2025 1 commit
- [Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  afcb3f88
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
16 Apr, 2025 1 commit
- update moe models of LM_NN · 2db90e2c
  zhuwenwen authored Apr 16, 2025
  
  2db90e2c
11 Apr, 2025 1 commit
- Revert "[Model] use AutoWeightsLoader for deepseek_v2, internlm2" (#16453) · 905e91e9
  DefTruth authored Apr 11, 2025
  
  905e91e9
10 Apr, 2025 1 commit
- [Model] use AutoWeightsLoader for deepseek_v2, internlm2 (#16383) · a9bd832f
  Aaron Ang authored Apr 10, 2025
```
Signed-off-by: Aaron Ang <aaron.angyd@gmail.com>
```
  a9bd832f
08 Apr, 2025 1 commit

[Bugfix] fix deepseek fp16 scale bug (#14809) · db104221

Jinzhen Lin authored Apr 09, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

db104221

07 Apr, 2025 1 commit
- 增加fused-moe int4/int8的支持，以及deepseek精度问题的修复 · bb94d2e5
  yangql authored Apr 07, 2025
  
  bb94d2e5
01 Apr, 2025 1 commit
- 去掉自研专家并行代码 · 9beadbfb
  王敏 authored Apr 01, 2025
  
  9beadbfb