Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc

01 Sep, 2025 1 commit

[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096

JartX authored Sep 01, 2025


[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

183a7096

29 Aug, 2025 1 commit
- [Models] Improve iteration over layers (#19497) · de533ab2
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  de533ab2
25 Aug, 2025 1 commit
- [Bugfix] Fix Qwen3 MoE GPTQ inference (#23490) · a9082a4d
  Isotr0py authored Aug 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a9082a4d
20 Aug, 2025 1 commit

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2

19 Aug, 2025 1 commit
- [Model] Removes redundant all-reduce operation in Qwen3MoeSparseMoeBlock (#23169) · 4f510bc2
  yiz-liu authored Aug 20, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  4f510bc2
13 Aug, 2025 1 commit
- Fix GGUF loader for Qwen3 MoE. (#22785) · b159c0a6
  Gh0u1L5 authored Aug 13, 2025
```
Signed-off-by: Gh0u1L5 <Gh0u1L5@outlook.com>
```
  b159c0a6
12 Aug, 2025 1 commit

Enable 4bit bnb prequant MOE (#21548) · 9b94d6ec

Andy Chen authored Aug 11, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9b94d6ec

11 Aug, 2025 1 commit
- [BUGFIX] KeyError 'layers.14.mlp.gate.g_idx' for Qwen3-MoE with GPTQ on ROCm (#22017) · 1e55dfa7
  JartX authored Aug 11, 2025
  
  1e55dfa7
09 Aug, 2025 1 commit
- [Misc] Use config definitions from Transformers library (#21913) · 65552b47
  Cyrus Leung authored Aug 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65552b47
08 Aug, 2025 1 commit
- Add ModelOpt Qwen3 nvfp4 support (#20101) · d57dc236
  Zhiyu authored Aug 07, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  d57dc236
07 Aug, 2025 1 commit
- [Qwen3] Enable dual-chunk-attention support for Qwen3 models. (#21924) · 7377131a
  Tao He authored Aug 07, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  7377131a
30 Jul, 2025 1 commit
- [Feature][EPLB] Add eplb support for Qwen3 (#20815) · d979dd6b
  aladerran authored Jul 30, 2025
```
Signed-off-by: aladerran <aladerran@gmail.com>
```
  d979dd6b
17 Jul, 2025 1 commit
- [Misc] Qwen MoE model supports LoRA (#20932) · a3a6c695
  Jee Jee Li authored Jul 18, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a3a6c695
14 Jul, 2025 1 commit
- [Quantization] add BNB for MixtralForCausalLM (#20893) · a99b9f7d
  Jee Jee Li authored Jul 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a99b9f7d
12 Jul, 2025 1 commit
- remove qk contiguous · e34d3444
  zhuwenwen authored Jul 12, 2025
  
  e34d3444
11 Jul, 2025 2 commits
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- add qk contiguous · bcf6be4c
  zhuwenwen authored Jul 11, 2025
  
  bcf6be4c
10 Jul, 2025 1 commit
- add apex rmsnorm · 3e0a595d
  zhuwenwen authored Jul 10, 2025
  
  3e0a595d
03 Jul, 2025 1 commit
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
30 Jun, 2025 1 commit
- [Bugfix] Skip loading extra parameters for modelopt Qwen3 MoE model (#19598) · f5dfa075
  noiji authored Jun 30, 2025
```
Signed-off-by: noiji <>
```
  f5dfa075
20 Jun, 2025 1 commit
- [Chore]: qwen3-moe-type-hints-mistake (#19860) · e41bf15c
  Xerxes authored Jun 20, 2025
```
Co-authored-by: xinnan.hou <hxn02029096@alibaba-inc.com>
```
  e41bf15c
12 Jun, 2025 1 commit
- 修复qwen3-moe的awq配置导致fp16加载错误，修复dpsk-moe手写算子首字耗时增加问题 · 99ffef47
  zhuwenwen authored Jun 12, 2025
  
  99ffef47
10 Jun, 2025 1 commit
- Update qwen3_moe.py · 07c69390
  zhuwenwen authored Jun 10, 2025
  
  07c69390
04 Jun, 2025 1 commit
- 修复qwen3-moe-awq的bug问题 · 1a4e4cad
  yangql authored Jun 04, 2025
  
  1a4e4cad
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
26 May, 2025 1 commit
- update qwen3 moe inference · 7bdb03ea
  zhuwenwen authored May 26, 2025
  
  7bdb03ea
20 May, 2025 1 commit
- [Misc] Allow `AutoWeightsLoader` to skip loading weights with specific substr in name (#18358) · f07a673e
  Isotr0py authored May 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  f07a673e
16 May, 2025 1 commit
- update qwen3_moe.py · 9b0aa006
  zhuwenwen authored May 16, 2025
  
  9b0aa006
15 May, 2025 2 commits
- fix qwen3-235b run error and remove update_environment_variables of hip · 3f9af065
  zhuwenwen authored May 15, 2025
  
  3f9af065
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
14 May, 2025 2 commits
- Modularize fused experts and integrate PPLX kernels (#15956) · f9c069c8
  bnellnm authored May 14, 2025
  
  f9c069c8
- [Model] Add packed_modules_mapping for Qwen3-MOE (#18118) · 63dc3426
  Jee Jee Li authored May 14, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  63dc3426
07 May, 2025 1 commit
- [Kernel] Use fused rmsnorm for some models like qwen3 series (#17735) · f80ae5bd
  Wanrui Dai authored May 07, 2025
```
Signed-off-by: evian <eviantai@u.nus.edu>
Co-authored-by: evian <eviantai@u.nus.edu>
```
  f80ae5bd
06 May, 2025 1 commit
- support qwen3-moe nn layout · 4dc24bc8
  zhuwenwen authored May 06, 2025
  
  4dc24bc8
30 Apr, 2025 1 commit
- [Fix] Support passing args to logger (#17425) · da4e7687
  Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  da4e7687
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
08 Apr, 2025 1 commit
- [Model] use AutoWeightsLoader for phimoe,qwen2_moe,qwen3_moe (#16203) · 5a1e1c83
  rongfu.leng authored Apr 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5a1e1c83
07 Apr, 2025 1 commit

[Model] Add Qwen3 and Qwen3MoE (#15289) · 7699258e

YamPengLi authored Apr 07, 2025


Signed-off-by: YamPengLi <yampayne.lyp@alibaba-inc.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

7699258e

05 Mar, 2025 1 commit
- [V1] EP/TP MoE + DP Attention (#13931) · 72c62eae
  Tyler Michael Smith authored Mar 05, 2025
  
  72c62eae
04 Mar, 2025 1 commit
- Clean up unused padding_idx variables across many model definitions (#13240) · 4f5b059f
  Tyler Michael Smith authored Mar 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  4f5b059f