Commits · 34553b9d2702dd2a27a578fec819e88e76dcbfb4 · OpenDAS / vllm_cscc

10 Nov, 2025 1 commit
- [Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492) · 34553b9d
  jiahanc authored Nov 10, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  34553b9d
09 Nov, 2025 2 commits
- [Kernel] Fix fused_gdn_gating (#28343) · c4768dcf
  Jiangyun Zhu authored Nov 10, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c4768dcf
- [Misc] Add some comments in qwen3-next (#28267) · 7ae5a5fb
  Jiangyun Zhu authored Nov 09, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  7ae5a5fb
06 Nov, 2025 1 commit
- [PERF] Decouple projections from GDN custom op. Attempt 2 (#28083) · b6a248bd
  Vadim Gimpelson authored Nov 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  b6a248bd
05 Nov, 2025 2 commits

[Kernel] Fuse computation of g and beta for Gated Delta Net (#28095) · c18f88c6
Jiangyun Zhu authored Nov 06, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
c18f88c6

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

04 Nov, 2025 2 commits
- Revert "[PERF] Decouple projections from GDN custom op" (#28080) · d4e547bb
  Vadim Gimpelson authored Nov 05, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  d4e547bb
- [PERF] Decouple projections from GDN custom op (#27512) · 5fd8f02e
  Vadim Gimpelson authored Nov 04, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  5fd8f02e
29 Oct, 2025 1 commit

[perf] Enable concurrent execution of "shared_experts" and "selected_experts"... · 8df98c21

Jiangyun Zhu authored Oct 29, 2025


[perf] Enable concurrent execution of "shared_experts" and "selected_experts" in qwen3-next (#27578)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>

8df98c21

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [Bugfix][Qwen] fixes the weights dtype in qwen3_next: it is actually a bfloat16 (#27030) · bde9e227
  Tao He authored Oct 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  bde9e227
16 Oct, 2025 1 commit

[PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select /... · 785d8b64

Vadim Gimpelson authored Oct 16, 2025


[PERF] Qwen3-next MTP speedup (change bool mask indexing to index_select / index_copy to reduce d2h) (#26437)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

785d8b64

15 Oct, 2025 1 commit
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
27 Sep, 2025 1 commit
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
26 Sep, 2025 1 commit
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
23 Sep, 2025 2 commits
- Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7361ab37
- [V1] Remove V0 code paths for Hybrid models (#25400) · a903669e
  Thomas Parnell authored Sep 23, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  a903669e
21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
20 Sep, 2025 1 commit

[BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ... · 36429096

JartX authored Sep 20, 2025


[BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ and AutoRound-GPTQ) (#25268)
Signed-off-by: JartX <sagformas@epdcenter.es>

36429096

19 Sep, 2025 1 commit
- [Qwen] Remove cuda hard-code in qwen3 next (#25243) · 838d7116
  Icey authored Sep 19, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
  838d7116
18 Sep, 2025 3 commits

[PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
072d7e53
[Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
ef7eefe1

[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in... · 027d37df

toncao authored Sep 18, 2025


[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

027d37df

17 Sep, 2025 2 commits
- [Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. (#24957) · dd6a910a
  Tao He authored Sep 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  dd6a910a
- [Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4a9375fe
12 Sep, 2025 1 commit
- [BugFix] Fix Qwen3-Next PP (#24709) · f592b317
  Nick Hill authored Sep 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f592b317
11 Sep, 2025 2 commits
- [Bugifx] Fix qwen-next packed_modules_mapping (#24656) · 817beef7
  Jee Jee Li authored Sep 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  817beef7
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9