Commits · d76fc11ef5d40f86019811873ae340c8dcb64e3a · OpenDAS / vllm_cscc

26 Jan, 2026 2 commits
- [ROCm][Bugfix] Fix ptpc scale load issue for fused shared expert path in deepseek mtp (#33018) · be6931ee
  Pleaplusone authored Jan 26, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  be6931ee
- [Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcd80206
12 Jan, 2026 1 commit
- [Model] Remove incorrect `SupportsPP` from MTP models (#32150) · 600aaab8
  Cyrus Leung authored Jan 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  600aaab8
07 Jan, 2026 1 commit
- [BugFix] LoRA: Support loading base_layer of experts (#31104) · 48291484
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Jan 07, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  48291484
18 Dec, 2025 1 commit
- [refactor] Add prefix support to embed_tokens in DeepSeek MTP (#30788) · b166ef20
  zzhxxx authored Dec 18, 2025
```
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
```
  b166ef20
02 Dec, 2025 2 commits

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 339e84ce

Matthew Bonanni authored Dec 02, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
(cherry picked from commit 51c57b51)

339e84ce

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 51c57b51

Matthew Bonanni authored Dec 02, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

51c57b51

24 Nov, 2025 1 commit
- [Bugfix][Rocm] Fix shared expert weight loading failure in DeepSeek-MTP (#27563) · 8005e606
  杰兮 authored Nov 24, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  8005e606
13 Nov, 2025 3 commits
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
- [fix]解决moe_fused_gate编译错误，去掉mla中mtp部分的修改 · f687d53c
  王敏 authored Nov 13, 2025
  
  f687d53c
- restore v32 support · 81eaff62
  zhuwenwen authored Nov 13, 2025
  
  81eaff62
05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

30 Oct, 2025 1 commit
- [MTP] Refactor mtp predictor to avoid d2h operation (#27643) · 10042057
  Mengqing Cao authored Oct 31, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  10042057
21 Oct, 2025 1 commit
- [Bugfix] Fix broken MTP weight loading for FP8 KV Scales (#27227) · f381cf23
  Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  f381cf23
15 Oct, 2025 1 commit
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit

[Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc

Lucas Wilkinson authored Oct 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

29255cfc

06 Oct, 2025 1 commit
- [Bugfix] Allow skipping MoE in NVFP4 (fix for MTP) (#25987) · 2161efe9
  Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  2161efe9
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [Model] Supplement to PR 24862: Pass param prefix to LLMHead (#25805) · cbf92219
  whx authored Oct 03, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  cbf92219
01 Oct, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

27 Sep, 2025 1 commit

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
09 Sep, 2025 1 commit
- [Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134) · 955c6249
  Tyler Michael Smith authored Sep 08, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  955c6249
18 Aug, 2025 1 commit
- [fix]修复mtp eager模式下显存占用增加问题 · ac4cc84e
  zhuwenwen authored Aug 18, 2025
  
  ac4cc84e
16 Aug, 2025 1 commit
- [Bugfix] Fix DeepSeek MTP (#22934) · fbd88728
  Benjamin Chislett authored Aug 15, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  fbd88728
06 Aug, 2025 2 commits
- Revert "Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样"" · 467490e6
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 33485749.
```
  467490e6
- Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样" · 33485749
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 93fae6b1.
```
  33485749
05 Aug, 2025 1 commit
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
31 Jul, 2025 1 commit
- [Bugfix] Fix MTP weight loading (#21941) · 2dff2e21
  Benjamin Chislett authored Jul 31, 2025
  
  2dff2e21
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
03 Jul, 2025 1 commit
- 增加dpsk awq mtp推理的支持 · f9795c8c
  zhuwenwen authored Jul 03, 2025
  
  f9795c8c
25 Jun, 2025 1 commit
- [V1][Speculative Decoding] Fix DeepSeek MTP (#20022) · 8359f4c8
  cjackal authored Jun 26, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  8359f4c8
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
23 May, 2025 1 commit

[V1] Support Deepseek MTP (#18435) · 2628a69e

Jiayi Yao authored May 23, 2025


Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

2628a69e

15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
27 Feb, 2025 2 commits
- [Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626) · 9804145c
  Benjamin Chislett authored Feb 27, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  9804145c
- update mtp layout · c5888d31
  zhuwenwen authored Feb 27, 2025
  
  c5888d31