Commits · 5d16d0fa629eb8ff3d92b0f1eed06548c5277e81 · OpenDAS / vllm_cscc

21 Oct, 2025 4 commits

[Deepseek v3.2] Remove extra logics in indexer (#26465) · 09a7e6f6

Lain authored Oct 21, 2025


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Lain <siyuanf@nvidia.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>

09a7e6f6

[Performance] Dual stream execution of "shared_experts" and "selected_experts"... · 344a0017

Alexander Matveev authored Oct 21, 2025


[Performance] Dual stream execution of "shared_experts" and "selected_experts" inside FusedMoE (#26440)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>

344a0017

[Deepseek v3.2] Optimize top_k_per_row (#26763) · 80e94529
Daniel Cámpora authored Oct 21, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
80e94529

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

18 Oct, 2025 2 commits
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
  Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b26b70be
16 Oct, 2025 1 commit

[ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097) · 13170343

kliuae authored Oct 16, 2025


Signed-off-by: chenjun <junchen2@amd.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: valarLip <103567126+valarLip@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

13170343

15 Oct, 2025 2 commits
- [Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456) · f5ed68ef
  Yongye Zhu authored Oct 15, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  f5ed68ef
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits

[Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
47e66c24

Separate MLAAttention class from Attention (#25103) · e614ab78

Naveenraj Kamalakannan authored Oct 08, 2025

Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e614ab78

07 Oct, 2025 1 commit

Add topk logits torch op for DS3.2. (#25945) · e1098ced

Daniel Cámpora authored Oct 07, 2025

Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Daniel Cámpora <961215+dcampora@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

e1098ced

06 Oct, 2025 1 commit
- [Bugfix] Allow skipping MoE in NVFP4 (fix for MTP) (#25987) · 2161efe9
  Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  2161efe9
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
02 Oct, 2025 1 commit
- [Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1e50f1be
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

27 Sep, 2025 1 commit
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
25 Sep, 2025 1 commit
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
23 Sep, 2025 1 commit
- Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7361ab37
21 Sep, 2025 2 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
17 Sep, 2025 1 commit
- [Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4a9375fe
09 Sep, 2025 1 commit
- [Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134) · 955c6249
  Tyler Michael Smith authored Sep 08, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  955c6249
06 Sep, 2025 1 commit

[Core] Allow disabling TP sharding for parallel Linear layer (#23024) · 53b19ccd

Isotr0py authored Sep 06, 2025

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

53b19ccd

04 Sep, 2025 1 commit
- [Attention][Platform] Refactor MLA to support Custom Op (#23332) · 3efb9f4d
  whx authored Sep 04, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  3efb9f4d
03 Sep, 2025 1 commit
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
02 Sep, 2025 1 commit
- [Bug] R1 Accuracy: Fix `routed_scaling_factor` Double Mul Issue (#24119) · 930a2414
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  930a2414
30 Aug, 2025 2 commits

Add LoRA support for DeepSeek models (V2, V3, R1-0528) (#23971) · 379ea282

sadegh.shokatian authored Aug 30, 2025


Signed-off-by: sadeghja1070 <sadegh.ja1070@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

379ea282

Add routed_scaling_factor to MoE grouped topk (#23123) · 8fb85b7b

Xin Yang authored Aug 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8fb85b7b

29 Aug, 2025 1 commit
- [Models] Improve iteration over layers (#19497) · de533ab2
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  de533ab2
26 Aug, 2025 1 commit
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac
20 Aug, 2025 1 commit

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2

09 Aug, 2025 1 commit
- [Misc] Use config definitions from Transformers library (#21913) · 65552b47
  Cyrus Leung authored Aug 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  65552b47
07 Aug, 2025 1 commit
- [Bugfix] Add missing `packed_modules_mapping` to `DeepseekV2ForCausalLM` (#22352) · 7e0b1218
  fxmarty-amd authored Aug 07, 2025
```
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
```
  7e0b1218
30 Jul, 2025 1 commit
- [Model] Remove DSV2 unused code (#21903) · fc91da54
  Jee Jee Li authored Jul 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fc91da54
23 Jul, 2025 1 commit
- [BUGFIX] deepseek-v2-lite failed due to fused_qkv_a_proj name update (#21414) · 08d2bd78
  Chendi.Xue authored Jul 22, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  08d2bd78
22 Jul, 2025 1 commit
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
19 Jul, 2025 1 commit
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
10 Jul, 2025 1 commit
- Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665) · ad6c2e1a
  Seiji Eicher authored Jul 09, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  ad6c2e1a