Commits · 0da696a79c36e8eca4ea6bf46b71d9b4edb689f4 · OpenDAS / vllm_cscc

19 Jan, 2026 1 commit
- remove SUPPORT_MOE_MARLIN_W16A16 · 6216b12d
  zhuwenwen authored Jan 19, 2026
  
  6216b12d
16 Jan, 2026 1 commit
- add SUPPORT_MOE_MARLIN_W16A16 to use moe marlin on bw · ad60a973
  zhuwenwen authored Jan 16, 2026
  
  ad60a973
14 Jan, 2026 1 commit
- fix tests of kernels · 0e607f8e
  zhuwenwen authored Jan 14, 2026
```
set VLLM_USE_PD_SPLIT=1
update moe_align_block_size
```
  0e607f8e
10 Jan, 2026 1 commit
- remove pa · 29a9e952
  zhuwenwen authored Jan 10, 2026
  
  29a9e952
09 Jan, 2026 1 commit
- update SUPPORT_TC · d4cc442a
  zhuwenwen authored Jan 09, 2026
  
  d4cc442a
13 Nov, 2025 1 commit
- 修改triton 量化w8a8 config命令方式 · 9f7f976c
  zhuwenwen authored Nov 13, 2025
```
add deps of pd-pp
```
  9f7f976c
31 Oct, 2025 1 commit
- update moe configs name · 28021d6e
  zhuwenwen authored Oct 31, 2025
  
  28021d6e
01 Oct, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

26 Sep, 2025 1 commit

[Misc] fix unique_filepath (#25732) · 56aafa8c

Jiangyun Zhu authored Sep 27, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

56aafa8c

25 Sep, 2025 2 commits
- [mypy] Further improve MM type annotations (#25654) · 12c1287d
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12c1287d
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
24 Sep, 2025 5 commits

Improve `--help` for enhanced user experience (#24903) · e7f27ea6
Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
e7f27ea6
[Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f291412

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[Misc] Improve type annotations for jsontree (#25577) · 9313be50
Cyrus Leung authored Sep 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
9313be50

[Spec Decode] Enable FlashInfer Spec Decoding (#25196) · c30b405b

Benjamin Chislett authored Sep 23, 2025


Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: lhsjohn <huashuoli@tencent.com>

c30b405b

23 Sep, 2025 4 commits

Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[core] add nccl symmetric memory for all reduce (#24532) · 8c1c81a3

Amir Samani authored Sep 23, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8c1c81a3

[Perf] Apply torch.compile for `per_block_cast_to_fp8` (#24611) · 9949aa2e
Wentao Ye authored Sep 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
9949aa2e

22 Sep, 2025 3 commits

[torch.compile] Cleanup compilation tests and custom passes, add debug utils,... · d5e0fca2

Luka Govedič authored Sep 22, 2025


[torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) (#24542)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d5e0fca2

Make `mypy` behave like a proper pre-commit hook (#25313) · 3d2c56b7

Harry Mellor authored Sep 22, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

3d2c56b7

[Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
417a164a

21 Sep, 2025 1 commit
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
20 Sep, 2025 2 commits
- [Docs] Fix warnings in mkdocs build (continued) (#25042) · 032d661d
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  032d661d
- [BugFix] Exclude self when checking for port collision (#25286) · b7f186bb
  Nick Hill authored Sep 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  b7f186bb
19 Sep, 2025 1 commit

[CORE] Prompt Embeddings Support for v1 Engine (#24278) · 9a4600e4

Andrew Sansom authored Sep 18, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Andrew Sansom <qthequartermasterman@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9a4600e4

17 Sep, 2025 1 commit

[Bugfix] Refactor Flashinfer TRTLLM attention kernel selection logic (#24600) · e67a79db

elvischenv authored Sep 18, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

e67a79db

16 Sep, 2025 1 commit
- [Deprecation] Remove DeepGEMM Old Symbol Wrapper (#24902) · de2cc3d8
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  de2cc3d8
13 Sep, 2025 1 commit
- [Core][Multimodal] Cache `supports_kw` (#24773) · 1da0f144
  Lukas Geiger authored Sep 13, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1da0f144
12 Sep, 2025 1 commit
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
11 Sep, 2025 2 commits

[flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197) · e42af78b
Xiaozhu Meng authored Sep 11, 2025
```
Signed-off-by: Xiaozhu <mxz297@gmail.com>
```
e42af78b

Allow users to specify kv cache memory size (#21489) · 94e6b2d5

Boyuan Feng authored Sep 11, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

94e6b2d5

09 Sep, 2025 3 commits
- [ROCm][Feature] Enable Pipeline Parallelism with Ray Compiled Graph on ROCm (#24275) · 73e688cb
  Charlie Fu authored Sep 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  73e688cb
- [Misc] Improve Worker process title and logging prefix (#22205) · 0cdd2136
  22quinn authored Sep 08, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  0cdd2136
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
31 Aug, 2025 1 commit
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
30 Aug, 2025 2 commits

Fix wrong truncate_prompt_tokens type hint (#22761) · 5b8077b8

Gabriel Marinho authored Aug 30, 2025

Signed-off-by: Gabriel Marinho <gmarinho@ibm.com>
Signed-off-by: Gabriel Marinho <104592062+gmarinho2@users.noreply.github.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

5b8077b8

[Bugfix] Fix --config arg expansion called from api_server.py (#23944) · 5b31cb17

dubejf authored Aug 30, 2025


Signed-off-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Jean-Francois Dube <dubejf+gh@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

5b31cb17

29 Aug, 2025 1 commit
- Adds `json_count_leaves` utility function (#23899) · 4f7cde72
  Adit Chawdhary authored Aug 29, 2025
```
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
```
  4f7cde72