Commits · 4ccffe561f0bc9fe007fdaafe8342171592db7db · OpenDAS / vllm_cscc

12 Nov, 2025 1 commit

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

11 Nov, 2025 1 commit
- [Feature] Add env var `VLLM_MOE_USE_DEEP_GEMM` (#28422) · de540c03
  Wentao Ye authored Nov 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  de540c03
04 Nov, 2025 2 commits
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af
- [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) · 4022a9d2
  Varun Sundar Rabindranath authored Nov 04, 2025
  
  4022a9d2
30 Oct, 2025 1 commit

[BugFix] Stopgap - Flashinfer Autotuner + GPT-OSS + DP/TP (#27762) · e5e076ca

Varun Sundar Rabindranath authored Oct 30, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

e5e076ca

21 Oct, 2025 1 commit

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e

Varun Sundar Rabindranath authored Oct 21, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5ff5d94e

16 Oct, 2025 1 commit

[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to... · b3dda72c

Wentao Ye authored Oct 16, 2025


[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b3dda72c

13 Oct, 2025 1 commit

[UX] Speedup DeepGEMM warmup with heuristics (#25619) · 0d21b9b5

Michael Goin authored Oct 13, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

0d21b9b5

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
24 Sep, 2025 1 commit

[Bug] Fix AttributeError: 'FusedMoE' object has no attribute... · 88d7bdbd

Wentao Ye authored Sep 23, 2025


[Bug] Fix AttributeError: 'FusedMoE' object has no attribute 'w13_weight_scale'. Did you mean: 'w13_weight_scale_inv' (#25519)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

88d7bdbd

23 Sep, 2025 1 commit
- [Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
  bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f11e3c51
18 Sep, 2025 1 commit
- [BugFix] Fix DeepGEMM warmup, no m.weight_scale_inv (#25206) · 9fac6aa3
  Lucas Wilkinson authored Sep 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  9fac6aa3
17 Sep, 2025 1 commit
- [Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
  bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  5963b98b
12 Sep, 2025 1 commit
- [Startup] Make DeepGEMM warmup scale with max-num-batched-tokens (#24693) · 2e6bc468
  Lucas Wilkinson authored Sep 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  2e6bc468
11 Sep, 2025 1 commit

[Kernel][B200] `mxfp4` fused cutlass moe (#23696) · 074854b2

Duncan Moss authored Sep 11, 2025


Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

074854b2

10 Sep, 2025 1 commit

[Perf] Warmup FlashInfer attention during startup (#23439) · fba78565

Michael Goin authored Sep 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>

fba78565

14 Aug, 2025 1 commit

[Kernel] Add nvfp4 gemm flashinfer backends (#22346) · 279a5f31

nvjullin authored Aug 15, 2025


Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

279a5f31

10 Aug, 2025 1 commit
- [Docs] Fix warnings in docs build (#22588) · 00976db0
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  00976db0
08 Aug, 2025 1 commit

[Misc] DeepGEMM : Avoid JIT generation in the hot-path (#22215) · f703b923

Varun Sundar Rabindranath authored Aug 08, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

f703b923