Commits · 7e63ef827a6da01d510694777dba5ea5712af837 · OpenDAS / vllm_cscc

"vllm/compilation/passes/utility/fix_functionalization.py" did not exist on "fc407a14259992e330c641fdfb0d62067ee02ae2"

12 Jan, 2026 1 commit
- [cpu][bench] Add Fused MoE Micro Benchmark for CPU Backend (#32092) · 5e034f2e
  Andika Rachman authored Jan 12, 2026
```
Signed-off-by: andikarachman <andika.rachman.y@gmail.com>
```
  5e034f2e
09 Jan, 2026 2 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
08 Jan, 2026 2 commits

[MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71

Robert Shaw authored Jan 07, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

9f6dcb71

[MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
Robert Shaw authored Jan 07, 2026

5dcd7ef1

07 Jan, 2026 1 commit

[Misc] Improve error messages for unsupported types and parameters (#30593) · 0790f076

BlankR authored Jan 07, 2026


Signed-off-by: BlankR <hjyblanche@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0790f076

06 Jan, 2026 3 commits
- [Misc] Use `deprecated` for `seed_everything` (#31780) · db318326
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db318326
- [cpu][bench] Add CPU paged attention benchmarks (#31720) · 799b5721
  Fadi Arafeh authored Jan 06, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  799b5721
- [Bugfix] Add init_workspace_manager to moe kernel benchmarks (#31042) · e1cd7a5f
  Michael Goin authored Jan 05, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e1cd7a5f
02 Jan, 2026 1 commit
- [Benchmark] Fix OOM during MoE kernel tuning for large models (#31604) · a0e9ee83
  Alfred authored Jan 03, 2026
```
Signed-off-by: Alfred <massif0601@gmail.com>
```
  a0e9ee83
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

23 Dec, 2025 1 commit
- [Chore] Update more locations to use `attention_config.backend` (#31153) · 8cef1376
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8cef1376
21 Dec, 2025 1 commit
- [NVFP4][Perf] Tune NVFP4 input quant kernel for small batch size (#30897) · 06d49028
  Michael Goin authored Dec 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  06d49028
16 Dec, 2025 1 commit
- [Perf][Kernels] Vectorize `csrc/activations_kernels.cu` (#29512) · 0a1ab1e5
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0a1ab1e5
15 Dec, 2025 1 commit

[Benchmarks] `auto_tune.sh`: Use hostname variable for server requests (#30529) · c01d5898

Kevin Musgrave authored Dec 15, 2025

Signed-off-by: Kevin Musgrave <kevin.musgrave@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c01d5898

13 Dec, 2025 2 commits
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- update benchmark_paged_attention.py and ops.h of convert_vertical_slash_indexes · c004bf6e
  zhuwenwen authored Dec 13, 2025
  
  c004bf6e
11 Dec, 2025 4 commits
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [Bugfix] Fix `task` still being passed in tests/benchmarks (#30476) · d917747c
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d917747c
- [perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) · fba89069
  Ming Yang authored Dec 11, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fba89069
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
10 Dec, 2025 1 commit
- [Misc] Consistent case for `vllm bench serve` results (#30403) · 794a7875
  Matthew Bonanni authored Dec 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  794a7875
09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

04 Dec, 2025 2 commits
- add nn_moe · a1b2eff7
  zhuwenwen authored Dec 04, 2025
  
  a1b2eff7
- Add new benchmark configurations for gfx936_80cu with E=512,N=64 and... · 0765eb67
  laibao authored Dec 04, 2025
```
Add new benchmark configurations for gfx936_80cu with E=512,N=64 and E=512,N=128 Qwen3-Next-80B-A3B-Instruct nn tp4 tp8 moe json
```
  0765eb67
03 Dec, 2025 2 commits

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163) · 9bcf9229

Lumis Chen authored Dec 04, 2025


Signed-off-by: LuminolT <lumischen01@gmail.com>
Signed-off-by: Lumis Chen <lumischen01@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

9bcf9229

02 Dec, 2025 3 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 85fb2e31
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
(cherry picked from commit 951445a5)
```
  85fb2e31
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
01 Dec, 2025 1 commit
- [Doc] fix heading levels (#29783) · f5516039
  Liu Jinyi authored Dec 01, 2025
```
Signed-off-by: KKKZOZ <kkkzoz@qq.com>
```
  f5516039
29 Nov, 2025 2 commits

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

[Misc] Refactor tokenizer interface (#29693) · 34a98427
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
34a98427

24 Nov, 2025 1 commit

[Doc]: fix typos in various files (#29230) · eca7a8fb

Didier Durand authored Nov 24, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

eca7a8fb

20 Nov, 2025 1 commit
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
18 Nov, 2025 2 commits
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
- [Benchmark] multi_turn: Report warmup-inclusive runtime (#28937) · 49a986ec
  Ido Segev authored Nov 18, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  49a986ec