Commits · 41199996658428e6780f99c1ffff3ecc3bc5cc91 · OpenDAS / vllm_cscc

04 Dec, 2025 2 commits
- add nn_moe · a1b2eff7
  zhuwenwen authored Dec 04, 2025
  
  a1b2eff7
- Add new benchmark configurations for gfx936_80cu with E=512,N=64 and... · 0765eb67
  laibao authored Dec 04, 2025
```
Add new benchmark configurations for gfx936_80cu with E=512,N=64 and E=512,N=128 Qwen3-Next-80B-A3B-Instruct nn tp4 tp8 moe json
```
  0765eb67
02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 85fb2e31
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
(cherry picked from commit 951445a5)
```
  85fb2e31
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
01 Dec, 2025 1 commit
- [Doc] fix heading levels (#29783) · f5516039
  Liu Jinyi authored Dec 01, 2025
```
Signed-off-by: KKKZOZ <kkkzoz@qq.com>
```
  f5516039
29 Nov, 2025 2 commits

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

[Misc] Refactor tokenizer interface (#29693) · 34a98427
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
34a98427

24 Nov, 2025 1 commit

[Doc]: fix typos in various files (#29230) · eca7a8fb

Didier Durand authored Nov 24, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

eca7a8fb

20 Nov, 2025 1 commit
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
18 Nov, 2025 2 commits
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
- [Benchmark] multi_turn: Report warmup-inclusive runtime (#28937) · 49a986ec
  Ido Segev authored Nov 18, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  49a986ec
16 Nov, 2025 2 commits

[Benchmark] Fix client seed synchronization in multi-turn benchmark (#28512) · d231876c
ai-jz authored Nov 15, 2025
```
Signed-off-by: ai-jz <aijz.xplr@gmail.com>
```
d231876c

Adding a benchmark for batch invariance (#28161) · f849ee73

Bram Wasti authored Nov 16, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f849ee73

13 Nov, 2025 1 commit
- Fix: Correctly filter special tokens in benchmark_prefix_caching (#28615) · e63fd445
  Di Wu authored Nov 13, 2025
```
Signed-off-by: Di Wu <dw2761@nyu.edu>
```
  e63fd445
12 Nov, 2025 1 commit
- [Benchmark] Add retry support to fix workload bias in multi-turn benchmark (#28493) · f31419ed
  ai-jz authored Nov 11, 2025
  
  f31419ed
11 Nov, 2025 4 commits
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
- Add request timeout override for multi-turn benchmarks (#28386) · 3380543b
  Ido Segev authored Nov 11, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  3380543b
- Multi turn benchmark progress bar for synthetic conversation generation (#28394) · d381eb96
  Ido Segev authored Nov 11, 2025
```
Signed-off-by: Ido Segev <idos@pliops.com>
```
  d381eb96
- Fix rotary embedding benchmark script (#28323) · 57201a6a
  Xin Yang authored Nov 10, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  57201a6a
10 Nov, 2025 2 commits

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248) · d17ecc6b

Ilya Markov authored Nov 11, 2025

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d17ecc6b

[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for... · 03fa4d3f

Xiake Sun authored Nov 10, 2025


[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

03fa4d3f

06 Nov, 2025 1 commit
- Disable nm-testing models with issues in CI (#28206) · f3222929
  Michael Goin authored Nov 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f3222929
04 Nov, 2025 2 commits
- [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) · e4ee6586
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  e4ee6586
- Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435) · 2ec401bc
  yugong333 authored Nov 04, 2025
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2ec401bc
01 Nov, 2025 1 commit
- feat(benchmarks): support HF model names in multi-turn benchmark (#27850) · 2c0c7c39
  ai-jz authored Nov 01, 2025
  
  2c0c7c39
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 2 commits
- [Chore] Remove unused `PolyNorm` layer (#27110) · 3125d799
  Isotr0py authored Oct 18, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3125d799
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
16 Oct, 2025 1 commit
- Cleanup code after Python 3.10 upgrade (#26520) · ed344f41
  Lukas Geiger authored Oct 16, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  ed344f41
15 Oct, 2025 1 commit
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 2 commits

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

08 Oct, 2025 3 commits
- Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) · e09d1753
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e09d1753
- [Benchmarks] Fix imports in FP8 tuning script (#26407) · 6273fe8d
  Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  6273fe8d
- [Benchmarks] Add support for Qwen 3 VL MoE tuning (#26419) · 338b1bf0
  Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  338b1bf0
07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from docs and scripts (#26336) · 7e4cd070
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e4cd070
06 Oct, 2025 1 commit
- [Misc] auto_tune: kill specific vllm process (#26304) · 824a3f40
  Karan Goel authored Oct 06, 2025
```
Signed-off-by: Karan Goel <karangoel@google.com>
```
  824a3f40