Commits · 2afcec4decbbd64cf8da20d49281f828dd136c27 · OpenDAS / vllm_cscc

30 Nov, 2025 1 commit
- [Misc] Update `TokenizerLike` interface and move `get_cached_tokenizer` (#29730) · 2afcec4d
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2afcec4d
29 Nov, 2025 2 commits

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

[Doc]: fix code block rendering (#29728) · f4341f45
dublc authored Nov 29, 2025
```
Signed-off-by: dublc <jdublc0x@gmail.com>
```
f4341f45

28 Nov, 2025 1 commit

[Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef

Yanan Cao authored Nov 28, 2025


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

3461e7ef

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 1 commit
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
25 Nov, 2025 1 commit
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
24 Nov, 2025 1 commit

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

22 Nov, 2025 1 commit
- [docs] Fix cudagraph mode config (#29170) · d5dbdbfc
  Angela Yi authored Nov 21, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  d5dbdbfc
21 Nov, 2025 2 commits
- [Doc] Update plugin doc (#28532) · 4050bae4
  wangxiyuan authored Nov 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  4050bae4
- [V0 deprecation] Remove more V0 references (#29088) · aab0102a
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aab0102a
19 Nov, 2025 3 commits
- [Doc]: fix typos in various files (#29010) · 09540cd9
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  09540cd9
- [Docs] Clean up moe_kernel_features.md (#28530) · fdf93486
  Michael Yao authored Nov 19, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  fdf93486
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
18 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28863) · 083cf326
  Didier Durand authored Nov 18, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  083cf326
16 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28811) · 63fed555
  Didier Durand authored Nov 16, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  63fed555
15 Nov, 2025 1 commit
- [Doc]: fix typos in various files (#28567) · 2bb4435c
  Didier Durand authored Nov 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  2bb4435c
14 Nov, 2025 2 commits

[Docs] Enable some more markdown lint rules for the docs (#28731) · 67187554
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
67187554

docs(lora_resolvers): clarify multi-resolver order and storage path requirement (#28153) · 9261eb3d

Chen Wang authored Nov 14, 2025

Signed-off-by: Chen Wang <Chen.Wang1@ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

9261eb3d

12 Nov, 2025 2 commits
- [Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding... · 30441957
  Benjamin Chislett authored Nov 12, 2025
```
[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  30441957
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
10 Nov, 2025 1 commit

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

05 Nov, 2025 2 commits
- [Docs] Add guide to debugging vLLM-torch.compile integration (#28094) · 65ac8d8d
  Richard Zou authored Nov 05, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  65ac8d8d
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
03 Nov, 2025 1 commit

[BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e

ahao-anyscale authored Nov 03, 2025


[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

cac4c10e

30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

24 Oct, 2025 2 commits
- [Doc] Fix minor issues in docs/design/metrics.md (#27436) · 6454afec
  Lifans authored Oct 24, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  6454afec
- [Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
  fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  85fee74b
23 Oct, 2025 1 commit

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121

wang.yuqi authored Oct 23, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>

3fa2c121

22 Oct, 2025 2 commits

[Doc] Fix numbering sequence in prefix caching (#27357) · 1cb8c6c5
William Song authored Oct 23, 2025
```
Signed-off-by: William Song <jinwook@umich.edu>
```
1cb8c6c5

[docs] Update v1 metrics design doc (#27332) · 141d3b9f

Mark McLoughlin authored Oct 22, 2025


Signed-off-by: Simon Mo <simon.mo@hey.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: atalhens <sneh.lata@nutanix.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: atalhens <sneh.lata@nutanix.com>

141d3b9f

18 Oct, 2025 1 commit
- [V1][Metrics][Plugin] Add plugin support for custom `StatLoggerBase` implementations (#22456) · 83e760c5
  Tova Movshovitz authored Oct 19, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  83e760c5
17 Oct, 2025 2 commits
- [Docs] Replace all explicit anchors with real links (#27087) · 483ea646
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  483ea646
- [Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4ffd6e89
16 Oct, 2025 1 commit
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 2 commits
- [Doc] ruff format some Python examples (#26767) · ef9676a1
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef9676a1
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
07 Oct, 2025 1 commit

[Docs] add docs for cuda graph v1 (#24374) · 63773a62

fhl2000 authored Oct 07, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

63773a62