Commits · 014ece97c7aa49084a1119dca792af081a18dbc1 · OpenDAS / vllm_cscc

01 Dec, 2025 4 commits

[Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
014ece97
[Frontend] Resettle pooling entrypoints (#29634) · 62de4f42
wang.yuqi authored Dec 01, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
62de4f42
Make PyTorch profiler gzip and CUDA time dump configurable (#29568) · 1ab8fc81
Yifei Zhang authored Dec 01, 2025
```
Signed-off-by: Yifei Zhang <yifei.zhang1992@outlook.com>
```
1ab8fc81

[MoE] CuteDSL MoE with Nvfp4 DeepEP dispatch (#27141) · f72a817b

Shu Wang authored Nov 30, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f72a817b

30 Nov, 2025 13 commits
- [Model Runner V2] Use packed mask for prompt bin counts (#29756) · ec38a736
  Woosuk Kwon authored Nov 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ec38a736
- [Misc]Remove redundant hidden_size property in ModelConfig (#29749) · 21c26279
  Xingyu Liu authored Dec 01, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  21c26279
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
- Fix RoPE failures in Transformers nightly (#29700) · cd719de5
  Harry Mellor authored Nov 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cd719de5
- [ROCm][Attention] Sliding window support for `AiterFlashAttentionBackend` (#29234) · 8c363ed6
  Pleaplusone authored Nov 30, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  8c363ed6
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
- [Bugfix] Fix mismatched nvfp4 gemm output shape (#29742) · 47539cfd
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  47539cfd
- [Misc] Update `TokenizerLike` interface and move `get_cached_tokenizer` (#29730) · 2afcec4d
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2afcec4d
- [Doc]: Fix typo in fused_moe layer (#29731) · 9381b5cd
  朝 authored Nov 30, 2025
```
Signed-off-by: BowTen <bowten@qq.com>
```
  9381b5cd
- [Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783) · 66b58402
  Vensen authored Nov 30, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  66b58402
- Fix AttributeError about _use_fi_prefill (#29734) · 82c795d6
  Huamin Li authored Nov 29, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  82c795d6
- [Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732) · e1464c3a
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e1464c3a
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091
  Xin Yang authored Nov 29, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a491b091
29 Nov, 2025 14 commits
- [Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37
  Jinzhen Lin authored Nov 29, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>
```
  1656ad37
- [Chore] Move `detokenizer_utils` to `vllm/tokenizers` (#29727) · fa59fe41
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fa59fe41
- [Chore] Enable passing `tokenizer=None` into MM processor (#29724) · fe3398fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fe3398fa
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
- [Model Runner V2] Fuse penalties and temperature into single kernel (#29720) · f223ed41
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f223ed41
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
- [Model Runner V2] Add sample/ directory and reorganize files (#29719) · 6afc0ffa
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6afc0ffa
- [LoRA] Cleanup LoRA unused code (#29611) · 39e63dec
  Jee Jee Li authored Nov 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  39e63dec
- [Model Runner V2] Don't use UVA buffer for prefill_len (#29713) · 4a80ad0a
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4a80ad0a
- [BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698) · e23f665d
  Lucas Wilkinson authored Nov 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e23f665d
- [Model Runner V2] Refactor prefill token preparation (#29712) · ca1b1e72
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca1b1e72
- [Frontend] Perform offline path replacement to `tokenizer` (#29706) · 762a4a6c
  Tsukasa OI authored Nov 29, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  762a4a6c
- [Model Runner V2] Support penalties using bin counts (#29703) · 1dcafb3d
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dcafb3d
- [Bugfix] Fix O(n²) multimodal string prompt processing (#29667) · c625d7b1
  Mert Unsal authored Nov 28, 2025
```
Signed-off-by: mertunsall <mertunsal1905@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c625d7b1
28 Nov, 2025 9 commits
- [compile] Include `enable_sleep_mode` into caching factors. (#29696) · 6173682b
  Zhengxu Chen authored Nov 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  6173682b
- bugfix: correct attn output with base 2 or e (#28840) · 9726e645
  Augusto Yao authored Nov 29, 2025
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
```
  9726e645
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [Bugfix] fix dots.llm1.inst (#29687) · a51f4186
  Jiangyun Zhu authored Nov 29, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  a51f4186
- [Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  7675ba30
- [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597) · 1986de13
  Benjamin Chislett authored Nov 28, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  1986de13
- [Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef
  Yanan Cao authored Nov 28, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  3461e7ef
- Remove `all_special_tokens_extended` from tokenizer code (#29686) · fecae12c
  Harry Mellor authored Nov 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fecae12c
- [Chore] Rename `Processor` to `InputProcessor` (#29682) · 8d9338fa
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9338fa