Commits · d17f0fbf304fde851e1f4995a30d78182985044e · OpenDAS / vllm_cscc

09 Oct, 2025 1 commit

Separate MLAAttention class from Attention (#25103) · e614ab78

Naveenraj Kamalakannan authored Oct 08, 2025

Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e614ab78

08 Oct, 2025 9 commits

[Kernels] Modular kernel refactor (#24812) · da364615
bnellnm authored Oct 08, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
da364615
[Models] Improve iteration over layers (#26425) · 93f2c0aa
Lukas Geiger authored Oct 08, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
93f2c0aa

[Refactor] Refactor FP8 & INT8 Quant Folder inside `w8a8` (#25293) · 241b4cfe

Wentao Ye authored Oct 08, 2025


Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: courage17340 <courage17340@163.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Jacob Kahn <jacobkahn1@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zxw <1020938856@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
Signed-off-by: jiang1.li <jiang1...

241b4cfe

Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2f99f2f5
[Model] Allow passing custom number of max tiles to Nano 2 VL (#26403) · f9582fd8
Eugene Khvedchenya authored Oct 08, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
```
f9582fd8
[Misc] add `usedforsecurity=False` in md5 hash call (#26357) · f377333b
Daniele authored Oct 08, 2025
```
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
```
f377333b

[TPU] Rename tpu_commons to tpu_inference (#26279) · 335b28f7

Utkarsh Sharma authored Oct 08, 2025


Signed-off-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

335b28f7

Add SwigluOAI implementation for CPUFusedMOE (#26347) · 046118b9
isharif168 authored Oct 08, 2025
```
Signed-off-by: Sharif Inamdar <sharif.inamdar@arm.com>
```
046118b9
[torchao] safetensors integration (#25969) · b32260ab
liangel-02 authored Oct 07, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
b32260ab

07 Oct, 2025 11 commits

[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in... · 0c824fc4

Morrison Turnansky authored Oct 07, 2025


[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

0c824fc4

[Bug] Fix Shape Validation for Fallback while Enabling E8M0 for DeepGEMM (#26322) · 8f36850f
Wentao Ye authored Oct 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
8f36850f
[deepseek] add EP8 FusedMOE config for H200 and B200 (#26331) · 29fd2662
Chen Zhang authored Oct 08, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
29fd2662
[Model] Lfm2Moe (#26344) · 320feae6
Paul Pak authored Oct 08, 2025
```
Signed-off-by: Paul Pak <paulpak58@gmail.com>
```
320feae6

[Model] Add support for ModernBertForTokenClassification (#26340) · 6f59beaf

antrec authored Oct 07, 2025

Signed-off-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Signed-off-by: antrec <antoine.recanati@gmail.com>
Co-authored-by: Antoine Recanati Le Goat <antoine.recanati@sancare.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

6f59beaf

[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
fxmarty-amd authored Oct 07, 2025

41f1cf38
[Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
08d26a1b

Add topk logits torch op for DS3.2. (#25945) · e1098ced

Daniel Cámpora authored Oct 07, 2025

Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Daniel Cámpora <961215+dcampora@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

e1098ced

[Model] Define merge_by_field_config MM interface (R-T) (#26260) · de342585

Ayush Satyam authored Oct 07, 2025


Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

de342585

[Model] Define merge_by_field_config MM interface (U-Z) (#26261) · 5f7e8a91

Ayush Satyam authored Oct 07, 2025


Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

5f7e8a91

[BUG] Fix file parsing for load_format runai_streamer_sharded (#26324) · 4dbdf4a2
ahao-anyscale authored Oct 06, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
4dbdf4a2

06 Oct, 2025 12 commits

[Bugfix] Allow skipping MoE in NVFP4 (fix for MTP) (#25987) · 2161efe9
Benjamin Chislett authored Oct 06, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
2161efe9

[Bugfix] Fix gemma3 with transformers backend (#23178) · 7cd95dc8

Raushan Turganbay authored Oct 06, 2025

Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Raushan Turganbay <raushan@huggingface.co>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7cd95dc8

Add bias handling to CPUFusedMOE kernel (#26289) · c02058c2

Crefeda Rodrigues authored Oct 06, 2025


Signed-off-by: Crefeda Rodrigues <crefeda.rodrigues@arm.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Crefeda Rodrigues <65665931+cfRod@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Sharif Inamdar <Sharif.Inamdar@arm.com>
Co-authored-by: Isotr0py <2037008807@qq.com>