Commits · e317414ce11a66f6e653ce382f5d987b0c0191bd · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "0bb1e885a08df59beec7149b1d0d646e24ab1a42"

10 Oct, 2025 26 commits

[BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
949cb017
[BUG] Qwen3-next MTP. Fix attn metadata build bug (#26564) · e94cfd51
Vadim Gimpelson authored Oct 10, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
e94cfd51
Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
7c12763b

Add Qwen3-Omni moe thinker (#25550) · 19a9b169

Xiong Wang authored Oct 11, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Xiong Wang <feizi.wx@alibaba-inc.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

19a9b169

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

[Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
8d2b8c0f

[Model][Qwen3VL] Compute `cu_seqlens` on CPU to remove (#26496) · b2155ed3

Lukas Geiger authored Oct 10, 2025


Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b2155ed3

[Bugfix] fixed top_logprobs: -1 does not appear to work as intended (#26470) · 910abdbd
Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
910abdbd

[torch.compile] Make inductor partition rules respect splitting_ops #25691 (#25845) · cddce79f

baonudesifeizhai authored Oct 10, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

cddce79f

[Metrics] Add test for multi-modal cache stats logging (#26588) · e5192819
Mark McLoughlin authored Oct 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
e5192819

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

[Bugfix] Make DP padding optional in coordinate_batch_across_dp (#26375) · ae9d0e7d
Sage Moore authored Oct 10, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
ae9d0e7d

[BugFix][torch.compile] Fix fused_scaled_matmul_reduce_scatter signature for PyTorch 2.8 (#26038) · f4ba2061

Jason Li authored Oct 10, 2025


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: <>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f4ba2061

[BugFix] Fix noop elimination edge case (#26394) · 67661375
Andy Lo authored Oct 10, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
67661375
[Bugfix] Convert untraceable GroupShape to list for AMD impl (#26535) · 213b6445
Lucas Kabela authored Oct 10, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
213b6445
[NIXL] Ignore abort on already-finished request (#25067) · 784c2311
Mark McLoughlin authored Oct 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
784c2311
[bugfix][DCP] fix block_size of hash in DCP prefix caching (#26296) · 606b00e8
Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
606b00e8
[CI] fix ruff format (#26579) · 720d3cd0
Chauncey authored Oct 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
720d3cd0

Remove LoRA bias support (#25807) · ab196ede

Ashwin Phadke authored Oct 10, 2025


Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ab196ede

[GPT-OSS] Add support for arrays at tool message content (#25593) · 3ee202ea
Luis Tomas Bolivar authored Oct 10, 2025
```
Signed-off-by: Luis Tomas Bolivar <ltomasbo@redhat.com>
```
3ee202ea
[Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ad430a67
[deepseek] kernel block size for UniformTypeKVCacheSpecs (#26559) · 6f0f570c
Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
6f0f570c
fix test_simple_inductor_graph_partition (#26522) · b545a0b2
Boyuan Feng authored Oct 09, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
b545a0b2

[Spec-Decode] Support piecewise cudagraphs for Eagle head (#25109) · 29255cfc

Lucas Wilkinson authored Oct 10, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

29255cfc

[Core] Small simplification in `GPUModelRunner._update_states()` (#26508) · aafb99a4
Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
aafb99a4
[DP][ray] Support different VLLM_RAY_DP_PACK_STRATEGY (#23849) · 757fa4a4
Rui Qiao authored Oct 09, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
757fa4a4

09 Oct, 2025 14 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [CI] Fix Pre-commit Issue Cannot determine type of "rank" and "world_size" (#26448) · 8983e021
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8983e021
- [Bug] Fix modular_kernel: ZeroDivisionError: integer division or modulo by zero (#26528) · 1ee35382
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1ee35382
- [Bugfix] Fix CUDA graph selection bug in FlashInfer at high concurrency (#26499) · 6e783bc5
  Benjamin Chislett authored Oct 09, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  6e783bc5
- [UX] Add FlashInfer as default CUDA dependency (#26443) · c9d33c60
  Michael Goin authored Oct 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c9d33c60
- [Core] Remove unused `prev_sampled_token_ids_invalid_indices` input batch field (#26514) · 2e54db4d
  Nick Hill authored Oct 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2e54db4d
- [Flashinfer][gpt-oss] Support FP8-qkv Flashinfer TRTLLM Sinks Attention (#25674) · 44f633db
  elvischenv authored Oct 10, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  44f633db
- [Bugfix] Disable moe inplace for torch >= 2.9 (#26497) · a462331e
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  a462331e
- [Bugfix] Enable padded FP4 quantization (#25947) · 4069db3f
  roikoren755 authored Oct 09, 2025
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  4069db3f
- [BUGFIX] Add cu_tokens_across_sp to DPMetadata (#26457) · 0d37450e
  Sage Moore authored Oct 09, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0d37450e
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
- [Models][Qwen] Replace `pad` with `cat` for better performance (#26486) · 2c1c7dfb
  Lukas Geiger authored Oct 09, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  2c1c7dfb
- Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481) · e246ad6f
  Harry Mellor authored Oct 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e246ad6f