Commits · d0bed837ac83aa33f6540d32cbcc75525328078e · OpenDAS / vllm_cscc

10 Oct, 2025 22 commits

[BugFix] Make penalties and bad_words work with async scheduling (#26467) · 5bc26c43
Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
5bc26c43
AOT Compilation for torch.compile (Bundled) (#24274) · eef921f4
Zhengxu Chen authored Oct 10, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
eef921f4
[BugFix] Fix async scheduling + request preemption (#26385) · 949cb017
Nick Hill authored Oct 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
949cb017
Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
7c12763b

Add Qwen3-Omni moe thinker (#25550) · 19a9b169

Xiong Wang authored Oct 11, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Xiong Wang <feizi.wx@alibaba-inc.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

19a9b169

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

[Model] Add FlexOlmo model implementation (#24923) · 8d2b8c0f
Shane A authored Oct 10, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
```
8d2b8c0f
[Bugfix] fixed top_logprobs: -1 does not appear to work as intended (#26470) · 910abdbd
Chauncey authored Oct 11, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
910abdbd

[torch.compile] Make inductor partition rules respect splitting_ops #25691 (#25845) · cddce79f

baonudesifeizhai authored Oct 10, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

cddce79f

[Metrics] Add test for multi-modal cache stats logging (#26588) · e5192819
Mark McLoughlin authored Oct 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
e5192819

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

Added test_top_k_per_row to test-pipeline.yaml. (#26569) · 0e67102d
Daniel Cámpora authored Oct 10, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
0e67102d
[CI] fix test_run_batch.py::test_completions - AssertionError (#26578) · 1e6848a6
Chauncey authored Oct 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
1e6848a6
[BugFix] Fix noop elimination edge case (#26394) · 67661375
Andy Lo authored Oct 10, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
67661375
[NIXL] Ignore abort on already-finished request (#25067) · 784c2311
Mark McLoughlin authored Oct 10, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
784c2311
[bugfix][DCP] fix block_size of hash in DCP prefix caching (#26296) · 606b00e8
Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
606b00e8
[CI] fix ruff format (#26579) · 720d3cd0
Chauncey authored Oct 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
720d3cd0

Remove LoRA bias support (#25807) · ab196ede

Ashwin Phadke authored Oct 10, 2025


Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ab196ede

[GPT-OSS] Add support for arrays at tool message content (#25593) · 3ee202ea
Luis Tomas Bolivar authored Oct 10, 2025
```
Signed-off-by: Luis Tomas Bolivar <ltomasbo@redhat.com>
```
3ee202ea
[Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ad430a67
fix test_simple_inductor_graph_partition (#26522) · b545a0b2
Boyuan Feng authored Oct 09, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
b545a0b2
[Chore]: One pythonic tool parser test uses the wrong parser (#26515) · da445560
Ben Browning authored Oct 10, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
```
da445560

09 Oct, 2025 12 commits
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
- [Flashinfer][gpt-oss] Support FP8-qkv Flashinfer TRTLLM Sinks Attention (#25674) · 44f633db
  elvischenv authored Oct 10, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  44f633db
- Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate... · 5728da11
  Jiangyun Zhu authored Oct 09, 2025
```
Revert  #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  5728da11
- [Bugfix] Move current_platform import to avoid python import cache. (#16601) · ec10fd0a
  Wenzheng Bi authored Oct 09, 2025
```
Signed-off-by: iwzbi <wzbi@zju.edu.cn>
```
  ec10fd0a
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
- [Misc] Upgrade more code to Python 3.10 (#26463) · dc7976dd
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dc7976dd
- [torchao] Add support for ModuleFqnToConfig using regex (#26001) · a83ff278
  Jerry Zhang authored Oct 09, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  a83ff278
- Add: Support for multiple hidden layers in Eagle3 (#26164) · cf4cd6c2
  Rahul Tuli authored Oct 09, 2025
```
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
```
  cf4cd6c2
- Bump Flashinfer to v0.4.0 (#26326) · 5e49c3e7
  elvischenv authored Oct 09, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5e49c3e7
- [CI/Build] Fix model nightly tests (#26466) · 0f29dca9
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0f29dca9
- [Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
  Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
  d24cf322
- [Core][KVConnector] Propagate all tokens on resumed preemptions (#24926) · d17f0fbf
  Qier Li authored Oct 09, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
Co-authored-by: Qier Li <qier@fb.com>
```
  d17f0fbf
08 Oct, 2025 6 commits
- [Kernels] Modular kernel refactor (#24812) · da364615
  bnellnm authored Oct 08, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  da364615
- [Bugfix] Respect min_tokens in scheduler stop check (#26317) · f08919b7
  Elaine Zhao authored Oct 08, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  f08919b7
- [Attention] Implement universal BACKEND_MAP (#25900) · 76879cc1
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  76879cc1
- [Bug] Fix Test in Batch Invariant (#26128) · 4ba88757
  Wentao Ye authored Oct 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4ba88757
- [Bug] Fix DeepGEMM Attention Test (#26423) · 9fb3ae4e
  Wentao Ye authored Oct 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9fb3ae4e
- Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f99f2f5