Commits · 1891cf605ac015016cca38acc9e1950f70586f2e · OpenDAS / vllm_cscc · GitLab

29 Oct, 2025 13 commits
- [Bugfix] Fix modular kernel tests (#27707) · 1891cf60
  bnellnm authored Oct 29, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  1891cf60
- [perf] Enable concurrent execution of "shared_experts" and "selected_experts"... · 8df98c21
  Jiangyun Zhu authored Oct 29, 2025
```
[perf] Enable concurrent execution of "shared_experts" and "selected_experts" in qwen3-next (#27578)
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  8df98c21
- [CI/Build] Move pre-commit only scripts to `tools/pre_commit` (#27657) · 4fb8771c
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4fb8771c
- [Speculators] Move tests + fix integration (#27308) · 413ef7a3
  Dipika Sikka authored Oct 29, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Co-authored-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  413ef7a3
- [Bugfix] Fix non-contiguous tensor error in `rocm_unquantized_gemm_impl` (#27605) · 8b624950
  Zhewen Li authored Oct 29, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  8b624950
- [CI/Build][Bugfix]Fix Quantized Models Test on AMD (#27712) · 83fd49b1
  Zhewen Li authored Oct 28, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  83fd49b1
- [KV Connector] Update lmcache connector with latest compatibility (#27681) · a4a4f0f6
  Shaoting authored Oct 28, 2025
```
Signed-off-by: Samuel Shen <slshen@uchicago.edu>
Co-authored-by: Samuel Shen <slshen@uchicago.edu>
```
  a4a4f0f6
- [Model] Fix Qwen3VL and Qwen3Omni after torch.compile changes (#27705) · 0d8161b0
  Lukas Geiger authored Oct 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  0d8161b0
- [NIXL][XPU] update name of nixl wheel (#27631) · d2c33c39
  liuzhenwei authored Oct 29, 2025
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  d2c33c39
- [Build] Revert triton_kernels requirements (#27659) · f6d5f588
  Varun Sundar Rabindranath authored Oct 29, 2025
  
  f6d5f588
- Revert "Install pre-built xformers-0.0.32.post2 built with pt-2.9.0" (#27714) · 9007bf57
  Simon Mo authored Oct 28, 2025
  
  9007bf57
- Install pre-built xformers-0.0.32.post2 built with pt-2.9.0 (#27598) · f2575447
  Huy Do authored Oct 28, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  f2575447
- [Core] Early return in SlidingWindowManager.remove_skipped_blocks (#27673) · 0b51c9bd
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  0b51c9bd
28 Oct, 2025 27 commits
- [Bug] Fix deepep low latency use nvlink by default (#27677) · d3ab240f
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d3ab240f
- [Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612
  Lucas Kabela authored Oct 28, 2025
```
[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>
```
  94666612
- [AsyncScheduling] Make async overlap work with logprobs (#27615) · 4fe58953
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4fe58953
- [Core] Scheduler: Publish connector events after output (#25875) · 111faf11
  Or Ozeri authored Oct 28, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  111faf11
- [Test] Batch Invariant: Unit test using parameterized backend (#27478) · 6afc28a9
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6afc28a9
- [Misc] Make reorder batch also separate extends (#27367) · 141e6a05
  Lucas Wilkinson authored Oct 29, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  141e6a05
- Add load pattern configuration guide to benchmarks (#26886) · 130aa8cb
  Matvei Pashkovskii authored Oct 28, 2025
```
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Signed-off-by: Matvei Pashkovskii <matvei.pashkovskii@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  130aa8cb
- [compile] Add fallback path to AOT compile when serialization fails. (#27350) · e3d81866
  Zhengxu Chen authored Oct 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e3d81866
- [Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658) · f5710ef0
  Cyrus Leung authored Oct 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5710ef0
- [Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597) · a8c02fb5
  Mohammad Miadh Angkad authored Oct 28, 2025
```
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a8c02fb5
- [Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117) · 02af36df
  Kero Liang authored Oct 28, 2025
```
Signed-off-by: Kero Liang <kerorek@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: donglu <donglu@cohere.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  02af36df
- [FLA] Introduce Kimi Delta Attention(KDA) to VLLM (#27654) · e88bdd60
  Zhiyuan Li authored Oct 28, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
```
  e88bdd60
- [nit]: Fix import for the lmcache integration (#27600) · 05e034f0
  Samuel Shen authored Oct 28, 2025
```
Signed-off-by: Samuel Shen <slshen@uchicago.edu>
Co-authored-by: Samuel Shen <slshen@uchicago.edu>
```
  05e034f0
- [BugFix] Also consider RAY_EXPERIMENTAL_NOSET_* when storing compilation cache (#27294) · 936643a8
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Oct 28, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  936643a8
- [Bugfix][Frontend] validate arg priority in frontend LLM class before add request (#27596) · b186149e
  Junpu Fan authored Oct 28, 2025
```
Signed-off-by: Junpu Fan <junpufan@gmail.com>
```
  b186149e
- [Core] Enable async scheduling for external_launcher mode (#27394) · 2abbd351
  22quinn authored Oct 28, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2abbd351
- fix: allow HuggingFace standard chat template params via **kwargs (#27622) · 446912d1
  wangln19 authored Oct 28, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  446912d1
- [compile] Disable dynamo guards check for AOT compilation. (#27288) · a00d6254
  Zhengxu Chen authored Oct 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a00d6254
- [Hybrid] Add mamba_block_size to Engine Args (#27289) · 05181cc5
  Asaf Joseph Gardin authored Oct 28, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  05181cc5
- [compile] Add enable_prompt_embeds to compile hash. (#27285) · 259504e1
  Zhengxu Chen authored Oct 28, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  259504e1
- [Bug] Fix shape issue for eplb expert weights (#27589) · 0484b642
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0484b642
- [Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588) · f58d9b64
  Cyrus Leung authored Oct 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f58d9b64
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95
- [V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601) · 7a865f23
  Nick Hill authored Oct 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7a865f23
- Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565) · 2fa90bda
  wangln19 authored Oct 28, 2025
```
Signed-off-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
Co-authored-by: wangln19 <wanglinian@dev.wanglinian.msh-dev.svc.cluster.local>
```
  2fa90bda
- [CI/Build] Fix amd model executor test (#27612) · 0291fbf6
  Zhewen Li authored Oct 28, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  0291fbf6
- [Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618) · b46e4a06
  Jialin Ouyang authored Oct 28, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b46e4a06