Commits · 99d69af9ece094acb94901439925f8468b32326a · OpenDAS / vllm_cscc

01 Nov, 2025 13 commits

[Bugfix] Python 3.10 compatibility for `Self` (#27918) · 99d69af9
Cyrus Leung authored Nov 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
99d69af9
[Bugfix] DeepSeek V3.2 MTP metadata & CUDA graph issues (#26779) · d811b442
Haco authored Nov 01, 2025
```
Signed-off-by: xiaohajiayou <923390377@qq.com>
```
d811b442

[V0 deprecation] Remove VLLM_USE_V1 usage in platform and v1 module (#27798) · 30a14b03

wangxiyuan authored Nov 01, 2025


Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

30a14b03

[Docs] Mock all imports for docs (#27873) · 799ce45c
Harry Mellor authored Nov 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
799ce45c
feat(benchmarks): support HF model names in multi-turn benchmark (#27850) · 2c0c7c39
ai-jz authored Nov 01, 2025

2c0c7c39

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

[Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
e2347dbf

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

Adding SplitK in fused_moe_lora kernel (#27818) · 29de3cde

yugong333 authored Oct 31, 2025


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

29de3cde

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

[Bugfix] Fix KDA output (#27905) · 3a5de7d2
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
3a5de7d2
[Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
bc4486d6
[Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
0cdbe7b7

31 Oct, 2025 20 commits
- [Hybrid] A simpler algorithm to find kernel_block_size (#26476) · df334868
  Chen Zhang authored Oct 31, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  df334868
- Batch invariance doc (#27839) · 0e0a638c
  Bram Wasti authored Oct 31, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0e0a638c
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
- fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
  ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  bc306fe5
- [bugfix] Missing cached item in beam search (#27874) · 103a468b
  Chenguang Zheng authored Nov 01, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  103a468b
- Docs update tpu install instructions (#27824) · 70bfbd7b
  Rob Mulla authored Oct 31, 2025
```
Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Rob Mulla <RobMulla@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  70bfbd7b
- [Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3
  GuanLuo authored Nov 01, 2025
```
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d6517be3
- [Bugfix] Fix broken MRoPE for GLM-4.1V/GLM-4.5V (#27860) · 7e06c40e
  Isotr0py authored Nov 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7e06c40e
- [Bugfix] Allow 64-bit integer values for LoRA IDs to avoid overflow/truncation (#27876) · 675704ac
  Madeesh Kannan authored Oct 31, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
```
  675704ac
- [CI/Build] Add gpt-oss LoRA test (#27870) · 0384aa71
  Jee Jee Li authored Oct 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0384aa71
- [Perf] Decouple torch op from GDA to leverage torch.compile (#27871) · 3857eb87
  Jiangyun Zhu authored Oct 31, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3857eb87
- [BugFix] Don’t compute reorder threshold when there are no attention groups (#27861) · 933cdea4
  Huamin Li authored Oct 31, 2025
  
  933cdea4
- [Bugfix] Avoid too small block m/n for FlexAttention kernel option (#27853) · 3933f18a
  Isotr0py authored Oct 31, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3933f18a
- [Kimi-Linear] Correct prefixes and add compatibility to AWQ quants (#27834) · e5ef4dfc
  toncao authored Oct 31, 2025
```
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
```
  e5ef4dfc
- [Hardware][Powerpc] Fix VLLM_CPU_OMP_THREADS_BIND="auto" low CPU utilization for Power (#27734) · 36960501
  Akash kaothalkar authored Oct 31, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  36960501
- [benchmark] Make request IDs unique across clients by default (#27723) · b2e65cb4
  Seiji Eicher authored Oct 30, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b2e65cb4
- [CI Test] Add Scheduled Integration Test (#27765) · 2bf0bcc1
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2bf0bcc1
30 Oct, 2025 7 commits
- [CI/Build][Intel] Enable performance benchmarks for Intel Gaudi 3 (#26919) · 697f507a
  Jakub Sochacki authored Oct 31, 2025
```
Signed-off-by: jakub-sochacki <jakub.sochacki@wp.pl>
```
  697f507a
- [Misc] Make all tool scripts executable (#27831) · d5d2a0fe
  Matthew Bonanni authored Oct 30, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  d5d2a0fe
- [BugFix] Fix broken import in initialize_ray_cluster() (#27838) · c9791f18
  Nick Hill authored Oct 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9791f18
- [Feature] Batch invariant torch.compile (#27660) · e7acb200
  Paul Zhang authored Oct 30, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e7acb200
- [Core][Perf] Only invoke save_new_computed_blocks when computed blocks are not empty (#27799) · 4b68c4a5
  Jialin Ouyang authored Oct 30, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4b68c4a5
- [Refactor] Remove `VLLM_DEEPEP_LOW_LATENCY_ALLOW_NVLINK` (#27750) · a8141fa6
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a8141fa6
- [Fix] Skip `record_sleep_state` logic in `PrometheusStatsLogger` if not in dev mode (#27789) · 49170025
  Sumanth R Hegde authored Oct 30, 2025
```
Signed-off-by: SumanthRH <sumanthrh99@gmail.com>
```
  49170025