Commits · 728a9eb70ee30b1ab355a98f7e19fb81a0a7b873 · OpenDAS / vllm_cscc · GitLab

12 Nov, 2025 26 commits
- [Misc] Refactor Attention kv transfer methods into decorator (#27816) · 728a9eb7
  Nicolò Lucchesi authored Nov 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  728a9eb7
- [Refactor] Remove redundant TP gather/split in split_qkv in QwenVL (#28271) · bc5bd45c
  Canlin Guo authored Nov 12, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  bc5bd45c
- [Performance][Hopper] Avoid M dim padding to 4x for most cases (due to cuda... · f76e85c2
  Alexander Matveev authored Nov 12, 2025
```
[Performance][Hopper] Avoid M dim padding to 4x for most cases (due to cuda graphs paddings) (#28492)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  f76e85c2
- Fix pre-commit (and XPU) on `main` (#28556) · 54aecd9e
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  54aecd9e
- [V0 deprecation] Deprecate use_v1 parameter (#28112) · 10138c92
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  10138c92
- [Bugfix] Fix gpt_oss packed_modules_mapping (#28536) · a9d18b51
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a9d18b51
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- add cpu option for p/d in nixl_connector (#28356) · c5f10cc1
  ZhengHongming888 authored Nov 12, 2025
```
Signed-off-by: Hongming Zheng <hongming.zheng@intel.com>
```
  c5f10cc1
- [KVConnector] Enable get_block_ids_with_load_errors() in LMCache connector (#27978) · d1431523
  ziruiliu authored Nov 12, 2025
```
Signed-off-by: Zirui Liu <ziliu@ddn.com>
Signed-off-by: ziruiliu <ziliu@ddn.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d1431523
- [XPU]Fix crash due to removed VLLM_USE_V1 attribute (#28520) · a4730c1b
  Chaojun Zhang authored Nov 12, 2025
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
```
  a4730c1b
- [Model] fix glm4_moe_mtp load weights with GLM-4.6 checkpoint. (#27597) · d3ade61e
  wuyaoxuehun authored Nov 12, 2025
```
Signed-off-by: wuao.scotty <wuao.scotty@bytedance.com>
Co-authored-by: wuao.scotty <wuao.scotty@bytedance.com>
```
  d3ade61e
- [BugFix]: --enable-lora with model granite-4.0-micro crash (#27733) · 1761dea1
  yyzxw authored Nov 12, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  1761dea1
- [CI] Introduce autorun_on_main feature (#27836) · c748355e
  Huamin Li authored Nov 12, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  c748355e
- [CI/Build] Fix crash due to removed VLLM_USE_V1 attribute in EPD (#28521) · 91864b79
  Chenguang Zheng authored Nov 12, 2025
```
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  91864b79
- [Core] Cache `vllm_is_batch_invariant` (#28304) · ac0bb2c3
  Lukas Geiger authored Nov 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  ac0bb2c3
- [Benchmark] Add retry support to fix workload bias in multi-turn benchmark (#28493) · f31419ed
  ai-jz authored Nov 11, 2025
  
  f31419ed
- [BugFix] Add fallback path in `apply_rotary_pos_emb_flashattn` for non-cuda platforms (#28447) · b9ce9a30
  Fanli Lin authored Nov 12, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  b9ce9a30
- [Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56
  Chenguang Zheng authored Nov 12, 2025
```
Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>
```
  4ccffe56
- [Model][Qwen3VL] Simplify `get_mrope_input_positions` using numpy (#28302) · cbb799e3
  Lukas Geiger authored Nov 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  cbb799e3
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
- [[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  e1710393
- [Performance] Cache loaded custom logitsprocs to avoid overheads (#28462) · 3f770f44
  Isotr0py authored Nov 12, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f770f44
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
- [BugFix] Graceful handling of torch symm mem errors. (#27671) · 1788aa1e
  Ilya Markov authored Nov 12, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1788aa1e
- Use FLASHINFER MLA backend when testing fp8_kv_scale_compile (#28491) · d2353954
  Adrian Abeyta authored Nov 11, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  d2353954
11 Nov, 2025 14 commits
- [Feature] Allow configuring FlashInfer workspace size (#28269) · 412e153d
  Max Hu authored Nov 11, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  412e153d
- [Bugfix] Disable shared expert overlap if Marlin MoE is used (#28410) · e5f599d4
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e5f599d4
- Add Zurich vLLM Meetup (#28488) · 28534b92
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  28534b92
- [Misc] Cleanup Executor interface (#28441) · d4902ba5
  wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  d4902ba5
- [TPU] Rename path to tpu platform (#28452) · df4d3a44
  Kyuyeun Kim authored Nov 11, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  df4d3a44
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
- [Misc] fix typo in DCP comment (#28389) · 8c32c6e4
  Jie Luo authored Nov 12, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  8c32c6e4
- [V0 deprecation] Clean up num_prefill_tokens logic for V0 (#28203) · de120bc9
  Canlin Guo authored Nov 12, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  de120bc9
- [Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245) · 4228be79
  Jialin Ouyang authored Nov 11, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4228be79
- [Misc] Remove unused attention prefix prefill ops functions (#26971) · 76e4dcf2
  Lukas Geiger authored Nov 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  76e4dcf2
- [BugFix] Fix Siglip2Attention on XPU (#28448) · d5edcb86
  Fanli Lin authored Nov 12, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  d5edcb86
- [Kernel] Optimize rms_norm kernel (#27931) · 6c3c0f82
  Xin Yang authored Nov 11, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  6c3c0f82
- Prefer FlashAttention MLA as default over FlashMLA (#27363) · 684f2545
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  684f2545
- [CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424) · e5534249
  Zhewen Li authored Nov 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e5534249