Commits · b004c00418268daa61b3526358b661165a360f7d · OpenDAS / vllm_cscc · GitLab

23 Nov, 2025 10 commits
- [Model Runner V2] Support spec decoding [1/N] (#29274) · b004c004
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b004c004
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
- [Bugfix] Use lazy string reference for DeepseekV3Config in config registry (#28958) · 6fb0215e
  Luke authored Nov 23, 2025
```
Signed-off-by: Luke <yq0536@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6fb0215e
- [ROCm][CI] Fix "Cannot re-initialize CUDA in forked subprocess" in test_pynccl.py (#29119) · 55c21c88
  Micah Williamson authored Nov 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  55c21c88
- [CI/Build][AMD] Add check for flash_att_varlen_func to test_tree_attention.py (#29252) · 3999442f
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  3999442f
- [CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency in... · 71362ffa
  rasmith authored Nov 22, 2025
```
[CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency  in test_multi_connector.py due to hipErrorLaunchFailure  when calling .cpu() (#29253)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  71362ffa
- [Model Runner V2] Minor fix for cudagraph_utils (#29256) · 20ee418a
  Woosuk Kwon authored Nov 22, 2025
  
  20ee418a
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
- docs: fixes distributed executor backend config for multi-node vllm (#29173) · 3ed767ec
  Michael Act authored Nov 23, 2025
```
Signed-off-by: Michael Act <michael.a.c.tulenan@gdplabs.id>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3ed767ec
- [Fix] Add SM check to flashinfer MOE backend (#29144) · 5f96c00c
  jiahanc authored Nov 22, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  5f96c00c
22 Nov, 2025 30 commits
- Patch DeepEP when building docker image with CUDA 13 (#29154) · 45870632
  Qidong Su authored Nov 22, 2025
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
```
  45870632
- [Chore] Update batch invariant code owner (#29246) · 472fdee9
  Wentao Ye authored Nov 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  472fdee9
- Refactor: Move CUDA graph dispatch logic earlier (#27382) · df78aeef
  Yizhou authored Nov 23, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  df78aeef
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [CI/build] Removes source compilation from runtime image (#26966) · eb5352a7
  Benjamin Bartels authored Nov 22, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  eb5352a7
- [Bugfix] Use HF config fields as fallback when loading Mistral config (#29239) · d1cf8214
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1cf8214
- [perf][cpu] Accelerate paged attention GEMMs (QK, PV) on Arm CPUs with NEON (#29193) · 730bd353
  Fadi Arafeh authored Nov 22, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  730bd353
- chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240) · f55c76c2
  Federico authored Nov 22, 2025
  
  f55c76c2
- Fix EVS crash when using `video_embeds` inputs in Qwen2.5-VL (#29232) · d84d8f44
  ZiTian Zhao authored Nov 22, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d84d8f44
- [Misc] Fix pre-commit (#29238) · ae668183
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ae668183
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
- [tiny] Remove unsupported TRITON_MLA backend from batch invariance (#28832) · 5f7209a7
  Bram Wasti authored Nov 22, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5f7209a7
- fix: clean up function never use in setup.py (#29061) · 2d4978a5
  yihong authored Nov 22, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2d4978a5
- Fix: Resolve circular import in model_loader/utils.py (#29189) · 6965a392
  Nandan Vallamdasu authored Nov 22, 2025
```
Signed-off-by: nandan2003 <nandan.vallamdasu@outlook.com>
Signed-off-by: Nandan Vallamdasu  <nandan.vallamdasu@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  6965a392
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229) · 8e22da1d
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8e22da1d
- [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) · a4fdf240
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  a4fdf240
- Simplify `from_blob` usage in `get_cuda_view_from_cpu_tensor` (#29027) · e6309acd
  Jane (Yuan) Xu authored Nov 22, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  e6309acd
- Handle triton kernel import exception (#29062) · 988ee66b
  jinghanhu authored Nov 22, 2025
  
  988ee66b
- [Frontend][Responses API] Multi-turn (with type: "output_text") support for... · ea38474a
  Mads Kildegård authored Nov 22, 2025
```
[Frontend][Responses API] Multi-turn (with type: "output_text") support for non-harmony requests (#29175)
Signed-off-by: Mads Kildegård <mkildegaard99@gmail.com>
```
  ea38474a
- [responsesAPI] parse reasoning item input (#28248) · 742e9ff6
  Andrew Xia authored Nov 21, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  742e9ff6
- [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) · e9056056
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9056056
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
- [Bugfix]Fix a conditional to not check zero value (#28754) · 933f67ec
  Yanan Cao authored Nov 21, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  933f67ec
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
- [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6f403501
- Add fused MoE config for H200 E160 N192 fp8 (#29182) · 052950e5
  FlintyLemming authored Nov 22, 2025
```
Signed-off-by: FlintyLemming <admin@flinty.moe>
```
  052950e5
- [CI/Build] Disable test_gptoss_tp.py in 'LoRA TP Test' group for ROCm platform (#29204) · 1ef9c9e2
  qli88 authored Nov 21, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  1ef9c9e2