Commits · 5f96c00c557fc68c352d1b9bb1d6f9c9bb9f133d · OpenDAS / vllm_cscc

23 Nov, 2025 1 commit

[Fix] Add SM check to flashinfer MOE backend (#29144) · 5f96c00c

jiahanc authored Nov 22, 2025


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

5f96c00c

22 Nov, 2025 37 commits
- Patch DeepEP when building docker image with CUDA 13 (#29154) · 45870632
  Qidong Su authored Nov 22, 2025
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
```
  45870632
- [Chore] Update batch invariant code owner (#29246) · 472fdee9
  Wentao Ye authored Nov 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  472fdee9
- Refactor: Move CUDA graph dispatch logic earlier (#27382) · df78aeef
  Yizhou authored Nov 23, 2025
```
Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>
```
  df78aeef
- [BugFix] Fix chunked prompt logprobs + preemption (#29071) · 7df331c6
  Nick Hill authored Nov 22, 2025
  
  7df331c6
- [CI/build] Removes source compilation from runtime image (#26966) · eb5352a7
  Benjamin Bartels authored Nov 22, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  eb5352a7
- [Bugfix] Use HF config fields as fallback when loading Mistral config (#29239) · d1cf8214
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1cf8214
- [perf][cpu] Accelerate paged attention GEMMs (QK, PV) on Arm CPUs with NEON (#29193) · 730bd353
  Fadi Arafeh authored Nov 22, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  730bd353
- chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240) · f55c76c2
  Federico authored Nov 22, 2025
  
  f55c76c2
- Fix EVS crash when using `video_embeds` inputs in Qwen2.5-VL (#29232) · d84d8f44
  ZiTian Zhao authored Nov 22, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d84d8f44
- [Misc] Fix pre-commit (#29238) · ae668183
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ae668183
- [BugFix] Fix returned logprobs with spec decode + prefill chunking (#29216) · d44a63c6
  Nick Hill authored Nov 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d44a63c6
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
- [tiny] Remove unsupported TRITON_MLA backend from batch invariance (#28832) · 5f7209a7
  Bram Wasti authored Nov 22, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5f7209a7
- fix: clean up function never use in setup.py (#29061) · 2d4978a5
  yihong authored Nov 22, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  2d4978a5
- Fix: Resolve circular import in model_loader/utils.py (#29189) · 6965a392
  Nandan Vallamdasu authored Nov 22, 2025
```
Signed-off-by: nandan2003 <nandan.vallamdasu@outlook.com>
Signed-off-by: Nandan Vallamdasu  <nandan.vallamdasu@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  6965a392
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229) · 8e22da1d
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8e22da1d
- [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) · a4fdf240
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  a4fdf240
- Simplify `from_blob` usage in `get_cuda_view_from_cpu_tensor` (#29027) · e6309acd
  Jane (Yuan) Xu authored Nov 22, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  e6309acd
- Handle triton kernel import exception (#29062) · 988ee66b
  jinghanhu authored Nov 22, 2025
  
  988ee66b
- [Frontend][Responses API] Multi-turn (with type: "output_text") support for... · ea38474a
  Mads Kildegård authored Nov 22, 2025
```
[Frontend][Responses API] Multi-turn (with type: "output_text") support for non-harmony requests (#29175)
Signed-off-by: Mads Kildegård <mkildegaard99@gmail.com>
```
  ea38474a
- [responsesAPI] parse reasoning item input (#28248) · 742e9ff6
  Andrew Xia authored Nov 21, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  742e9ff6
- [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) · e9056056
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9056056
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
- [Bugfix]Fix a conditional to not check zero value (#28754) · 933f67ec
  Yanan Cao authored Nov 21, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  933f67ec
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
- [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6f403501
- Add fused MoE config for H200 E160 N192 fp8 (#29182) · 052950e5
  FlintyLemming authored Nov 22, 2025
```
Signed-off-by: FlintyLemming <admin@flinty.moe>
```
  052950e5
- [CI/Build] Disable test_gptoss_tp.py in 'LoRA TP Test' group for ROCm platform (#29204) · 1ef9c9e2
  qli88 authored Nov 21, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  1ef9c9e2
- [Bugfix] Fix block size in block_table with PCP (#29094) · 5c8f2adf
  Jie Luo authored Nov 22, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  5c8f2adf
- [CI/Build] Add terratorch for AMD (#29205) · ed8e6843
  Ryan Rock authored Nov 21, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ed8e6843
- [Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217) · d045e22d
  Lukas Geiger authored Nov 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  d045e22d
- [CI] Bug: Fix triton import issue (#29202) · 1d34eb11
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1d34eb11
- [Rocm][CI] Fix DeekSeek V2-Lite Accuracy CI (#29135) · 9a3101b2
  Charlie Fu authored Nov 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  9a3101b2
- [docs] Fix cudagraph mode config (#29170) · d5dbdbfc
  Angela Yi authored Nov 21, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  d5dbdbfc
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 2 commits
- [Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) · e9af6ba6
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9af6ba6
- [KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
  Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  c6fa3895