Commits · 6965a392a4cd38ee65ac6a9c2730e0a7c62a658d · OpenDAS / vllm_cscc · GitLab

22 Nov, 2025 23 commits
- Fix: Resolve circular import in model_loader/utils.py (#29189) · 6965a392
  Nandan Vallamdasu authored Nov 22, 2025
```
Signed-off-by: nandan2003 <nandan.vallamdasu@outlook.com>
Signed-off-by: Nandan Vallamdasu  <nandan.vallamdasu@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  6965a392
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [CI/Build Don't add FLASHINFER backend in test_cpu_offloading.py (#29229) · 8e22da1d
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8e22da1d
- [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) · a4fdf240
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  a4fdf240
- Simplify `from_blob` usage in `get_cuda_view_from_cpu_tensor` (#29027) · e6309acd
  Jane (Yuan) Xu authored Nov 22, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  e6309acd
- Handle triton kernel import exception (#29062) · 988ee66b
  jinghanhu authored Nov 22, 2025
  
  988ee66b
- [Frontend][Responses API] Multi-turn (with type: "output_text") support for... · ea38474a
  Mads Kildegård authored Nov 22, 2025
```
[Frontend][Responses API] Multi-turn (with type: "output_text") support for non-harmony requests (#29175)
Signed-off-by: Mads Kildegård <mkildegaard99@gmail.com>
```
  ea38474a
- [responsesAPI] parse reasoning item input (#28248) · 742e9ff6
  Andrew Xia authored Nov 21, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  742e9ff6
- [Model Runner V2] Limit cudagraph size to max decode batch size (#29221) · e9056056
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9056056
- [LoRA] Cleanup FusedMoEWithLoRA (#29187) · 1489902b
  Jee Jee Li authored Nov 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1489902b
- [Bugfix]Fix a conditional to not check zero value (#28754) · 933f67ec
  Yanan Cao authored Nov 21, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  933f67ec
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
- [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6f403501
- Add fused MoE config for H200 E160 N192 fp8 (#29182) · 052950e5
  FlintyLemming authored Nov 22, 2025
```
Signed-off-by: FlintyLemming <admin@flinty.moe>
```
  052950e5
- [CI/Build] Disable test_gptoss_tp.py in 'LoRA TP Test' group for ROCm platform (#29204) · 1ef9c9e2
  qli88 authored Nov 21, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  1ef9c9e2
- [Bugfix] Fix block size in block_table with PCP (#29094) · 5c8f2adf
  Jie Luo authored Nov 22, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  5c8f2adf
- [CI/Build] Add terratorch for AMD (#29205) · ed8e6843
  Ryan Rock authored Nov 21, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ed8e6843
- [Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217) · d045e22d
  Lukas Geiger authored Nov 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  d045e22d
- [CI] Bug: Fix triton import issue (#29202) · 1d34eb11
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1d34eb11
- [Rocm][CI] Fix DeekSeek V2-Lite Accuracy CI (#29135) · 9a3101b2
  Charlie Fu authored Nov 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  9a3101b2
- [docs] Fix cudagraph mode config (#29170) · d5dbdbfc
  Angela Yi authored Nov 21, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  d5dbdbfc
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 17 commits
- [Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) · e9af6ba6
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9af6ba6
- [KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
  Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  c6fa3895
- [BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
  Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  3137991f
- Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9
  Julien Denize authored Nov 21, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  57430fc9
- [BugFix] Fix missing symbol triggering FA2 fallback on Hopper (#29107) · c68c7b40
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c68c7b40
- [log] add weights loading time log to sharded_state loader (#28628) · 53a1ba6e
  Ning Xie authored Nov 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  53a1ba6e
- [BugFix] Make sure to allocate worst case MoE workspace during profile run in... · 1840c5cb
  Lucas Wilkinson authored Nov 21, 2025
```
[BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1840c5cb
- [Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
  Woosuk Kwon authored Nov 21, 2025
  
  1bed891f
- [Deprecation] Deprecate `seed=None` (#29185) · ceca0605
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ceca0605
- [ROCm][CI] Fix config/test_config_generation.py (#29142) · 75648b16
  Charlie Fu authored Nov 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  75648b16
- [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
  Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  460d02a4
- Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) · b4c8fbaa
  Mingyuan Ma authored Nov 21, 2025
```
Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  b4c8fbaa
- [CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in... · e99e4673
  rasmith authored Nov 21, 2025
```
[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  e99e4673
- [Log] Optimize startup log (#28948) · a42ab317
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  a42ab317
- Upstream triton fp4 weight preshuffle (#28888) · b7f1f490
  Aleksandr Malyshev authored Nov 21, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  b7f1f490
- GPU Model Runner V2 (#25266) · 30b44a15
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  30b44a15
- [CI] Add batch invariant test to ci (#27842) · 1f400c58
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1f400c58