Commits · 3bb9561928bb4b0fb1047e738e2f160f841b04b6 · OpenDAS / vllm_cscc · GitLab

24 Dec, 2025 10 commits
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
- [ROCm][CI] Set VLLM_FLOAT32_MATMUL_PRECISION="tf32" For terratorch Tests In AMD CI (#31242) · 3ce791ac
  Micah Williamson authored Dec 23, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  3ce791ac
- [ROCm][CI][Bugfix] Fix Siglip2 rotary embedding dispatch and InternVL video test tolerance (#31235) · e42894f5
  Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e42894f5
- [Bug] Fix `Number of dimensions of tensors must match.` for Deepseek V3.2 (#31160) · 76e6a951
  Wentao Ye authored Dec 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  76e6a951
- [P/D] Mooncake connector support more protocols (#30133) · 8b59753c
  Chao Lei authored Dec 24, 2025
```
Signed-off-by: LCAIZJ <leichao139636@163.com>
```
  8b59753c
- [KVEvent] User request.block_hash for parent block_hash (#30544) · 538e830c
  Chen Zhang authored Dec 23, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  538e830c
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105
- [Bugfix] Enable `dynamic_dims` for different embeds shape (#31223) · dd424571
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd424571
- [Chore] Simplify logic of `_execute_mm_encoder` (#31222) · ca6a95ba
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca6a95ba
- [CI] Add Qwen3-Next-FP8 to Blackwell model tests (#31049) · bc0a5a0c
  Vadim Gimpelson authored Dec 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  bc0a5a0c
23 Dec, 2025 23 commits
- [ROCm][Bugfix] Fix RuntimeError in MMEncoderAttention by replacing .view() with .reshape() (#31203) · bfa2c0bb
  Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bfa2c0bb
- [Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686
  Mark McLoughlin authored Dec 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f7900686
- [Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
  Asaf Joseph Gardin authored Dec 23, 2025
  
  34916ae3
- docs: Add llm-d integration to the website (#31234) · 0736f901
  Yuan Tang authored Dec 23, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  0736f901
- Use helper function instead of looping through attribute names (#29788) · c016c95b
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c016c95b
- Only patch `original_max_position_embeddings` for Transformers v4 (#31214) · 1339878e
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1339878e
- [FIX] FP4 quantization kernel padding initialization bug (#31097) · b94f80ff
  danielafrimi authored Dec 23, 2025
```
Signed-off-by: <>
Co-authored-by: root <root@gpu-193.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-951.slurm-workers-slurm.slurm.svc.cluster.local>
```
  b94f80ff
- Fix edge case Mistral tool parser (#30724) · 38c361f9
  Joachim Studnia authored Dec 23, 2025
```
Signed-off-by: Joachim Studnia <joachim@mistral.ai>
Signed-off-by: Joachim Studnia <studniajoachim@gmail.com>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  38c361f9
- [Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bb62dda2
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
- Add util function for checking nesting of rope parameters (#31146) · b10d47e0
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b10d47e0
- [OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
  R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  769f27e7
- [Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54
  Jakub Zakrzewski authored Dec 23, 2025
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  23daef54
- [Bugfix] Fix MoE LoRA bin/pt loading (#31161) · 27c6c2f9
  Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  27c6c2f9
- Correct position of docstring of class attributes (#31209) · 73cfb7a7
  Weida Hong authored Dec 23, 2025
```
Signed-off-by: Weida Hong <wdhongtw@google.com>
```
  73cfb7a7
- [ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
  vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  f32cfd7d
- [Bugfix] Fix Jais2ForCausalLM (#31198) · 6b16fff0
  Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b16fff0
- [XPU] decrease IGC_ForceOCLSIMDWidth for speculative decoding triton-xpu... · f1c2c201
  Yan Ma authored Dec 23, 2025
```
[XPU] decrease IGC_ForceOCLSIMDWidth for speculative decoding triton-xpu kernel compilation (#30538)
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  f1c2c201
- [Chore] Update more locations to use `attention_config.backend` (#31153) · 8cef1376
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8cef1376
- [Feature] Batch invariant: Lora (#30097) · a37328fc
  liuquan authored Dec 23, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
  a37328fc
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
- [ci] Fix Pytorch compilation test oom in 2.10 (#31194) · 612d5ffd
  Angela Yi authored Dec 22, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  612d5ffd
- [AMD][CI] fix v1/engine test_preprocess_error_handling (#31192) · 78e5e62b
  Divakar Verma authored Dec 22, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  78e5e62b
22 Dec, 2025 7 commits
- [MoE Refactor][7/N] AITER MK (#31102) · b57b9673
  Robert Shaw authored Dec 22, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b57b9673
- [CI Failure] Disable mosaicml/mpt-7b and databricks/dbrx-instruct tests (#31182) · 6d518ffb
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d518ffb
- [Perf] Remove blocking copy in GDN Attention (#31167) · 85aff45e
  Benjamin Chislett authored Dec 22, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  85aff45e
- [Bug] Fix `'CutlassMLAImpl' object has no attribute '_workspace_buffer'` (#31173) · 5312a728
  Wentao Ye authored Dec 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5312a728
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [Doc] Add vllm-metal to hardware plugin documentation (#31174) · 95863540
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  95863540
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8