Commits · 519ef9a91111d2d6f8545c8a6b2c1a28d87309fa · OpenDAS / vllm_cscc · GitLab

17 Dec, 2025 16 commits
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
- [Doc][ResponsesAPI] add documentation (#30840) · 4c054d89
  Andrew Xia authored Dec 17, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  4c054d89
- [NIXL][Bugfix] Fix NIXL/RDMA registration failure over CuMemAllocator (#29569) · f4e884f2
  Sheng Lin authored Dec 17, 2025
```
Signed-off-by: Somoku <linsh0@protonmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f4e884f2
- CustomOp: grouped topk (#29575) · 3b1d440e
  Xinyu Chen authored Dec 17, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  3b1d440e
- [Mamba] Removed disable cascade attn in MambaModelConfig (#30712) · a9e15c21
  Asaf Joseph Gardin authored Dec 17, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  a9e15c21
- [Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during... · 20fda431
  Robin authored Dec 17, 2025
```
[Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during streaming extraction (#30555)
Signed-off-by: WangErXiao <863579016@qq.com>
```
  20fda431
- [XPU] fix broken fp8 online quantization for XPU platform (#30831) · 4f735bab
  Yan Ma authored Dec 17, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  4f735bab
- [Bugfix][CPU] Fix CPU backend ROPE dispatch for VL models (#30829) · 0cd53536
  Li, Jiang authored Dec 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0cd53536
- Update note comment for flashinfer attention warmup (#30711) · d4d27517
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d4d27517
- bump up compressed tensors version to 0.13.0 (#30799) · 009a7738
  shanjiaz authored Dec 17, 2025
```
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  009a7738
- [CI/Build] Fix compatibility between #30244 and #30396 (#30787) · 44d3b1df
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44d3b1df
- [CPU] Add action to automatically label CPU related PRs (#30678) · bb5ac1fe
  Fadi Arafeh authored Dec 17, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  bb5ac1fe
- Update model-hosting-container-standards to 0.1.10 (#30815) · 811cdf51
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  811cdf51
- Fix nemotron_nas intermediate_size computation (#30795) · f5db6385
  Grzegorz K. Karch authored Dec 17, 2025
```
Signed-off-by: Grzegorz Karch <gkarch@nvidia.com>
```
  f5db6385
- [docker] Allow kv_connectors install to fail on arm64 (#30806) · c0a88df7
  Amr Mahdi authored Dec 17, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
  c0a88df7
16 Dec, 2025 24 commits
- [MM] Pass FA version in ViT Attn (#30756) · e087fbc3
  Nicolò Lucchesi authored Dec 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e087fbc3
- Replace deprecated enable_fusion with fuse_norm_quant in test_rms_group_quant (#30817) · e80455ca
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e80455ca
- [ROCm] [Bugfix] Fix torch sdpa hallucination (#30789) · 2410132b
  TJian authored Dec 17, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2410132b
- [Perf][Kernels] Vectorize `csrc/activations_kernels.cu` (#29512) · 0a1ab1e5
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0a1ab1e5
- [CI] Skip ci failure test (#30804) · b6ec077e
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6ec077e
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
- [Bugfix][DSV32] Fix overflow in topk. (#30754) · eaa82a70
  Daniel Cámpora authored Dec 16, 2025
```
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  eaa82a70
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
- [Refactor] Small refactor for group topk (#30562) · f21f5ea3
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  f21f5ea3
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) · 10ee1c64
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  10ee1c64
- [Docs][API] Remove warning about LoRARequest being internal-only (#30774) · 66c3537e
  Mark McLoughlin authored Dec 16, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  66c3537e
- Update where `bytes_to_unicode` is imported from (#30771) · e1625498
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e1625498
- Remove `head_mask` from Ultravox and Swin (#30764) · 0b0acc75
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b0acc75
- Fix instantiation of `HfHubHTTPError` in LoRA test (#30768) · af506fd7
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af506fd7
- [TRTLLM] Remove the MoE GEMM weight name change (#30713) · ce12b407
  Ming Yang authored Dec 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ce12b407
- [Feat] Enable eplb with default all2all backend (#30559) · 59bd5f6a
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  59bd5f6a
- [BugFix] Fix memory spike in workspace allocation (#30744) · 00a8d762
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  00a8d762
- [CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) · 4de08ad6
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4de08ad6
- [Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772) · 75eb302a
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  75eb302a
- [ROCm][MTP] Support MTP for AITER MLA backend (#28624) · 9dbbc59b
  Pleaplusone authored Dec 16, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  9dbbc59b
- update piecewise cudagraph warning when splitting_ops=[] (#30728) · 104003dc
  Boyuan Feng authored Dec 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  104003dc