Commits · 4924ac582c5007fbf7b15d719708812e06961009 · OpenDAS / vllm_cscc · GitLab

19 Dec, 2025 5 commits
- Add hidden dimension validation for multimodal embedding inputs (#30968) · 4924ac58
  Wenqi Glantz authored Dec 19, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  4924ac58
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
- [ROCm][CI][Bugfix] Multi-Modal Model Support Fixes and Attention Backend Improvements (#30270) · 7b43db21
  Andreas Karatzas authored Dec 18, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  7b43db21
- [Bugfix] Fix tool_choice="none" being ignored by GPT-OSS/harmony models (#30867) · 6a09612b
  PlatinumGod authored Dec 19, 2025
```
Signed-off-by: yujiepu <pyjapple@gmail.com>
Signed-off-by: PlatinumGod <pyjapple@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  6a09612b
- [BugFix] Handle errors when preprocessing added requests (#30895) · 45c0526a
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  45c0526a
18 Dec, 2025 12 commits
- Remove all2all backend envvar (#30363) · 41b6f920
  Elizabeth Thomas authored Dec 18, 2025
```
Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  41b6f920
- [MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6
  Isotr0py authored Dec 19, 2025
```
[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  700a5ad6
- [Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
  inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  500f26e6
- adds jais 2 support (#30188) · 28d15ab5
  sarathc-cerebras authored Dec 18, 2025
```
Signed-off-by: sarathc-cerebras <sarath.chandran@cerebras.net>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  28d15ab5
- [BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7
  Lucas Wilkinson authored Dec 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  30bb19a7
- [Fix][FlexAttention] return max logical block index to handle reused blocks (#30915) · 11a89cf9
  Yifan Qiao authored Dec 17, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
```
  11a89cf9
- [CPU] Refactor CPU fused MOE (#30531) · e3ab93c8
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3ab93c8
- [compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  5f2f3fba
- [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) · bc3700e0
  Nicolò Lucchesi authored Dec 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bc3700e0
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
- [Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9
  SungMinCho authored Dec 17, 2025
```
Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  a0b782f9
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38
17 Dec, 2025 9 commits
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [CI][Bugfix] Fix flaky `tests/entrypoints/openai/test_audio.py::test_chat_streaming_audio` (#30878) · 9ca8cb38
  Nicolò Lucchesi authored Dec 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9ca8cb38
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
- [Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749) · 9ad5b217
  Chauncey authored Dec 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9ad5b217
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
- [Kernels][FI] Skip trtllm attention when num_kv_heads=1 (#30842) · a1001522
  Ye (Charlotte) Qi authored Dec 17, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a1001522
- CustomOp: grouped topk (#29575) · 3b1d440e
  Xinyu Chen authored Dec 17, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  3b1d440e
- [Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during... · 20fda431
  Robin authored Dec 17, 2025
```
[Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during streaming extraction (#30555)
Signed-off-by: WangErXiao <863579016@qq.com>
```
  20fda431
- [CI/Build] Fix compatibility between #30244 and #30396 (#30787) · 44d3b1df
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44d3b1df
16 Dec, 2025 14 commits
- [CI] Skip ci failure test (#30804) · b6ec077e
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6ec077e
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- [Refactor] Small refactor for group topk (#30562) · f21f5ea3
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  f21f5ea3
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) · 10ee1c64
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  10ee1c64
- Fix instantiation of `HfHubHTTPError` in LoRA test (#30768) · af506fd7
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af506fd7
- [CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) · 4de08ad6
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4de08ad6
- [Bugfix] Fix RequestOutput miss lora_request (#30636) · 0e391e75
  Jee Jee Li authored Dec 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0e391e75
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
- improve lazy import test (#30733) · c881db36
  Boyuan Feng authored Dec 15, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c881db36
- [CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · 3bd9c491
  Shanshan Shen authored Dec 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3bd9c491
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5