Commits · 58fab50d82838d5014f4a14d991fdb9352c9c84b · OpenDAS / vllm_cscc · GitLab

22 Oct, 2025 25 commits
- [Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d
  Russell Bryant authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  58fab50d
- [Bugfix] Fix HF format InternVL large variants video processing (#27330) · db6f28d8
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  db6f28d8
- [Bugfix] Make `get_mrope_input_positions` instance methods (#27342) · 14e2f123
  Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  14e2f123
- [NIXL] use Host buffer to support TP_ratio > 1 for XPU (#27140) · 7c4767f1
  Chendi.Xue authored Oct 22, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  7c4767f1
- [Bugfix] Add missing 'is_internal_router' attribute to FusedMoEWithLoRA (#27351) · 9771e0b4
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9771e0b4
- [bugfix] remove unused parameters to reduce unnecessary vram usage (#26789) · 980de31c
  Reinforce-II authored Oct 22, 2025
```
Signed-off-by: Reinforce-II <fate@eastal.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  980de31c
- [Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267) · 1c160841
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1c160841
- [NIXL] Terminate handshake listener thread in shutdown (#26404) · 4ca13a86
  Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  4ca13a86
- [Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec
  Isotr0py authored Oct 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  675aa2ec
- [Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3
  dongbo910220 authored Oct 22, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  3ae082c3
- Mirroring changes in test-pipeline.yaml into test-amd.yaml (#27242) · 49c00fe3
  Alexei-V-Ivanov-AMD authored Oct 22, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  49c00fe3
- [docs] Update v1 metrics design doc (#27332) · 141d3b9f
  Mark McLoughlin authored Oct 22, 2025
```
Signed-off-by: Simon Mo <simon.mo@hey.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: atalhens <sneh.lata@nutanix.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: atalhens <sneh.lata@nutanix.com>
```
  141d3b9f
- [Core] Handle MoE LoRA edge cases (#27335) · abf3db40
  Jee Jee Li authored Oct 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  abf3db40
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
- [Log] Add Warning for `LLM(data_parallel_size=k)` single-process DP Usage (#27282) · 1a0f4def
  Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1a0f4def
- [Bugfix][CPU] Disable dual stream execution for experts on CPU (#27320) · 843af7f7
  Li, Jiang authored Oct 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  843af7f7
- [Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86
  wang.yuqi authored Oct 22, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  1f633b86
- fixed reasoning streaming with tool_choice="required" (#24108) · a4c29e6e
  ExtReMLapin authored Oct 22, 2025
```
Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  a4c29e6e
- Remove last `level` references not removed in #26355 (#27260) · 8f18feb1
  Harry Mellor authored Oct 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8f18feb1
- Update release pipeline for PyTorch 2.9.0 (#27303) · ed540d6d
  Huy Do authored Oct 22, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  ed540d6d
- [1/N][Platform] Cleanup useless function (#26982) · f6027b28
  wangxiyuan authored Oct 22, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  f6027b28
- [torch.compile] Enable silu_mul_fp8_quant fusion without custom ops enabled (#27146) · ab3e8004
  Jiangyun Zhu authored Oct 22, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ab3e8004
- [Benchmark] Add plot utility for parameter sweep (#27168) · ceacedc1
  Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ceacedc1
- [CI] Nixl integration tests DP-EP (#27199) · bfa59be8
  Nicolò Lucchesi authored Oct 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bfa59be8
- [DOC] [ROCm] Add ROCm quickstart guide (#26505) · 265ecb05
  vllmellm authored Oct 22, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  265ecb05
21 Oct, 2025 15 commits
- [Deepseek v3.2] Remove extra logics in indexer (#26465) · 09a7e6f6
  Lain authored Oct 21, 2025
```
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Signed-off-by: Lain <siyuanf@nvidia.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
```
  09a7e6f6
- [P/D] KVConnector for decode benchmarking (#25986) · 6c2eef5a
  Tyler Michael Smith authored Oct 21, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  6c2eef5a
- [Bugfix] skip cuda graph for drafter when running with eager (#26821) · 19748806
  Benjamin Chislett authored Oct 21, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  19748806
- Updated xgrammar backend to not deny supported string formats (#27253) · 4a8a567e
  ExtReMLapin authored Oct 22, 2025
```
Signed-off-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Signed-off-by: ExtReMLapin <3909752+ExtReMLapin@users.noreply.github.com>
Co-authored-by: CNE Pierre FICHEPOIL <pierre-1.fichepoil@gendarmerie.interieur.gouv.fr>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4a8a567e
- [Performance] Dual stream execution of "shared_experts" and "selected_experts"... · 344a0017
  Alexander Matveev authored Oct 21, 2025
```
[Performance] Dual stream execution of "shared_experts" and "selected_experts" inside FusedMoE (#26440)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  344a0017
- Update PyTorch to 2.9.0+cu129 (#24994) · becb7de4
  Huy Do authored Oct 21, 2025
```
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  becb7de4
- [Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8
  Tao He authored Oct 22, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  250fb1b8
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
- [Bugfix][P/D] Reduce num_threads used by nixl ucx backend (#27196) · ddeec11b
  David Whyte-Gray authored Oct 21, 2025
```
Signed-off-by: David Whyte-Gray <40244437+dagrayvid@users.noreply.github.com>
```
  ddeec11b
- [Feature] Batch Invariant for R1 TP 8 on Blackwell (#27229) · 86ed7702
  Wentao Ye authored Oct 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  86ed7702
- [ROCm] Update Triton, Torch, and AITER branches for ROCm base Dockerfile (#27206) · aa1356ec
  Micah Williamson authored Oct 21, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  aa1356ec
- Add @pavanimajety to .github/codeowners for Flashinfer, ModelOpt related code (#27213) · ecc3c094
  Pavani Majety authored Oct 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  ecc3c094
- [ROCM] Enable CompressedTensorsWNA16 (#27187) · ba09652d
  JartX authored Oct 21, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  ba09652d
- [CI] Install pre-release version of `apache-tvm-ffi` for `flashinfer` (#27262) · bd66b852
  Harry Mellor authored Oct 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bd66b852
- [Chore] Separate out NCCL utilities from vllm.utils (#27197) · 6c728f77
  dongbo910220 authored Oct 21, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  6c728f77