Commits · 6f1355a1b74e4502e6a4e6ba9a811cc50729ee1f · OpenDAS / vllm_cscc · GitLab

25 Nov, 2025 6 commits
- [Perf] Disable DeepGEMM MoE by default when TP=8 is used (#29346) · 6f1355a1
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6f1355a1
- Scheduled removal of `ParallelConfig`'s direct child EPLB fields (#29324) · a4ad43ad
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a4ad43ad
- [BugFix] Fix duplicate id tool-call race condition (#29355) · a178a0b4
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  a178a0b4
- [XPU] upgrade torch & ipex 2.9 on XPU platform (#29307) · b8328b49
  Kunshang Ji authored Nov 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b8328b49
- [Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688) · 5f9679a4
  Hanjie Qiu authored Nov 24, 2025
```
Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  5f9679a4
- [UX] Raise error for attn backend of batch invariant (#29348) · 699bca76
  Wentao Ye authored Nov 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  699bca76
24 Nov, 2025 29 commits
- [Bugfix] Only use triton_kernels for MXFP4 on SM90 and SM100 (#29339) · c17610e2
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c17610e2
- [Hybrid Allocator] Better layer padding strategy for gpt-oss eagle (#29303) · 71df2a57
  Chen Zhang authored Nov 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  71df2a57
- Remove VLLM_SKIP_WARMUP tip (#29331) · 4dd42db5
  Tyler Michael Smith authored Nov 24, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4dd42db5
- [Tests] Verify gpt_oss package is installed in harmony tests (#29336) · 84371daf
  Nick Hill authored Nov 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  84371daf
- [Model Runner V2] Simplify Eagle bookkeeping with num_rejected (#29347) · f32c7d6f
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f32c7d6f
- [XPU]fix Kimi-VL-A3B-thinking on xpu (#29309) · 3cfa63ad
  Yan Ma authored Nov 25, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  3cfa63ad
- [CI/Build] Moves to cuda-base runtime image while retaining minimal JIT dependencies (#29270) · 4d6afcad
  Benjamin Bartels authored Nov 24, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
Signed-off-by: Benjamin Bartels <benjamin@bartels.dev>
```
  4d6afcad
- [Model Runner V2] Add minor clarification comments for Eagle (#29332) · 97588c4d
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  97588c4d
- [Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) · 839c6b7b
  Chenheli Hua authored Nov 24, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  839c6b7b
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
- [Model Runner V2] Change Numba AoT to JIT (#29328) · cec418b5
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cec418b5
- [Model Runner V2] Implement Single-step Eagle 1 (#29300) · cc313cb7
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc313cb7
- [NIXL] Use config to enable telemetry + NIXL version bump (#29305) · 26a46558
  Nicolò Lucchesi authored Nov 24, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  26a46558
- [Build/CI][DP/EP] Add QWen/Qwen3-30B-A3B-FP8 + EPLB tests to Nightly H100 and B200 (#29195) · e924bbb4
  Varun Sundar Rabindranath authored Nov 24, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e924bbb4
- [Bugfix] properly handle nested json with llama3 tool parser (#27701) · 656516c3
  Aydin Abiar authored Nov 24, 2025
```
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Signed-off-by: Aydin Abiar <62435714+Aydin-ab@users.noreply.github.com>
Co-authored-by: Aydin Abiar <aydin@anyscale.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  656516c3
- [Bugfix] [ROCm] [UX] Reorganize ROCm Backend Selection Logic (#26980) · e48b2e68
  vllmellm authored Nov 24, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e48b2e68
- Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53
  Laith Sakka authored Nov 24, 2025
```
Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  7a228b53
- Update KServe guide link in documentation (#29258) · f716a153
  Yuan Tang authored Nov 24, 2025
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  f716a153
- [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
  WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
  2601f18a
- [CPU][IBM Z] Fix BF16 support and vectorize math operations for s390x (#28926) · 4de87866
  R3hankhan authored Nov 24, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  4de87866
- [Doc]: fix typos in various files (#29230) · eca7a8fb
  Didier Durand authored Nov 24, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  eca7a8fb
- [Bugfix][Rocm] Fix shared expert weight loading failure in DeepSeek-MTP (#27563) · 8005e606
  杰兮 authored Nov 24, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  8005e606
- [Feature][Benchmark] add --link-vars can filter when serve_param equal bench_param (#28909) · 68dfe28e
  rongfu.leng authored Nov 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  68dfe28e
- [BugFix] Fix R-VL model loading error (#29299) · ed40d859
  Fanli Lin authored Nov 24, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  ed40d859
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
- [ROCm] Support for Whisper v1 with Aiter Unified Attention and Aiter Flash Attention (#28376) · 5253f427
  tongqiu authored Nov 24, 2025
```
Signed-off-by: apinge <Tong.Qiu2@amd.com>
```
  5253f427
- [Model] Add OpenCUA-7B support (#29068) · 30854783
  Zero authored Nov 24, 2025
```
Signed-off-by: lim4349 <rockmanzero@naver.com>
Signed-off-by: Zero <rockmanzero@naver.com>
Co-authored-by: Cloud User <ubuntu@a100-80g-4.novalocal>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  30854783
- [LoRA] Optimize 3D MoE logic (#29222) · 1073ba68
  Jee Jee Li authored Nov 24, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1073ba68
- [Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message... · c309bb52
  Josh Moore authored Nov 23, 2025
```
[Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249)
Signed-off-by: joshiemoore <joshiemoore98@gmail.com>
```
  c309bb52
23 Nov, 2025 5 commits
- [Model Runner V2] Add apply_temperature option to gumbel_sample (#29276) · 3e1ad406
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  3e1ad406
- [Model Runner V2] Optimize CUDA graph capture time (#29275) · 62d54ba4
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  62d54ba4
- [Model Runner V2] Support spec decoding [1/N] (#29274) · b004c004
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b004c004
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
- [Bugfix] Use lazy string reference for DeepseekV3Config in config registry (#28958) · 6fb0215e
  Luke authored Nov 23, 2025
```
Signed-off-by: Luke <yq0536@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6fb0215e