Commits · 90f3f7d73e09aff12dc96767223fa54f48f117a8 · OpenDAS / vllm_cscc · GitLab

14 Sep, 2025 9 commits
- [Spec Decoding]Support Spec Decoding Metrics in DP Mode (#24049) · 90f3f7d7
  wuhang authored Sep 15, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  90f3f7d7
- [Chore] Remove ipex_ops warning (#24835) · 6dc8da5d
  Robert Shaw authored Sep 14, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  6dc8da5d
- Force use C++17 globally to avoid compilation error (#24823) · 79cbcab8
  FengjinChen authored Sep 15, 2025
```
Signed-off-by: chenfengjin <1871653365@qq.com>
```
  79cbcab8
- [Benchmarks] Throw usage error when using dataset-name random and dataset-path together (#24819) · ff680359
  Ye (Charlotte) Qi authored Sep 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  ff680359
- fix type of sampling rate for encode_base64 (#24826) · 1177dd53
  co63oc authored Sep 15, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1177dd53
- [Perf] Fix DeepGEMM Contiguous Layout Issue, 5.5% Throughput Improvement (#24783) · fc2dbcda
  Wentao Ye authored Sep 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fc2dbcda
- [Misc] Improve `s3_utils` type hints with `BaseClient` (#24825) · fec347de
  Hyogeun Oh (오효근) authored Sep 14, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  fec347de
- [Multi Modal][Performance] Fused Q,K's apply_rope into one (#24511) · cc3173ae
  Wenlong Wang authored Sep 14, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc3173ae
- [Chore] Minor simplification for non-PP path (#24810) · 3e903b6c
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  3e903b6c
13 Sep, 2025 16 commits
- [Minor] Simplify duplicative device check for cuda (#24793) · 973c9d01
  Victor Ziliang Peng authored Sep 13, 2025
```
Signed-off-by: Ziliang Peng <ziliangdotme@gmail.com>
```
  973c9d01
- Remove redundant assignment in xfer_buffers, This is a little fix (#24732) · 15b8fef4
  TaoYu Chen authored Sep 13, 2025
```
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com>
```
  15b8fef4
- [CI][Spec Decode] Adjust threshold for flaky ngram spec decoding test again (#24771) · cfa3234a
  Wenlong Wang authored Sep 13, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  cfa3234a
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
- [Misc] Correct an outdated comment. (#24765) · 4dad72f0
  Russell Bryant authored Sep 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4dad72f0
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 59d7ffc1
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  59d7ffc1
- [Core][Multimodal] Cache `supports_kw` (#24773) · 1da0f144
  Lukas Geiger authored Sep 13, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1da0f144
- [Kernels][DP/EP] Optimize Silu Kernel for R1 (#24054) · 98229db2
  Elvir Crnčević authored Sep 13, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  98229db2
- [Perf] Use NVIDIA hardware-accelerated instruction for float to fp8_e4m3 quantization (#24757) · dbeee384
  elvischenv authored Sep 13, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  dbeee384
- [Doc]: Remove 404 hyperlinks (#24785) · 30498f2a
  Rakesh Asapanna authored Sep 13, 2025
```
Signed-off-by: Rakesh Asapanna  <45640029+rozeappletree@users.noreply.github.com>
```
  30498f2a
- [Docs] Remove Neuron install doc as backend no longer exists (#24396) · abc7989a
  Harry Mellor authored Sep 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  abc7989a
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
- [Chore] Remove unused batched RoPE op & kernel (#24789) · 5febdc87
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5febdc87
- [Bugfix] Fix GPUModelRunner has no attribute lora_manager (#24762) · 99bfef84
  Jee Jee Li authored Sep 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  99bfef84
- [Model] Add Olmo3 model implementation (#24534) · 89e08d6d
  Shane A authored Sep 12, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  89e08d6d
- [Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) · 7f2ea707
  Chenheli Hua authored Sep 12, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  7f2ea707
12 Sep, 2025 15 commits
- [Core] Support async scheduling with uniproc executor (#24219) · 4fdd6f5c
  Nick Hill authored Sep 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  4fdd6f5c
- [Qwen3Next] Fixes the cuda graph capture conditions under large batch sizes (#24660) (#24667) · 8226dd56
  Tao He authored Sep 13, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  8226dd56
- Add FLASHINFER_MLA to backend selector test (#24753) · 5fe643fc
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  5fe643fc
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- Invert pattern order to make sure that out_proj layers are identified (#24781) · c89ed8de
  Alexandre Marques authored Sep 12, 2025
```
Signed-off-by: Alexandre Marques <almarque@redhat.com>
```
  c89ed8de
- [Compilation Bug] Fix Inductor Graph Output with Shape Issue (#24772) · 3beadc2f
  Wentao Ye authored Sep 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3beadc2f
- [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints (#23937) · bc636f21
  Clayton Coleman authored Sep 12, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  bc636f21
- [CI] Trigger BC Linter when labels are added/removed (#24767) · 017354c0
  Zhewen Li authored Sep 12, 2025
  
  017354c0
- [Bugfix] Fix incompatibility between #20452 and #24548 (#24754) · 010acc6e
  Cyrus Leung authored Sep 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  010acc6e
- [CI] Speed up model unit tests in CI (#24253) · c8c42597
  afeldman-nm authored Sep 12, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  c8c42597
- [UX] Remove AsyncLLM torch profiler disabled log (#24609) · 9d2a4460
  Michael Goin authored Sep 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9d2a4460
- [Model] Switch to Fused RMSNorm in GLM-4.1V model (#24733) · f17c0758
  Samit authored Sep 13, 2025
```
Signed-off-by: SamitHuang <285365963@qq.com>
```
  f17c0758
- [Models] Prevent CUDA sync in Qwen2.5-VL (#24741) · b0d1213a
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b0d1213a
- [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` (#24742) · 57f94e88
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  57f94e88
- [Bugfix][Frontend] Fix `--enable-log-outputs` does not match the documentation (#24626) · 684b6870
  Kebe authored Sep 13, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  684b6870