Commits · a0d8b9738dccaa70a9eb6355c9f9cf6c9bb9fc3d · OpenDAS / vllm_cscc · GitLab

15 Sep, 2025 7 commits
- [Misc] Own KVConnectors installation (#24867) · a0d8b973
  Nicolò Lucchesi authored Sep 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a0d8b973
- [Misc] rename interval to max_recent_requests (#24229) · 59e17dd4
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  59e17dd4
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79
- [Bugfix] MiDashengLM model contact error under concurrent testing (#24738) · a8c0f599
  bingchen-mi authored Sep 15, 2025
```
Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
```
  a8c0f599
- [Frontend] Skip `stop` in reasoning content (#14550) · f4a948f3
  Ce Gao authored Sep 15, 2025
```
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  f4a948f3
- [kv cache] update num_free_blocks in the end (#24228) · 3f331398
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3f331398
- [Docs] Have a try to improve frameworks/streamlit.md (#24841) · 78818dd1
  Michael Yao authored Sep 15, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  78818dd1
14 Sep, 2025 10 commits
- [Hybrid Allocator] Support Pipeline Parallel (#23974) · 8e5cdcda
  Chen Zhang authored Sep 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8e5cdcda
- [Spec Decoding]Support Spec Decoding Metrics in DP Mode (#24049) · 90f3f7d7
  wuhang authored Sep 15, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  90f3f7d7
- [Chore] Remove ipex_ops warning (#24835) · 6dc8da5d
  Robert Shaw authored Sep 14, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  6dc8da5d
- Force use C++17 globally to avoid compilation error (#24823) · 79cbcab8
  FengjinChen authored Sep 15, 2025
```
Signed-off-by: chenfengjin <1871653365@qq.com>
```
  79cbcab8
- [Benchmarks] Throw usage error when using dataset-name random and dataset-path together (#24819) · ff680359
  Ye (Charlotte) Qi authored Sep 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  ff680359
- fix type of sampling rate for encode_base64 (#24826) · 1177dd53
  co63oc authored Sep 15, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1177dd53
- [Perf] Fix DeepGEMM Contiguous Layout Issue, 5.5% Throughput Improvement (#24783) · fc2dbcda
  Wentao Ye authored Sep 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fc2dbcda
- [Misc] Improve `s3_utils` type hints with `BaseClient` (#24825) · fec347de
  Hyogeun Oh (오효근) authored Sep 14, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  fec347de
- [Multi Modal][Performance] Fused Q,K's apply_rope into one (#24511) · cc3173ae
  Wenlong Wang authored Sep 14, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc3173ae
- [Chore] Minor simplification for non-PP path (#24810) · 3e903b6c
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  3e903b6c
13 Sep, 2025 16 commits
- [Minor] Simplify duplicative device check for cuda (#24793) · 973c9d01
  Victor Ziliang Peng authored Sep 13, 2025
```
Signed-off-by: Ziliang Peng <ziliangdotme@gmail.com>
```
  973c9d01
- Remove redundant assignment in xfer_buffers, This is a little fix (#24732) · 15b8fef4
  TaoYu Chen authored Sep 13, 2025
```
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com>
```
  15b8fef4
- [CI][Spec Decode] Adjust threshold for flaky ngram spec decoding test again (#24771) · cfa3234a
  Wenlong Wang authored Sep 13, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  cfa3234a
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
- [Misc] Correct an outdated comment. (#24765) · 4dad72f0
  Russell Bryant authored Sep 13, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4dad72f0
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 59d7ffc1
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  59d7ffc1
- [Core][Multimodal] Cache `supports_kw` (#24773) · 1da0f144
  Lukas Geiger authored Sep 13, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1da0f144
- [Kernels][DP/EP] Optimize Silu Kernel for R1 (#24054) · 98229db2
  Elvir Crnčević authored Sep 13, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  98229db2
- [Perf] Use NVIDIA hardware-accelerated instruction for float to fp8_e4m3 quantization (#24757) · dbeee384
  elvischenv authored Sep 13, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  dbeee384
- [Doc]: Remove 404 hyperlinks (#24785) · 30498f2a
  Rakesh Asapanna authored Sep 13, 2025
```
Signed-off-by: Rakesh Asapanna  <45640029+rozeappletree@users.noreply.github.com>
```
  30498f2a
- [Docs] Remove Neuron install doc as backend no longer exists (#24396) · abc7989a
  Harry Mellor authored Sep 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  abc7989a
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
- [Chore] Remove unused batched RoPE op & kernel (#24789) · 5febdc87
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5febdc87
- [Bugfix] Fix GPUModelRunner has no attribute lora_manager (#24762) · 99bfef84
  Jee Jee Li authored Sep 13, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  99bfef84
- [Model] Add Olmo3 model implementation (#24534) · 89e08d6d
  Shane A authored Sep 12, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  89e08d6d
- [Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) · 7f2ea707
  Chenheli Hua authored Sep 12, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  7f2ea707
12 Sep, 2025 7 commits
- [Core] Support async scheduling with uniproc executor (#24219) · 4fdd6f5c
  Nick Hill authored Sep 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Ronald1995 <ronaldautomobile@163.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  4fdd6f5c
- [Qwen3Next] Fixes the cuda graph capture conditions under large batch sizes (#24660) (#24667) · 8226dd56
  Tao He authored Sep 13, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  8226dd56
- Add FLASHINFER_MLA to backend selector test (#24753) · 5fe643fc
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  5fe643fc
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- Invert pattern order to make sure that out_proj layers are identified (#24781) · c89ed8de
  Alexandre Marques authored Sep 12, 2025
```
Signed-off-by: Alexandre Marques <almarque@redhat.com>
```
  c89ed8de
- [Compilation Bug] Fix Inductor Graph Output with Shape Issue (#24772) · 3beadc2f
  Wentao Ye authored Sep 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3beadc2f
- [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints (#23937) · bc636f21
  Clayton Coleman authored Sep 12, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  bc636f21