Commits · d593cf28fa020dbae53dae19122aac8aeeeae0bc · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "bd620b01fb74d5269ca6fc0fd32f66bfb205a358"

16 Sep, 2025 10 commits

[Misc] Add removed encoder-decoder models to previously supported models list (#24961) · d593cf28
Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d593cf28

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

[Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331) · 73cfb3c5
Chih-Chieh Yang authored Sep 16, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
73cfb3c5

[Feat][EPLB] A novel static EPLB placement strategy for MoE models. (#23745) · 7ea5c73a

Chen Bruce authored Sep 16, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Signed-off-by: Chen Bruce <bruceszchen@tencent.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Chen Bruce <cszwwdz@vip.qq.com>
Co-authored-by: lemon412 <lemon412@foxmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

7ea5c73a

[Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0` (#24593) · 27fcfe7b

tomeras91 authored Sep 16, 2025

Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Signed-off-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

27fcfe7b

[benchmark] Add triton version in the moe tuned config (#24769) · 04ad0dc2
Jee Jee Li authored Sep 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
04ad0dc2
[QWEN NEXT] Fused MoE kernels Optimization configs (#24924) · 238c4c17
Saman A. Pour authored Sep 15, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
238c4c17
[Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
8c546102
Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b
[ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2891603e

15 Sep, 2025 7 commits
- [Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
  Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a0b26701
- Move `MultiModalConfig` from `config/__init__.py` to `config/multimodal.py` (#24659) · c4afdb69
  Harry Mellor authored Sep 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c4afdb69
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
- [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822) · 0e219cd5
  Isotr0py authored Sep 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0e219cd5
- [Model]: support Ling2.0 (#24627) · 72c99f2a
  ant-yy authored Sep 15, 2025
```
Signed-off-by: vito.yy <vito.yy@antgroup.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  72c99f2a
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79
- [Bugfix] MiDashengLM model contact error under concurrent testing (#24738) · a8c0f599
  bingchen-mi authored Sep 15, 2025
```
Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
```
  a8c0f599
14 Sep, 2025 2 commits

[Perf] Fix DeepGEMM Contiguous Layout Issue, 5.5% Throughput Improvement (#24783) · fc2dbcda

Wentao Ye authored Sep 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

fc2dbcda

[Multi Modal][Performance] Fused Q,K's apply_rope into one (#24511) · cc3173ae
Wenlong Wang authored Sep 14, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
cc3173ae

13 Sep, 2025 5 commits
- [Doc]: fix typos in various files (#24798) · 41ae4a1e
  Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  41ae4a1e
- [Kernels][DP/EP] Optimize Silu Kernel for R1 (#24054) · 98229db2
  Elvir Crnčević authored Sep 13, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  98229db2
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
- [Chore] Remove unused batched RoPE op & kernel (#24789) · 5febdc87
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5febdc87
- [Model] Add Olmo3 model implementation (#24534) · 89e08d6d
  Shane A authored Sep 12, 2025
```
Signed-off-by: Shane A <shanea@allenai.org>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  89e08d6d
12 Sep, 2025 16 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- Invert pattern order to make sure that out_proj layers are identified (#24781) · c89ed8de
  Alexandre Marques authored Sep 12, 2025
```
Signed-off-by: Alexandre Marques <almarque@redhat.com>
```
  c89ed8de
- [Compilation Bug] Fix Inductor Graph Output with Shape Issue (#24772) · 3beadc2f
  Wentao Ye authored Sep 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3beadc2f
- [Model] Switch to Fused RMSNorm in GLM-4.1V model (#24733) · f17c0758
  Samit authored Sep 13, 2025
```
Signed-off-by: SamitHuang <285365963@qq.com>
```
  f17c0758
- [Models] Prevent CUDA sync in Qwen2.5-VL (#24741) · b0d1213a
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  b0d1213a
- [Models] Optimise and simplify `_validate_and_reshape_mm_tensor` (#24742) · 57f94e88
  Lukas Geiger authored Sep 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  57f94e88
- [Qwen3-Next] MoE configs for H100 TP=1,2 and TP2/EP (#24739) · 9f04d9d5
  Elvir Crnčević authored Sep 12, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  9f04d9d5
- [Bugfix] Fix MRoPE dispatch on XPU (#24724) · 4d7c1d53
  Yan Ma authored Sep 12, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  4d7c1d53
- [Docs] Fix warnings in mkdocs build (continued) (#24740) · 41f17bf2
  Hyogeun Oh (오효근) authored Sep 12, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  41f17bf2
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
- [Bugfix] Fix BNB name match (#24735) · 60a09519
  Jee Jee Li authored Sep 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  60a09519
- [BugFix] Fix Qwen3-Next PP (#24709) · f592b317
  Nick Hill authored Sep 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  f592b317
- [Bugfix] Fix MRoPE dispatch on CPU (#24712) · 7920de0a
  Li, Jiang authored Sep 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7920de0a
- Fix implementation divergence for BLOOM models between vLLM and HuggingFace... · ddcec289
  Andrew Sansom authored Sep 11, 2025
```
Fix implementation divergence for BLOOM models between vLLM and HuggingFace when using prompt embeds (#24686)
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ddcec289
- Enable conversion of multimodal models to pooling tasks (#24451) · e090b7b4
  Maximilien de Bayser authored Sep 12, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  e090b7b4