Commits · 33a0d43c7119269aa300d4341871dd46d52575d0 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "89a0315f4cdf34da40d7634a069068c09082b7dc"

24 Feb, 2026 4 commits

[BUGFIX][Qwen3.5] Hardcode `mlp.gate` as not quantizable (#35156) · 33a0d43c
Vadim Gimpelson authored Feb 24, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
33a0d43c

[Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) · ec853405

Jia Guo authored Feb 23, 2026


Signed-off-by: jasperjiaguo <jasperg662@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ec853405

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

[Perf] Improve default triton fused moe configs (#34846) · 22a97e66

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

22a97e66

23 Feb, 2026 11 commits
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
- [Bugfix] Fix MRotaryEmbedding missing `truncate` attr with YaRN scaling (#35080) · a7f341c3
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a7f341c3
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) · 1e8438a8
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Eldar Kurtic <you@example.com>
Co-authored-by: Eldar Kurtic <you@example.com>
```
  1e8438a8
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
- [Refactor] Remove dead private func `_fp8_perm` and `_extract_mask_for_item` (#35068) · 7f40e9e5
  Wentao Ye authored Feb 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7f40e9e5
- Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) · 103e614b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  103e614b
- fix: Apply embedding_multiplier to inputs_embeds (#34813) · e631f8e7
  Gabe Goodhart authored Feb 23, 2026
```
Signed-off-by: Gabe Goodhart <ghart@us.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e631f8e7
- [Refactor] Simplify dummy data generation (#35025) · 987506bc
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  987506bc
22 Feb, 2026 4 commits
- [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) · 2bcf71b9
  qizixi authored Feb 22, 2026
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  2bcf71b9
- [Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b
  tacos8me authored Feb 22, 2026
```
Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b7892a3b
- [New Model] Add ColModernVBERT (#34558) · 970861ac
  Athrael Soju authored Feb 22, 2026
```
Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Signed-off-by: athrael-soju <athrael-soju@users.noreply.github.com>
```
  970861ac
- [Model Bash][DSR1] Add selective dynamic shape marking for CustomOp (#34900) · 74d90b1c
  Vadim Gimpelson authored Feb 22, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  74d90b1c
21 Feb, 2026 6 commits

[Frontend] Add automatic language detection for Whisper transcription (#34342) · 98b0205c

Roman authored Feb 21, 2026


Signed-off-by: space_check <roman.vuskov@rwth-aachen.de>
Signed-off-by: Roman <45857014+spacecheck@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

98b0205c

[ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
8dc8a99b

[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) +... · 5719a4e4

Kata Coder authored Feb 21, 2026


[Frontend] Support multimodal inputs for late-interaction scoring (ColQwen3) + NewModel: nvidia/nemotron-colembed (#34574)
Signed-off-by: craftsangjae <craftsangjae@gmail.com>

5719a4e4

[Realtime] Add Qwen3-ASR realtime streaming support (#34613) · 11be2c74

pougetat authored Feb 20, 2026


Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

11be2c74

[ROCm][Bugfix]: Only save unpadded sizes for shared_experts in MoERunner to... · ded333fb

Rohan Potdar authored Feb 20, 2026


[ROCm][Bugfix]: Only save unpadded sizes for shared_experts in MoERunner to fix rmsnorm pad fusion (#34636)
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>

ded333fb

Revert "[Llama4,Quantization] Simplify and generalize logic for Q/K... · 0e22cd61
Lucas Wilkinson authored Feb 20, 2026
```
Revert "[Llama4,Quantization] Simplify and generalize logic for Q/K permutations in quantized self-attn layers " (#34997)
```
0e22cd61

20 Feb, 2026 6 commits

Bump Flashinfer Version and Re-enable DeepSeek NVFP4 AR+Norm Fusion (#34899) · ea5f903f
Wei Zhao authored Feb 20, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
ea5f903f
[CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
Lucas Wilkinson authored Feb 20, 2026

aaefc58e

[Minor] Add logging when using MXFP4 MXFP8 TRTLLM backend (#34916) · 05977923

Frank Wang authored Feb 19, 2026

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

05977923

[Models] LFM2: Support LoRA (#34921) · ea37530b

tianshu-Michael-yu authored Feb 19, 2026


Co-authored-by: Piotr Mazurek <piotr635@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

ea37530b

[Model Bash]: Improve FP8 Oracle for Config Specific Kernel Selection (#34260) · 81bfc21a

Elizabeth Thomas authored Feb 19, 2026

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2-redhat@h100-02.nemg-001.lab.rdu2.dc.redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2-redhat@h100-02.nemg-001.lab.rdu2.dc.redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

81bfc21a

[Quark] Fix MoE fp8 activation scale handling on mi300 (#34386) · d9e62c03
Bowen Bao authored Feb 19, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
d9e62c03

19 Feb, 2026 9 commits
- [UX] More descriptive reasons in is_supported_config for MoE (#34908) · f72061a1
  Michael Goin authored Feb 19, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f72061a1
- [Bugfix] Fix Basic Models Test (#34818) · 662205d3
  Matthew Bonanni authored Feb 19, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  662205d3
- [Bugfix] Fix cutlass fp8 kernel on hopper for Qwen3.5 (#34914) · 4fb8beef
  Roger Wang authored Feb 19, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  4fb8beef
- [Refactor] Deprecate `head_first` for `chunk_gated_delta_rule` (#34263) · c683d11c
  Wentao Ye authored Feb 19, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c683d11c
- Revert "[NemotronH] Do not force router to run in fp32 (#34582)" (#34808) · 3eff45d7
  roikoren755 authored Feb 19, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3eff45d7
- [Model Bash][DeepSeekR1] Remove Shared Expert Clone (#34344) · 4685a630
  Robert Shaw authored Feb 19, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  4685a630
- [Llama4,Quantization] Simplify and generalize logic for Q/K permutations in... · ee1d25f1
  Eldar Kurtić authored Feb 19, 2026
```
[Llama4,Quantization] Simplify and generalize logic for Q/K permutations in quantized self-attn layers  (#34471)
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  ee1d25f1
- [Bugfix] Qwen3.5 kv-scale weight remapping (#34719) · 6fff24f3
  Linda authored Feb 19, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
```
  6fff24f3
- [Voxtral Realtime] Fix engine crash on empty multimodal embeddings (#34862) · f75b61a9
  Tal Nir authored Feb 19, 2026
```
Signed-off-by: Tal Nir <tal@nervexneurotech.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  f75b61a9