Commits · dbf0da817adf06edf9906d666de7be788dfb66d6 · OpenDAS / vllm_cscc

25 Feb, 2026 1 commit
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
24 Feb, 2026 25 commits

Adding Nemotron fp8 Triton MoE Config (#34674) · 576fe503

yugong333 authored Feb 24, 2026


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

576fe503

[Bug][DSV3.2] Always prepare metadata for DeepGEMM Sparse Attention (#35075) · 9fa5b25a
Benjamin Chislett authored Feb 24, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
9fa5b25a

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87

[Perf] Optimize Python Slice for Structured Output using `islice` instead of [:] (#33593) · 9ce8fad2

Wentao Ye authored Feb 24, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9ce8fad2

Remove `padding_index` from models that don't use it for better Transformers... · c38b8d5a

Harry Mellor authored Feb 24, 2026


Remove `padding_index` from models that don't use it for better Transformers v5 compatibility (#35189)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

c38b8d5a

Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) · 9609b1f1
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
9609b1f1
Fix fallback to default tactic (flashinfer autotuner) with trtllm_fp4_block_scale_moe (#35088) · a0c70816
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
a0c70816
[CPU][Perf] Accelerate Attention head for s390x using vector intrinsics (#34434) · 34ce0ffd
R3hankhan authored Feb 24, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
34ce0ffd

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[Frontend] Always pass `supported_tasks` to validation (#35186) · 761e63e5
Cyrus Leung authored Feb 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
761e63e5
[Bugfix] Fix failing FunASR processor test (#35111) · d12d2014
Isotr0py authored Feb 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d12d2014
[Perf] Optimize pooling model redundant copy, 1.8% throughput improvement (#35127) · 14561fab
Wentao Ye authored Feb 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
14561fab
[compile] Save aot compile artifacts atomically. (#35117) · c77f3e12
Zhengxu Chen authored Feb 24, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
c77f3e12
[Feature] Add LoRA tower/connector support for Llama 4 Vision (mllama4) (#35147) · 012dee92
Dor Huri authored Feb 24, 2026
```
Signed-off-by: dorhuri123 <dor.huri1@live.biu.ac.il>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
012dee92

Make voxtral compile friendly (#33959) · f1c66454

Tugsbayasgalan Manlaibaatar authored Feb 24, 2026


Signed-off-by: Tugsbayasgalan Manlaibaatar <tmanlaibaatar@fb.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

f1c66454

[LoRA] Update LoRA expand kernel block_n calculation (#32621) · c870eb9e
Xin Yang authored Feb 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
c870eb9e

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[MM] Allow audio chunking for offline LLM (#34628) · f91808ae
Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
f91808ae
[BUGFIX][Qwen3.5] Hardcode `mlp.gate` as not quantizable (#35156) · 33a0d43c
Vadim Gimpelson authored Feb 24, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
33a0d43c
gpu_model_runner: Cache is_encoder_decoder from model config (#35099) · 80d93fd6
pschlan-amd authored Feb 24, 2026
```
Signed-off-by: Patrick Schlangen <pschlan@amd.com>
```
80d93fd6

[Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) · ec853405

Jia Guo authored Feb 23, 2026


Signed-off-by: jasperjiaguo <jasperg662@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ec853405

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

[Mamba1] - Change supports_update_block_table to True (#35054) · 95642441
Asaf Gardin authored Feb 24, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
95642441

[Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a4bd661f

[Perf] Improve default triton fused moe configs (#34846) · 22a97e66

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

22a97e66

23 Feb, 2026 14 commits
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- Fix custom processors that use deleted import for Transformers v5 (#35101) · 864167d3
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  864167d3
- [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) · a2ba6a52
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a2ba6a52
- Use Xet high performance mode for Transformers v5 (#35098) · c4f38696
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c4f38696
- [Bugfix] Fix MRotaryEmbedding missing `truncate` attr with YaRN scaling (#35080) · a7f341c3
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a7f341c3
- [Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950) · 5cc7c445
  Mark McLoughlin authored Feb 23, 2026
```
Export the existing Model FLOPs Utilization (MFU) metrics via Prometheus.

`--enable-mfu-metrics` is required for these to be exposed.
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  5cc7c445
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Llama4,CI] Bring back Llama-4 bug fixes, and also fix Maverick tests (#35033) · 1e8438a8
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Eldar Kurtic <you@example.com>
Co-authored-by: Eldar Kurtic <you@example.com>
```
  1e8438a8
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
- [XPU] allow TORCH_SDPA/TRITON_ATTN as XPU vit Backend (#35010) · b1b5e045
  Yan Ma authored Feb 23, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  b1b5e045
- [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) · aa08a30f
  Vincent Gimenes authored Feb 23, 2026
```
Signed-off-by: Vincent Gimenes <vincent.gimenes@gmail.com>
```
  aa08a30f
- [Refactor] Remove dead private func `_fp8_perm` and `_extract_mask_for_item` (#35068) · 7f40e9e5
  Wentao Ye authored Feb 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7f40e9e5
- Fix pipeline parallel with embed scaling in the Transformers modelling backend (#35094) · 103e614b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  103e614b