Commits · a6c137521cf7218cc2da5f56aa3e68ad96aa76b1 · OpenDAS / vllm_cscc

25 Feb, 2026 12 commits
- [Misc] Add shard_id validation for MergedColumnLinear (#35055) · a6c13752
  Isotr0py authored Feb 25, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a6c13752
- [Misc] Enable weights loading tracking for quantized models (#35074) · 4572a06a
  Isotr0py authored Feb 25, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4572a06a
- [compile] Improve error message during artifacts load failure. (#35115) · 5cc29cfb
  Zhengxu Chen authored Feb 25, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  5cc29cfb
- [Linear Attention] fix bug for linear attention + prefix caching + reset_prefix_cache (#35157) · 8fae54fa
  Chen Zhang authored Feb 24, 2026
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8fae54fa
- Remove requirement to use `--hf-overrides` for `DeepseekVLV2ForCausalLM` (#35203) · f7967577
  Harry Mellor authored Feb 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f7967577
- [Bugfix] Fix AttributeError when passing StructuredOutputsParams to CompletionRequest (#35237) · af770b8e
  pks authored Feb 25, 2026
```
Signed-off-by: Patrick Simianer <patrick@lilt.com>
```
  af770b8e
- [Responses][CI] Filter negative token IDs in schema fuzz test to avoid 500 errors (#35231) · 2ff3e436
  Andreas Karatzas authored Feb 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2ff3e436
- [FIX] fused moe with lora shared expert dual stream (1.07x otps) (#34933) · c2c4c461
  Jhao-Ting Chen authored Feb 24, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c2c4c461
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
- [Responses] Decouple SSE event helpers from Harmony context (#35148) · ec1d30c0
  Flora Feng authored Feb 24, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  ec1d30c0
- [Frontend] Use init_app_state and FrontendArgs in run_batch (#32967) · e3b2324e
  Pooya Davoodi authored Feb 24, 2026
```
Signed-off-by: Pooya Davoodi <pooya.davoodi@parasail.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e3b2324e
- [Core] Cleanup engine pause/sleep logic (#34528) · dbf0da81
  Nick Hill authored Feb 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  dbf0da81
24 Feb, 2026 25 commits

Adding Nemotron fp8 Triton MoE Config (#34674) · 576fe503

yugong333 authored Feb 24, 2026


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

576fe503

[Bug][DSV3.2] Always prepare metadata for DeepGEMM Sparse Attention (#35075) · 9fa5b25a
Benjamin Chislett authored Feb 24, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
9fa5b25a

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87

[Perf] Optimize Python Slice for Structured Output using `islice` instead of [:] (#33593) · 9ce8fad2

Wentao Ye authored Feb 24, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9ce8fad2

Remove `padding_index` from models that don't use it for better Transformers... · c38b8d5a

Harry Mellor authored Feb 24, 2026


Remove `padding_index` from models that don't use it for better Transformers v5 compatibility (#35189)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

c38b8d5a

Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) · 9609b1f1
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
9609b1f1
Fix fallback to default tactic (flashinfer autotuner) with trtllm_fp4_block_scale_moe (#35088) · a0c70816
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
a0c70816
[CPU][Perf] Accelerate Attention head for s390x using vector intrinsics (#34434) · 34ce0ffd
R3hankhan authored Feb 24, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
34ce0ffd

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[Frontend] Always pass `supported_tasks` to validation (#35186) · 761e63e5
Cyrus Leung authored Feb 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
761e63e5
[Bugfix] Fix failing FunASR processor test (#35111) · d12d2014
Isotr0py authored Feb 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d12d2014
[Perf] Optimize pooling model redundant copy, 1.8% throughput improvement (#35127) · 14561fab
Wentao Ye authored Feb 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
14561fab
[compile] Save aot compile artifacts atomically. (#35117) · c77f3e12
Zhengxu Chen authored Feb 24, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
c77f3e12
[Feature] Add LoRA tower/connector support for Llama 4 Vision (mllama4) (#35147) · 012dee92
Dor Huri authored Feb 24, 2026
```
Signed-off-by: dorhuri123 <dor.huri1@live.biu.ac.il>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
012dee92

Make voxtral compile friendly (#33959) · f1c66454

Tugsbayasgalan Manlaibaatar authored Feb 24, 2026


Signed-off-by: Tugsbayasgalan Manlaibaatar <tmanlaibaatar@fb.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

f1c66454

[LoRA] Update LoRA expand kernel block_n calculation (#32621) · c870eb9e
Xin Yang authored Feb 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
c870eb9e

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[MM] Allow audio chunking for offline LLM (#34628) · f91808ae
Nicolò Lucchesi authored Feb 24, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
f91808ae
[BUGFIX][Qwen3.5] Hardcode `mlp.gate` as not quantizable (#35156) · 33a0d43c
Vadim Gimpelson authored Feb 24, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
33a0d43c
gpu_model_runner: Cache is_encoder_decoder from model config (#35099) · 80d93fd6
pschlan-amd authored Feb 24, 2026
```
Signed-off-by: Patrick Schlangen <pschlan@amd.com>
```
80d93fd6

[Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) · ec853405

Jia Guo authored Feb 23, 2026


Signed-off-by: jasperjiaguo <jasperg662@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ec853405

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

[Mamba1] - Change supports_update_block_table to True (#35054) · 95642441
Asaf Gardin authored Feb 24, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
95642441

[Perf] Enable FlashInfer DeepGEMM swapAB on SM90 by default (#34924) · a4bd661f

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a4bd661f

[Perf] Improve default triton fused moe configs (#34846) · 22a97e66

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

22a97e66

23 Feb, 2026 3 commits
- Enforce that `model` is the first positional arg when `--served-model-name` is used (#34973) · 28c5e69b
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28c5e69b
- Fix custom processors that use deleted import for Transformers v5 (#35101) · 864167d3
  Harry Mellor authored Feb 23, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  864167d3
- [Bugfix] Fix prefix caching for Mamba 'all' mode (Nemotron models) (#34874) · a2ba6a52
  haosdent authored Feb 24, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  a2ba6a52