Commits · fd68cd132bbd8844d733ef9069e0d3b28f11c20e · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "d3317bbba44ec11bbef435308f98284487fce45a"

28 Feb, 2026 1 commit

[ROCm][Quantization] Add Composable Kernel (CK) backend support for M… (#34301) · d5b6f3ba

Douglas Lehr authored Feb 27, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>

d5b6f3ba

27 Feb, 2026 13 commits

[Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
1f3dbd95

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

[BugFix] Fix 3D rope in transformers backend (#35097) · fd6de37f

Raushan Turganbay authored Feb 27, 2026


Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100) · c8aca0c9

Netanel Haber authored Feb 27, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

c8aca0c9

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

[Bugfix] Fix check_interleaved_audio_video false positive for batched... · e8249378

Yueqian Lin authored Feb 27, 2026


[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8249378

[Bugfix] Add missing activation attr to RMSNormGated (#35423) · 6467b635
Tib authored Feb 27, 2026
```
Signed-off-by: tibG <naps@qubes.milou>
Co-authored-by: tibG <naps@qubes.milou>
```
6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) · a572baff
Chengyi Nie authored Feb 26, 2026
```
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
```
a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369) · 516cf266

zofia authored Feb 27, 2026


Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

516cf266

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896
[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) · 1e5ad9b7
Jee Jee Li authored Feb 27, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1e5ad9b7
[Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
38c498b8

26 Feb, 2026 17 commits
- [Bugfix] Fix KV Scale loading for MLA Models (#35430) · 62830211
  Pavani Majety authored Feb 26, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  62830211
- [ROCm][Quantization] GPT OSS Upstream MoE wmxfp4_afp8 with static scales (#30357) · 01923eec
  Aleksandr Malyshev authored Feb 26, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  01923eec
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- add mixed precision support for modelopt (#35047) · d0105b84
  sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  d0105b84
- Nemotron: use per-layer config in NemotronHMLPDecoderLayer for heterogeneous models (#35396) · 832a780f
  danielafrimi authored Feb 26, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  832a780f
- [ROCm] Add dynamic mxfp4 quantization for DeepSeek V2 projection layers (#34157) · ec8ab9d2
  Douglas Lehr authored Feb 26, 2026
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  ec8ab9d2
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
- [Misc] Standardize handling of `mm_processor_kwargs.size` (#35284) · 845ee348
  Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  845ee348
- [Bugfix] fix device_name for routing replay (#34336) · c6ca5159
  Li-Yongwen authored Feb 26, 2026
```
Signed-off-by: liyongwen <1310439159@qq.com>
```
  c6ca5159
- [Bugfix] Fix Qwen2.5-Omni and Qwen3-Omni mixed-modality embed regression (#35368) · c0615a29
  Yueqian Lin authored Feb 26, 2026
```
Signed-off-by: linyueqian <linyueqian@outlook.com>
```
  c0615a29
- [Bugfix] [Qwen3.5]Fix Qwen3.5 FP8 quantization: tuple shard_id weight loading (#35289) · 32693db8
  HZY authored Feb 26, 2026
```
Signed-off-by: daowu.hzy <daowu.hzy@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32693db8
- [Model] Ring 2.5 (#35102) · ab87f852
  Jiangyun Zhu authored Feb 26, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ab87f852
- [CPU][Feat] Enable KleidiAI INT8_W4A8 for all input dtypes (#34890) · 4171ff6d
  Fadi Arafeh authored Feb 26, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4171ff6d
- [UX] Add `--moe-backend` arg for explicit kernel selection (#33807) · de527e1c
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  de527e1c
- [MoE Refactor] MXFP4 Cutlass Experts to MK (#34542) · 1976356e
  Yongye Zhu authored Feb 25, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  1976356e
- [offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c
  Ming Yang authored Feb 25, 2026
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6831650c
25 Feb, 2026 7 commits
- fix(mxfp4): Disable monolithic path for TRITON backend with EP (#34270) · c97234c0
  Elizabeth Thomas authored Feb 25, 2026
```
Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c97234c0
- Revert "[Misc] Enable weights loading tracking for quantized models" (#35309) · 15d76f74
  Lucas Wilkinson authored Feb 25, 2026
  
  15d76f74
- [Perf] Add opt-in SM100 Oink RMSNorm custom-op path (#31828) · 24650715
  Laura Wang authored Feb 24, 2026
```
Signed-off-by: Laura Wang <3700467+Laurawly@users.noreply.github.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  24650715
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
- [Misc] Add shard_id validation for MergedColumnLinear (#35055) · a6c13752
  Isotr0py authored Feb 25, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a6c13752
- [Misc] Enable weights loading tracking for quantized models (#35074) · 4572a06a
  Isotr0py authored Feb 25, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4572a06a
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 2 commits

Adding Nemotron fp8 Triton MoE Config (#34674) · 576fe503

yugong333 authored Feb 24, 2026


Signed-off-by: Yu Gong <yu3.gong@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

576fe503

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87