Commits · e94b263bd6557dc54582bfc5ba74f0a631bd642d · OpenDAS / vllm_cscc

28 Feb, 2026 8 commits

[Chore] Cleanup BNB utilization dead code (#35620) · e94b263b
Isotr0py authored Mar 01, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
e94b263b

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

Fix Qwen3_5MTP packed_modules_mapping for gate_up_proj (#35581) · 63d7972f
cwazai authored Feb 28, 2026

63d7972f
[Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
7e08c22b
Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[MTP] Validate that MTP weights are actually loaded (#35548) · 2562e027
Matthew Bonanni authored Feb 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2562e027

[ROCm][Quantization] Add Composable Kernel (CK) backend support for M… (#34301) · d5b6f3ba

Douglas Lehr authored Feb 27, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>

d5b6f3ba

27 Feb, 2026 13 commits

[Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
1f3dbd95

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

[BugFix] Fix 3D rope in transformers backend (#35097) · fd6de37f

Raushan Turganbay authored Feb 27, 2026


Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100) · c8aca0c9

Netanel Haber authored Feb 27, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

c8aca0c9

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

[Bugfix] Fix check_interleaved_audio_video false positive for batched... · e8249378

Yueqian Lin authored Feb 27, 2026


[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8249378

[Bugfix] Add missing activation attr to RMSNormGated (#35423) · 6467b635
Tib authored Feb 27, 2026
```
Signed-off-by: tibG <naps@qubes.milou>
Co-authored-by: tibG <naps@qubes.milou>
```
6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) · a572baff
Chengyi Nie authored Feb 26, 2026
```
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
```
a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369) · 516cf266

zofia authored Feb 27, 2026


Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

516cf266

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896
[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) · 1e5ad9b7
Jee Jee Li authored Feb 27, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1e5ad9b7
[Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
38c498b8

26 Feb, 2026 17 commits
- [Bugfix] Fix KV Scale loading for MLA Models (#35430) · 62830211
  Pavani Majety authored Feb 26, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  62830211
- [ROCm][Quantization] GPT OSS Upstream MoE wmxfp4_afp8 with static scales (#30357) · 01923eec
  Aleksandr Malyshev authored Feb 26, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  01923eec
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- add mixed precision support for modelopt (#35047) · d0105b84
  sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  d0105b84
- Nemotron: use per-layer config in NemotronHMLPDecoderLayer for heterogeneous models (#35396) · 832a780f
  danielafrimi authored Feb 26, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  832a780f
- [ROCm] Add dynamic mxfp4 quantization for DeepSeek V2 projection layers (#34157) · ec8ab9d2
  Douglas Lehr authored Feb 26, 2026
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  ec8ab9d2
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
- [Misc] Standardize handling of `mm_processor_kwargs.size` (#35284) · 845ee348
  Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  845ee348
- [Bugfix] fix device_name for routing replay (#34336) · c6ca5159
  Li-Yongwen authored Feb 26, 2026
```
Signed-off-by: liyongwen <1310439159@qq.com>
```
  c6ca5159
- [Bugfix] Fix Qwen2.5-Omni and Qwen3-Omni mixed-modality embed regression (#35368) · c0615a29
  Yueqian Lin authored Feb 26, 2026
```
Signed-off-by: linyueqian <linyueqian@outlook.com>
```
  c0615a29
- [Bugfix] [Qwen3.5]Fix Qwen3.5 FP8 quantization: tuple shard_id weight loading (#35289) · 32693db8
  HZY authored Feb 26, 2026
```
Signed-off-by: daowu.hzy <daowu.hzy@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32693db8
- [Model] Ring 2.5 (#35102) · ab87f852
  Jiangyun Zhu authored Feb 26, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ab87f852
- [CPU][Feat] Enable KleidiAI INT8_W4A8 for all input dtypes (#34890) · 4171ff6d
  Fadi Arafeh authored Feb 26, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  4171ff6d
- [UX] Add `--moe-backend` arg for explicit kernel selection (#33807) · de527e1c
  Michael Goin authored Feb 25, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  de527e1c
- [MoE Refactor] MXFP4 Cutlass Experts to MK (#34542) · 1976356e
  Yongye Zhu authored Feb 25, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  1976356e
- [offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c
  Ming Yang authored Feb 25, 2026
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6831650c
25 Feb, 2026 2 commits
- fix(mxfp4): Disable monolithic path for TRITON backend with EP (#34270) · c97234c0
  Elizabeth Thomas authored Feb 25, 2026
```
Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c97234c0
- Revert "[Misc] Enable weights loading tracking for quantized models" (#35309) · 15d76f74
  Lucas Wilkinson authored Feb 25, 2026
  
  15d76f74