Commits · a60985b07eaf0fefa4c353ad2309b745707591ed · OpenDAS / vllm_cscc

"deploy/operator/internal/modelendpoint/client_test.go" did not exist on "b592269304c49ced5e138dfb43602c06a11ec4f8"

01 Mar, 2026 7 commits
- [Attention] FA4 integration (#32974) · 8b5014d3
  Lucas Wilkinson authored Mar 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b5014d3
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- fix(mxfp4): return is_monolithic=False when LoRA is enabled for Triton backend (#35382) · 5a435507
  Seungho Yoon authored Mar 01, 2026
```
Signed-off-by: Seungho Yoon <yoonsnowdev@gmail.com>
```
  5a435507
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
- Fix typo: implictly -> implicitly in isaac.py docstring (#35646) · a9ec392c
  lin-shh authored Mar 01, 2026
  
  a9ec392c
- [Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs (#35617) · afd089f2
  lailoo authored Mar 01, 2026
  
  afd089f2
28 Feb, 2026 8 commits

[Chore] Cleanup BNB utilization dead code (#35620) · e94b263b
Isotr0py authored Mar 01, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
e94b263b

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

Fix Qwen3_5MTP packed_modules_mapping for gate_up_proj (#35581) · 63d7972f
cwazai authored Feb 28, 2026

63d7972f
[Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
7e08c22b
Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[MTP] Validate that MTP weights are actually loaded (#35548) · 2562e027
Matthew Bonanni authored Feb 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2562e027

[ROCm][Quantization] Add Composable Kernel (CK) backend support for M… (#34301) · d5b6f3ba

Douglas Lehr authored Feb 27, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>

d5b6f3ba

27 Feb, 2026 13 commits

[Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
1f3dbd95

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

[BugFix] Fix 3D rope in transformers backend (#35097) · fd6de37f

Raushan Turganbay authored Feb 27, 2026


Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100) · c8aca0c9

Netanel Haber authored Feb 27, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

c8aca0c9

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

[Bugfix] Fix check_interleaved_audio_video false positive for batched... · e8249378

Yueqian Lin authored Feb 27, 2026


[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8249378

[Bugfix] Add missing activation attr to RMSNormGated (#35423) · 6467b635
Tib authored Feb 27, 2026
```
Signed-off-by: tibG <naps@qubes.milou>
Co-authored-by: tibG <naps@qubes.milou>
```
6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) · a572baff
Chengyi Nie authored Feb 26, 2026
```
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
```
a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369) · 516cf266

zofia authored Feb 27, 2026


Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

516cf266

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896
[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) · 1e5ad9b7
Jee Jee Li authored Feb 27, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1e5ad9b7
[Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
38c498b8

26 Feb, 2026 12 commits
- [Bugfix] Fix KV Scale loading for MLA Models (#35430) · 62830211
  Pavani Majety authored Feb 26, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  62830211
- [ROCm][Quantization] GPT OSS Upstream MoE wmxfp4_afp8 with static scales (#30357) · 01923eec
  Aleksandr Malyshev authored Feb 26, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  01923eec
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- add mixed precision support for modelopt (#35047) · d0105b84
  sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  d0105b84
- Nemotron: use per-layer config in NemotronHMLPDecoderLayer for heterogeneous models (#35396) · 832a780f
  danielafrimi authored Feb 26, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  832a780f
- [ROCm] Add dynamic mxfp4 quantization for DeepSeek V2 projection layers (#34157) · ec8ab9d2
  Douglas Lehr authored Feb 26, 2026
```
Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
```
  ec8ab9d2
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
- [Misc] Standardize handling of `mm_processor_kwargs.size` (#35284) · 845ee348
  Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  845ee348
- [Bugfix] fix device_name for routing replay (#34336) · c6ca5159
  Li-Yongwen authored Feb 26, 2026
```
Signed-off-by: liyongwen <1310439159@qq.com>
```
  c6ca5159
- [Bugfix] Fix Qwen2.5-Omni and Qwen3-Omni mixed-modality embed regression (#35368) · c0615a29
  Yueqian Lin authored Feb 26, 2026
```
Signed-off-by: linyueqian <linyueqian@outlook.com>
```
  c0615a29
- [Bugfix] [Qwen3.5]Fix Qwen3.5 FP8 quantization: tuple shard_id weight loading (#35289) · 32693db8
  HZY authored Feb 26, 2026
```
Signed-off-by: daowu.hzy <daowu.hzy@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32693db8