Commits · 719634815791ad97cf1e35ad52d4e39e630aeafd · OpenDAS / vllm_cscc

"examples/backends/sglang/deploy/agg_router.yaml" did not exist on "13560ab2fd6a7e4943a823ea100acdcbd4e14ec0"

05 Mar, 2026 5 commits

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
71963481
Fix import that was moved in Transformers 5.2.0 (#36120) · ecde7af9
Harry Mellor authored Mar 05, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
ecde7af9

[Bugfix] Fix score layer quantization for sequence classification models -... · f600d519

Hanjun Cho authored Mar 05, 2026


[Bugfix] Fix score layer quantization for sequence classification models  - Qwen3 (VL) Reranker (#35849)
Signed-off-by: Hanjun Cho <gkswns0531@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

f600d519

Order `config.py` in Lexicographical order (#35866) · 0a12cea2

Andrii Skliar authored Mar 05, 2026


Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>

0a12cea2

[Model] Add LoRA support for Whisper models (#29856) · 3b23d57c

daje0601 authored Mar 05, 2026


Signed-off-by: daje0601 <englishmt4118@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

3b23d57c

04 Mar, 2026 11 commits

fix minicpmo4.5: fix attn_mask in vit attn && fix resampler pos_emb i… (#34127) · bfdb512f
tc-mb authored Mar 05, 2026
```
Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: hezhihui <hezhihui@modelbest.cn>
```
bfdb512f
Fix phi4-mm and remove cuda binding (#35964) · 58cfe0dc
Yan Ma authored Mar 05, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
58cfe0dc
Use MMEncoderAttention (=use FlashAttention) instead of torch.sdpa in radio.py (#35653) · 289fc48a
Netanel Haber authored Mar 04, 2026

289fc48a
[Bugfix][Model] Fix FP8 k_scale/v_scale not loaded for Qwen3-MoE (#35656) · c8c3935b
Raghavan authored Mar 04, 2026
```
Signed-off-by: raghavan <oneraghavan@gmail.com>
```
c8c3935b

[Bugfix] Add missing dynamic_arg_dims for Qwen3-ASR torch.compile (#35869) · 36bf2131

Nathan Price authored Mar 04, 2026


Signed-off-by: Nathan Price <nathan@abridge.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

36bf2131

Support Audio Extraction from MP4 Video for Nemotron Nano VL (#35539) · 5d199ac8

Andrii Skliar authored Mar 04, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Andrii <askliar@nvidia.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Andrii Skliar <askliar@oci-nrt-cs-001-vscode-01.cm.cluster>
Co-authored-by: Andrii <askliar@nvidia.com>
Co-authored-by: root <root@pool0-03748.cm.cluster>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: root <root@pool0-02416.cm.cluster>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: root <root@pool0-04880.cm.cluster>

5d199ac8

[Bugfix] Guard mm_token_type_ids kwarg in get_mrope_input_positions (#35711) · edba1504
Andreas Karatzas authored Mar 03, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
edba1504
[Chore] Remove debug code in model implementation (#35883) · 6e9f21e8
Isotr0py authored Mar 04, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
6e9f21e8

[model] support FireRedASR2 (#35727) · c1d96340

AllenDou authored Mar 04, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753) · 77e6dcbb
Shanshan Shen authored Mar 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
77e6dcbb
[Bugfix] Fix EVS implementation for Qwen3 VL (#33607) · 70c73df6
William Zhang authored Mar 03, 2026
```
Signed-off-by: 2ez4bz <133824995+2ez4bz@users.noreply.github.com>
```
70c73df6

03 Mar, 2026 2 commits
- [V0 deprecation] Remove Swin model (#35821) · 8ea8ba27
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ea8ba27
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
02 Mar, 2026 4 commits
- [MoE][Perf] Wrap DSV3 QKVAProj GEMM in custom op for torch.compile (#35751) · 9319044e
  Robert Shaw authored Mar 02, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9319044e
- [Bugfix] Fix missing sequence_lengths in qwen3_omni_moe_thinker (#35741) · fa6a6be5
  Ye (Charlotte) Qi authored Mar 02, 2026
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  fa6a6be5
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
- [BugFix][Model]Fix the garbled code in Ernie4.5-VL caused by fast_moe_cold_start (#35587) · 2a9e3347
  CSWYF3634076 authored Mar 03, 2026
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  2a9e3347
01 Mar, 2026 2 commits
- Fix typo: implictly -> implicitly in isaac.py docstring (#35646) · a9ec392c
  lin-shh authored Mar 01, 2026
  
  a9ec392c
- [Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs (#35617) · afd089f2
  lailoo authored Mar 01, 2026
  
  afd089f2
28 Feb, 2026 3 commits
- [Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301
  Wentao Ye authored Feb 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e113a301
- Fix Qwen3_5MTP packed_modules_mapping for gate_up_proj (#35581) · 63d7972f
  cwazai authored Feb 28, 2026
  
  63d7972f
- [MTP] Validate that MTP weights are actually loaded (#35548) · 2562e027
  Matthew Bonanni authored Feb 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2562e027
27 Feb, 2026 10 commits

[Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
1f3dbd95

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

[BugFix] Fix 3D rope in transformers backend (#35097) · fd6de37f

Raushan Turganbay authored Feb 27, 2026


Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100) · c8aca0c9

Netanel Haber authored Feb 27, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

c8aca0c9

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

[Bugfix] Fix check_interleaved_audio_video false positive for batched... · e8249378

Yueqian Lin authored Feb 27, 2026


[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8249378

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896
[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) · 1e5ad9b7
Jee Jee Li authored Feb 27, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1e5ad9b7
[Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
38c498b8

26 Feb, 2026 3 commits
- Nemotron: use per-layer config in NemotronHMLPDecoderLayer for heterogeneous models (#35396) · 832a780f
  danielafrimi authored Feb 26, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  832a780f
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690