Commits · 3b1dbaad4e59742ab5a5e4fd8f4ccc4f0e83c996 · OpenDAS / vllm_cscc

30 Mar, 2026 1 commit

[HMA]Fix corner case when hybrid page_size can not be evenly divided issue... · 3b1dbaad

Chendi.Xue authored Mar 30, 2026


[HMA]Fix corner case when hybrid page_size can not be evenly divided issue (blk_size=64,tp=4) (#37467)
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

3b1dbaad

20 Mar, 2026 1 commit
- [Bugfix] Disable --calculate-kv-scales for hybrid GDN/Mamba+Attention… (#37565) · d7d2b5e4
  Le Yang authored Mar 21, 2026
```
Signed-off-by: Young-Leo <562593859@qq.com>
```
  d7d2b5e4
17 Mar, 2026 1 commit

[Model] Add ColQwen3.5 4.5B support (#36887) · c0745a85

Athrael Soju authored Mar 17, 2026


Signed-off-by: Athrael Soju <athrael.soju@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

c0745a85

16 Mar, 2026 1 commit
- [FlashInfer] Revert block_size 16 + head_size 256 workaround on Blackwell (#36987) · 8374387b
  Vadim Gimpelson authored Mar 16, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  8374387b
09 Mar, 2026 1 commit
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 1 commit
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
05 Mar, 2026 1 commit

Order `config.py` in Lexicographical order (#35866) · 0a12cea2

Andrii Skliar authored Mar 05, 2026


Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Co-authored-by: Andrii Skliar <askliar@nvidia.com>

0a12cea2

04 Mar, 2026 1 commit

Support Audio Extraction from MP4 Video for Nemotron Nano VL (#35539) · 5d199ac8

Andrii Skliar authored Mar 04, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Signed-off-by: Andrii Skliar <askliar@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
Signed-off-by: Andrii <askliar@nvidia.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Andrii Skliar <askliar@oci-nrt-cs-001-vscode-01.cm.cluster>
Co-authored-by: Andrii <askliar@nvidia.com>
Co-authored-by: root <root@pool0-03748.cm.cluster>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: root <root@pool0-02416.cm.cluster>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: wangxiyuan <wangxiyuan1007@gmail.com>
Co-authored-by: root <root@pool0-04880.cm.cluster>

5d199ac8

03 Mar, 2026 1 commit
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
02 Mar, 2026 1 commit
- [BugFix][Model]Fix the garbled code in Ernie4.5-VL caused by fast_moe_cold_start (#35587) · 2a9e3347
  CSWYF3634076 authored Mar 03, 2026
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  2a9e3347
27 Feb, 2026 1 commit
- [Bug] Fix outdated links in source code (#35314) · 062b7896
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  062b7896
26 Feb, 2026 1 commit
- [Model] Add nvidia/llama-nemotron-embed-vl-1b-v2 multimodal embedding model (#35297) · 111d8690
  Jakub Zakrzewski authored Feb 26, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  111d8690
20 Feb, 2026 1 commit
- Bump Flashinfer Version and Re-enable DeepSeek NVFP4 AR+Norm Fusion (#34899) · ea5f903f
  Wei Zhao authored Feb 20, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ea5f903f
15 Feb, 2026 1 commit

[torch.compile] Disable ar-rms fusion for ds3-fp4 & DP, fix CI test (#34392) · 23d825ab

Luka Govedič authored Feb 15, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

23d825ab

13 Feb, 2026 3 commits
- [Hybrid] Enable spec decoding in mamba cache align mode (#33705) · c027541e
  Harry Huang authored Feb 14, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  c027541e
- Extend ColBERT support to non-standard BERT backbones (#34170) · 071d863e
  Ilya Boytsov authored Feb 13, 2026
```
Signed-off-by: Ilya Boytsov <ilya.boytsov@aleph-alpha.com>
```
  071d863e
- [Bugfix] Fix mamba state dtype setting for Qwen3-Next and Qwen3.5 (#34489) · eea3024f
  Roger Wang authored Feb 12, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  eea3024f
06 Feb, 2026 1 commit

Onboard voyage-4-nano (#33720) · 96552566

chengchengpei authored Feb 05, 2026

Signed-off-by: Chengcheng Pei <chengchengpei@outlook.com>
Signed-off-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: chengchengpei <5881383+chengchengpei@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

96552566

31 Jan, 2026 1 commit
- [Deprecation] Remove deprecated items related to pooling (#33477) · 92924b2d
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  92924b2d
27 Jan, 2026 1 commit

Support heterogeneous NemotronHPuzzle model (#32549) · 83fb2d09

danielafrimi authored Jan 27, 2026



Signed-off-by: <dafrimi@nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: root <dafrimi@nvidia.com>

83fb2d09

23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

10 Jan, 2026 2 commits
- [Bugfix] Fix Qwen3-VL-Reranker model loading for sequence classification (#32089) · 8020a604
  RickyChen / 陳昭儒 authored Jan 11, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8020a604
- [Refactor] Separate sequence and token pooling types (#32026) · 583a90e0
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  583a90e0
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
08 Jan, 2026 1 commit
- [Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
  Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  eac3b96e
05 Jan, 2026 2 commits
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
- [CI Failure] Fix NomicBert max_model_len validation (#31662) · 8be6432b
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8be6432b
24 Dec, 2025 1 commit
- [Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131) · bd89ce16
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd89ce16
23 Dec, 2025 1 commit

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 1 commit
- [Misc] Fix spelling typos in model comments (#31117) · 14c3e6ad
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  14c3e6ad
17 Dec, 2025 1 commit
- [Mamba] Removed disable cascade attn in MambaModelConfig (#30712) · a9e15c21
  Asaf Joseph Gardin authored Dec 17, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  a9e15c21
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

11 Dec, 2025 2 commits
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
05 Dec, 2025 2 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override... · 6038b1b0

amitz-nv authored Dec 05, 2025


[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>

6038b1b0

04 Dec, 2025 1 commit
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
25 Nov, 2025 1 commit
- [Hybrid Allocator] Support KV cache groups with different block_size (#29143) · 48ddb02b
  Yifan Qiao authored Nov 25, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  48ddb02b
19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
08 Nov, 2025 1 commit
- [Performance][gpt-oss] Revert gpt-oss max cudagraph size to 1024 (#28345) · 404d7a9d
  Mohammad Miadh Angkad authored Nov 09, 2025
```
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
```
  404d7a9d