Commits · 5206e5e28c25dcc43d3a2373b591a0cdf9792f5d · OpenDAS / vllm_cscc

23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

19 Jan, 2026 1 commit
- Add support for LoRA adapters in Nemotron-H models (#30802) · aa7f37cc
  danisereb authored Jan 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  aa7f37cc
07 Jan, 2026 2 commits
- Enable quantized attention in NemotronH models (#31898) · bf184a66
  roikoren755 authored Jan 07, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  bf184a66
- [BugFix] LoRA: Support loading base_layer of experts (#31104) · 48291484
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Jan 07, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  48291484
06 Jan, 2026 1 commit
- [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#31807) · 28c94770
  roikoren755 authored Jan 06, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  28c94770
31 Dec, 2025 1 commit
- Add get_expert_mapping to NemotronHModel (for LoRA support) (#31539) · 108a2728
  danisereb authored Dec 31, 2025
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  108a2728
08 Dec, 2025 1 commit

Add latent MoE support (#30203) · fcd5306f

shaharmor98 authored Dec 08, 2025


Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

fcd5306f

29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

19 Nov, 2025 1 commit

[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear... · 1395461f

tomeras91 authored Nov 19, 2025


[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>

1395461f

13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
11 Nov, 2025 1 commit
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

04 Nov, 2025 1 commit
- [Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968) · 77f8001f
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  77f8001f
27 Oct, 2025 1 commit
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
23 Oct, 2025 1 commit
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

23 Sep, 2025 1 commit
- [V1] Remove V0 code paths for Hybrid models (#25400) · a903669e
  Thomas Parnell authored Sep 23, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  a903669e
21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
17 Sep, 2025 1 commit
- [Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4a9375fe
10 Sep, 2025 1 commit

[Bugfix] fix modelopt exclude_modules name mapping (#24178) · 08abfa78

tomeras91 authored Sep 10, 2025


Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08abfa78

29 Aug, 2025 1 commit
- [Models] Improve iteration over layers (#19497) · de533ab2
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  de533ab2
15 Aug, 2025 1 commit

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

11 Aug, 2025 1 commit
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
07 Aug, 2025 1 commit
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
19 Jul, 2025 1 commit
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
15 Jul, 2025 1 commit
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
11 Jul, 2025 1 commit
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
04 Jul, 2025 1 commit

Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022

Thomas Parnell authored Jul 04, 2025


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

2f35a022

06 Jun, 2025 1 commit
- [Model] Optimize nemotron_h implementation (#19249) · 7661e92e
  Jee Jee Li authored Jun 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7661e92e
05 Jun, 2025 1 commit

[Model] NemotronH support (#18863) · cb6d572e

Luis Vega authored Jun 05, 2025


Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>

cb6d572e

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
07 May, 2025 1 commit

[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for... · 18dd5e01

Chih-Chieh Yang authored May 06, 2025


[Model] Mamba2 causal conv1d Refactor to Split Prefill and Decode Requests for Corresponding Kernels (#17146)
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>

18dd5e01

24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
10 Apr, 2025 1 commit

[Model] Reduce redundant computations in mamba2 blocks for Bamba-9B (#15423) · daefed05

Chih-Chieh Yang authored Apr 10, 2025


Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>

daefed05

02 Apr, 2025 1 commit
- [Model] use AutoWeightsLoader in model load_weights (#15770) · e86c414d
  rongfu.leng authored Apr 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  e86c414d
18 Mar, 2025 1 commit

[MODEL] Add support for Zamba2 models (#13185) · 452e8fd9

yury-tokpanov authored Mar 18, 2025


Signed-off-by: Yury Tokpanov <yury@zyphra.com>
Signed-off-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Quentin Anthony <qganthony@yahoo.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

452e8fd9