Commits · f5972a872fa3fabd94b7a6c6f031f4b5bcee2b2d · OpenDAS / vllm_cscc

24 Feb, 2026 1 commit

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87

19 Feb, 2026 1 commit
- Revert "[NemotronH] Do not force router to run in fp32 (#34582)" (#34808) · 3eff45d7
  roikoren755 authored Feb 19, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  3eff45d7
16 Feb, 2026 1 commit
- [NemotronH] Do not force router to run in fp32 (#34582) · 3b30e615
  roikoren755 authored Feb 16, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  3b30e615
12 Feb, 2026 1 commit
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
02 Feb, 2026 1 commit
- [MoE] Enable Shared/Routed Overlap For Latent MoE (Nemotron-H) (#32790) · 0aca8b8c
  danielafrimi authored Feb 02, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  0aca8b8c
29 Jan, 2026 1 commit
- Bugfix: Pass router logits dtype in nemotron shared experts (#32669) · e01ff5c0
  amirkl94 authored Jan 29, 2026
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
```
  e01ff5c0
27 Jan, 2026 3 commits
- Support heterogeneous NemotronHPuzzle model (#32549) · 83fb2d09
  danielafrimi authored Jan 27, 2026
```
Signed-off-by: <dafrimi@nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: root <dafrimi@nvidia.com>
```
  83fb2d09
- [LoRA][Spec Decode] Support LoRA for Nemotron-H MTP models (#32265) · f3a5ee70
  danisereb authored Jan 27, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  f3a5ee70
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
26 Jan, 2026 1 commit
- [Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcd80206
23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

19 Jan, 2026 1 commit
- Add support for LoRA adapters in Nemotron-H models (#30802) · aa7f37cc
  danisereb authored Jan 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  aa7f37cc
07 Jan, 2026 2 commits
- Enable quantized attention in NemotronH models (#31898) · bf184a66
  roikoren755 authored Jan 07, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  bf184a66
- [BugFix] LoRA: Support loading base_layer of experts (#31104) · 48291484
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Jan 07, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  48291484
06 Jan, 2026 1 commit
- [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#31807) · 28c94770
  roikoren755 authored Jan 06, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  28c94770
31 Dec, 2025 1 commit
- Add get_expert_mapping to NemotronHModel (for LoRA support) (#31539) · 108a2728
  danisereb authored Dec 31, 2025
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  108a2728
08 Dec, 2025 1 commit

Add latent MoE support (#30203) · fcd5306f

shaharmor98 authored Dec 08, 2025


Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

fcd5306f

29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

19 Nov, 2025 1 commit

[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear... · 1395461f

tomeras91 authored Nov 19, 2025


[Hybrid][torch.compile] Refactor mamba2 forward to avoid obscuring linear projections under custom op (#28587)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>

1395461f

13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
11 Nov, 2025 1 commit
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

04 Nov, 2025 1 commit
- [Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968) · 77f8001f
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  77f8001f
27 Oct, 2025 1 commit
- [Hybrid] Added supports_mamba_prefix_caching Protocol (#27339) · 92737542
  Asaf Joseph Gardin authored Oct 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  92737542
23 Oct, 2025 1 commit
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

23 Sep, 2025 1 commit
- [V1] Remove V0 code paths for Hybrid models (#25400) · a903669e
  Thomas Parnell authored Sep 23, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  a903669e
21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
17 Sep, 2025 1 commit
- [Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
  whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4a9375fe
10 Sep, 2025 1 commit

[Bugfix] fix modelopt exclude_modules name mapping (#24178) · 08abfa78

tomeras91 authored Sep 10, 2025


Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08abfa78

29 Aug, 2025 1 commit
- [Models] Improve iteration over layers (#19497) · de533ab2
  Lukas Geiger authored Aug 29, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  de533ab2
15 Aug, 2025 1 commit

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

11 Aug, 2025 1 commit
- [Model] NemotronH Support (#22349) · 14a5d903
  danielafrimi authored Aug 11, 2025
```
Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
```
  14a5d903
07 Aug, 2025 1 commit
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
19 Jul, 2025 1 commit
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
15 Jul, 2025 1 commit
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
11 Jul, 2025 1 commit
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f