Commits · 936e0b79aa93008bb90e4cc190ea8adb9296b1df · OpenDAS / vllm_cscc

21 Apr, 2026 1 commit

[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph... · 936e0b79

Shanshan Shen authored Apr 21, 2026


[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph video inference (#40445)
Signed-off-by: shen-shanshan <467638484@qq.com>

936e0b79

14 Apr, 2026 1 commit

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061) · 80118853

Shanshan Shen authored Apr 14, 2026


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

80118853

09 Apr, 2026 1 commit
- [ASR] Fix spacing bw chunks in multi chunk audio transcription (#39116) · f7cad674
  Ekagra Ranjan authored Apr 09, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  f7cad674
05 Apr, 2026 1 commit

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

01 Apr, 2026 1 commit
- [Core] Simplify multimodal masking (#34246) · 4f6eed3b
  Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4f6eed3b
25 Mar, 2026 1 commit
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
23 Mar, 2026 1 commit
- [Feature] ViT Full CUDA Graph (#35963) · f85e479e
  Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
  f85e479e
13 Mar, 2026 2 commits
- [Refactor] Consolidate SupportsEagle (#36063) · 8b346309
  Benjamin Chislett authored Mar 13, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  8b346309
- Use Transformers v5 `WeightRenaming` for Transformers modeling backend (#31545) · 0005d2a3
  Harry Mellor authored Mar 13, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0005d2a3
10 Mar, 2026 1 commit
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
09 Mar, 2026 1 commit
- Increase Flexibility for OOV Multimodal Token Handling (#34858) · bd2659a5
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  bd2659a5
21 Feb, 2026 2 commits

[Frontend] Add automatic language detection for Whisper transcription (#34342) · 98b0205c

Roman authored Feb 21, 2026


Signed-off-by: space_check <roman.vuskov@rwth-aachen.de>
Signed-off-by: Roman <45857014+spacecheck@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

98b0205c

[Realtime] Add Qwen3-ASR realtime streaming support (#34613) · 11be2c74

pougetat authored Feb 20, 2026


Signed-off-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Thomas Pouget-Abadie <thomaspou@microsoft.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

11be2c74

05 Feb, 2026 1 commit

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit

Change the type signature of MixtureOfExperts.expert_weights to... · ce498a6d

Sage Moore authored Feb 04, 2026

Change the type signature of MixtureOfExperts.expert_weights to MutableSequence[Sequence[Tensor]] (#33573)
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

ce498a6d

31 Jan, 2026 1 commit
- [Bugfix] Fix `Qwen3ASR` language asr tag in output (#33410) · e77f162c
  Nicolò Lucchesi authored Jan 31, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  e77f162c
30 Jan, 2026 1 commit
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
27 Jan, 2026 1 commit

[LoRA][Spec Decode] Support LoRA for Nemotron-H MTP models (#32265) · f3a5ee70

danisereb authored Jan 27, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

f3a5ee70

26 Jan, 2026 1 commit
- [Chore] Update type annotation of `input_ids` in model forward (#33063) · dcd80206
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dcd80206
23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

22 Jan, 2026 1 commit
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
20 Jan, 2026 3 commits
- [4/N] Initialize MM components in context managers (M-P) (#32663) · fda3f03e
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fda3f03e
- [1/N] Initialize MM components in context managers (A-D) (#32632) · b75e85de
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b75e85de
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
19 Jan, 2026 1 commit
- Add support for LoRA adapters in Nemotron-H models (#30802) · aa7f37cc
  danisereb authored Jan 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  aa7f37cc
26 Dec, 2025 1 commit

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674) · ce1eafd1

Jee Jee Li authored Dec 26, 2025


Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>

ce1eafd1

24 Dec, 2025 1 commit
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
23 Dec, 2025 1 commit
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
22 Dec, 2025 1 commit
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
11 Dec, 2025 2 commits
- [Misc] Improve error message for `is_multimodal` (#30483) · 3a3b06ee
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3a3b06ee
- [Deprecation] Remove fallbacks for `embed_input_ids` and `embed_multimodal` (#30458) · 979f50ef
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  979f50ef
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 2 commits
- [Model] Move `multimodal_cpu_fields` definition to field config (#30181) · 671427ef
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  671427ef
- [Chore] Deprecate `SupportsMultiModal.merge_by_field_config` (#30170) · c46b932d
  Cyrus Leung authored Dec 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c46b932d
04 Dec, 2025 1 commit
- [Chore] Deprecate `merge_by_field_config` arg (#30035) · b286a311
  Cyrus Leung authored Dec 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b286a311
01 Dec, 2025 1 commit
- [Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
  sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
  092bb73b
29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

28 Nov, 2025 1 commit

[Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30

Cyrus Leung authored Nov 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7675ba30

27 Nov, 2025 1 commit
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd