Commits · 144030c84ebf03b4f911ad8bab6432729418729c · OpenDAS / vllm_cscc

"examples/backends/trtllm/deploy/agg.yaml" did not exist on "9ddb3efdbe1fc5a9872206d115c2050d497bbf23"

26 Mar, 2026 4 commits
- Disable dual stream execution of input projection for Qwen3 (#38152) · 9704a5c3
  Xin Yang authored Mar 25, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9704a5c3
- Fix minimax m2.5 nvfp4 kv scales weight loading (#37214) · 74056039
  Wei Zhao authored Mar 25, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  74056039
- [Bugfix] Fix Qwen3.5-FP8 Weight Loading Error on TPU (#37348) · d7d51a7e
  Jacob Platin authored Mar 25, 2026
```
Signed-off-by: Jacob Platin <jacobplatin@google.com>
```
  d7d51a7e
- Various Transformers v5 fixes (#38127) · 3c3c0842
  Harry Mellor authored Mar 26, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3c3c0842
25 Mar, 2026 11 commits
- [Cohere] Enable Cohere-Transcribe (#38120) · 7b54f60d
  Ekagra Ranjan authored Mar 25, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  7b54f60d
- [ROCm] Fix MoE kernel test failures on gfx950 (#37833) · 7d6917be
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  7d6917be
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration (#38050) · 678b3c99
  Yongye Zhu authored Mar 25, 2026
  
  678b3c99
- [Model] Add AutoWeightsLoader support for jais (#38074) · 7ac48fd3
  grYe99 authored Mar 25, 2026
```
Signed-off-by: grYe99 <guorongye99@gmail.com>
Co-authored-by: grYe99 <guorongye99@gmail.com>
```
  7ac48fd3
- Fix Plamo 2/3 & LFM2 for Transformers v5 (#38090) · d6bb2a9d
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6bb2a9d
- [Bugfix] Pass drafter quant_config to ParallelLMHead in Eagle3 (#37280) · a889b7f5
  Matthias Gehre authored Mar 25, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  a889b7f5
- [XPU] support MLA model on Intel GPU (#37143) · 14771f71
  Kunshang Ji authored Mar 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  14771f71
- [Revert] Remove CUDA torch fallbacks for... · 09c3dc91
  Chauncey authored Mar 25, 2026
```
[Revert] Remove CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#37968)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  09c3dc91
- [Performance] Auto-enable prefetch on NFS with RAM guard (#37673) · a93a53f8
  Artem Perevedentsev authored Mar 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  a93a53f8
- [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) · 679c6a3e
  Andreas Karatzas authored Mar 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  679c6a3e
24 Mar, 2026 4 commits
- [Model] Add Granite 4.0 1B speech to supported models (#38019) · 935c46dd
  Nick Cao authored Mar 24, 2026
```
Signed-off-by: Nick Cao <ncao@redhat.com>
```
  935c46dd
- [Mypy] Fix mypy for `vllm/model_executor` (except `vllm/model_executor/layers`) (#37904) · b3601da6
  Harry Mellor authored Mar 24, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b3601da6
- [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) · 352b90c4
  Li, Jiang authored Mar 24, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  352b90c4
- [V0 Deprecation] Refactor kv cache from list to element (#37487) · c59a132f
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c59a132f
23 Mar, 2026 14 commits
- [Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac
  Ranran authored Mar 23, 2026
```
Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  dc6908ac
- [Bug][MoE] Strengthen _supports_current_device() checks in the TRTLLM FP8,... · e85f8f09
  yzong-rh authored Mar 23, 2026
```
[Bug][MoE] Strengthen _supports_current_device() checks in the TRTLLM FP8, NVFP4, and FlashInfer CuteDSL MoE experts (#36728)
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  e85f8f09
- [Bug][MoE] Fix TRTLLM NVFP4 Routing Kernel Precision (#36725) · 5bf3c42d
  Robert Shaw authored Mar 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  5bf3c42d
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
- [Bugfix] Fix RoBERTa position_ids accumulation on CUDA graph padding (#37884) · ec228061
  Yufeng He authored Mar 23, 2026
  
  ec228061
- [XPU][MoE Refactor] Refactor xpu mxfp4 support into oracle (#37784) · debd6e76
  Kunshang Ji authored Mar 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  debd6e76
- [FP8]add FP8 WoQ kernel abstraction. (#32929) · 27d5ee3e
  Kunshang Ji authored Mar 23, 2026
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
```
  27d5ee3e
- [ROCm] Fix fused_moe_fake signature mismatch and other AITER bugs (#36100) · e99fb988
  Chuan (Richard) Li authored Mar 23, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
  e99fb988
- [Perf] [Bugfix] Fix Triton autotuning in inference for Qwen3.5 (#37338) · a16133a0
  Artem Perevedentsev authored Mar 23, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  a16133a0
- [Bugfix] Store Qwen3Next A_log in fp32 (#37810) · 54ab804e
  Hojin Yang authored Mar 23, 2026
```
Signed-off-by: effortprogrammer <yhjhoward7@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  54ab804e
- [Bugfix] JAIS: Only apply ALiBi when position_embedding_type='alibi' (#37820) · 02e6efe5
  r266-tech authored Mar 23, 2026
```
Co-authored-by: r266-tech <r266-tech@users.noreply.github.com>
```
  02e6efe5
- [ROCm][Refactor] Enable AWQMarlinConfig on ROCm to use choose_mp_linear_kernel (#36505) · 410d3008
  Matthias Gehre authored Mar 23, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  410d3008
- [Feature] ViT Full CUDA Graph (#35963) · f85e479e
  Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
  f85e479e
- Fix AudioFlamingo3/MusicFlamingo HF parity and RoTE handling (#37643) · e7767ecc
  Lasha Koroshinadze authored Mar 22, 2026
```
Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
```
  e7767ecc
22 Mar, 2026 5 commits
- [Bigfix]fix lora test by pass padded size back to the layer (#37811) · c058ff44
  Yongye Zhu authored Mar 22, 2026
  
  c058ff44
- Enable `NemotronHPuzzle` + `NemotronHMTP` (#37803) · e74c17e1
  Netanel Haber authored Mar 22, 2026
  
  e74c17e1
- [Bug] Fix fp8 deepgemm batch invariant (#37718) · 77d24c4b
  Wentao Ye authored Mar 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77d24c4b
- [MoE] Move PF Methods to Folder (#35927) · 4383f153
  Robert Shaw authored Mar 22, 2026
  
  4383f153
- [Perf] Optimize glm4.xv VIT (#37779) · b0507004
  Yang Liu authored Mar 22, 2026
```
Signed-off-by: Yang <lymailforjob@gmail.com>
```
  b0507004
21 Mar, 2026 2 commits
- [MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759) · 6b2fa3a7
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  6b2fa3a7
- [Quantization][Deprecation] Remove PTPC FP8 (#32700) · eeee5b26
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  eeee5b26