Commits · 11cec296dd47bbb25c3bb4e40bcc11341d6a2fe2 · OpenDAS / vllm_cscc

09 Jan, 2026 3 commits

[BugFix] Add spec-decode-incompatible request param validation (#31982) · 11cec296
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
11cec296

[Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1

Robert Shaw authored Jan 08, 2026

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5825bbc1

[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change... · d62cfe54

Yongye Zhu authored Jan 08, 2026


[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change compressed tensor kernel selection (#31752)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d62cfe54

08 Jan, 2026 37 commits
- [Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c
  Lucas Wilkinson authored Jan 08, 2026
```
[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  6cdf015c
- [Compressed-Tensors] Simplify NVFP4 Conditions, enable marlin support for NVFP4A16 MoEs (#30881) · 5d3b6097
  Dipika Sikka authored Jan 08, 2026
  
  5d3b6097
- [Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
  bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e74698c2
- [Frontend] Improve error message (#31987) · aa125ecf
  Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa125ecf
- Revert "feat(moe): Add is_act_and_mul=False support for Triton MoE kernels" (#31978) · 87e07a6b
  Michael Goin authored Jan 08, 2026
  
  87e07a6b
- [Model Runner V2] Simplify BlockTables with UVA (#31965) · 75082432
  Woosuk Kwon authored Jan 08, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  75082432
- [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a3d909ad
- [Bugfix] Fix vllm serve failure with Nemotron Nano V3 FP8 (#31960) · b8112c1d
  danisereb authored Jan 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  b8112c1d
- [Bugfix]: Fix Step3ReasoningParser missing is_reasoning_end_streaming (#31969) · eaba8ece
  Chauncey authored Jan 08, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  eaba8ece
- [Model] Support IQuestCoder model (#31575) · fe86be66
  yxing-bj authored Jan 08, 2026
```
Signed-off-by: yxing <yxing@iquestlab.com>
```
  fe86be66
- [OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
  Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  7645bc52
- [Model] Enable LoRA support for Pixtral (#31724) · 1123a878
  Ce Zhao authored Jan 08, 2026
```
Signed-off-by: <>
Signed-off-by: 赵策 <alcor@zhaocedeMacBook-Air.local>
Signed-off-by: 赵策 <alcor@mac.mynetworksettings.com>
Co-authored-by: 赵策 <alcor@mac.mynetworksettings.com>
```
  1123a878
- [Model] Add LFM2-VL model support (#31758) · 03fd76c5
  tianshu-Michael-yu authored Jan 08, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  03fd76c5
- [Model] Add Grok-2 (#31847) · 59d260f5
  Bijaya Dangol authored Jan 08, 2026
```
Signed-off-by: dangoldbj <dangoldbj23@gmail.com>
```
  59d260f5
- [Voxtral] Fix speech transcription api (#31388) · 18d4e481
  Patrick von Platen authored Jan 08, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  18d4e481
- [MM Encoder]: Make MMEncoderAttention's `scale` takes effect properly (#31950) · 2972a054
  Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2972a054
- [Model] Standardize common vision encoders (#31947) · 5576227b
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5576227b
- [Chore] Further cleanup pooler (#31951) · d1b6fe00
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d1b6fe00
- RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) · 04a49669
  omer-dayan authored Jan 08, 2026
```
Signed-off-by: Omer Dayan <omdayan@nvidia.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  04a49669
- [Misc] Support qwen3-next lora (#31719) · 96fcd3c2
  BingjiaWang authored Jan 08, 2026
  
  96fcd3c2
- fix(compile): apply partition wrapper when loading AOT cached functions (#31536) · 1f214290
  DevByteAI authored Jan 08, 2026
```
Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  1f214290
- Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635) · b634e619
  Lumosis authored Jan 08, 2026
```
Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: Lumosis <30372757+Lumosis@users.noreply.github.com>
```
  b634e619
- [Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
  Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  eac3b96e
- fix(rocm): Add get_supported_kernel_block_sizes() to ROCM_ATTN (#31712) · 107cf8e9
  Rabi Mishra authored Jan 08, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  107cf8e9
- [Model] Enable LoRA support for tower and connector in GLM4-V (#31652) · 63baa28c
  Zyyeric authored Jan 08, 2026
```
Signed-off-by: Zyyeric <eric1976808123@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  63baa28c
- [Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) · e5173d3b
  Andy Liu authored Jan 07, 2026
  
  e5173d3b
- [Fix] Enable mm_processor_cache with vision LoRA (#31927) · d3235cb5
  prashanth058 authored Jan 08, 2026
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  d3235cb5
- [BugFix] Fix spec decoding edge case bugs (#31944) · 287b37cd
  Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  287b37cd
- [grpc] Support gRPC server entrypoint (#30190) · 791b2fc3
  Chang Su authored Jan 07, 2026
```
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  791b2fc3
- [platform] add dp_metadata arg to set_additional_forward_context (#31942) · 2ab441be
  Ronald authored Jan 08, 2026
```
Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
```
  2ab441be
- [Model] Enable LoRA support for tower and connector in DotsOCR (#31825) · 9572f74f
  ShaanveerS authored Jan 08, 2026
```
Signed-off-by: ShaanveerS <shaanver.singh@gmail.com>
```
  9572f74f
- [ROCm][LoRA] Fix MoE accuracy regression by preserving float32 router weight scaling (#31931) · c4041f37
  Andreas Karatzas authored Jan 07, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c4041f37
- [MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71
  Robert Shaw authored Jan 07, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  9f6dcb71
- fix(rocm): add early return in get_flash_attn_version for ROCm (#31286) · 39d82005
  Rabi Mishra authored Jan 08, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  39d82005
- feat(moe): Add is_act_and_mul=False support for Triton MoE kernels (#31645) · 25eef3dc
  Rabi Mishra authored Jan 08, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  25eef3dc
- [0/N][Attention] Fix miscellaneous pre-commit issues (#31924) · 0d766741
  Matthew Bonanni authored Jan 07, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0d766741
- [MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
  Robert Shaw authored Jan 07, 2026
  
  5dcd7ef1