Commits · 020732800caf3ba1eae62098c4264dac7ef35611 · OpenDAS / vllm_cscc

"benchmarks/vscode:/vscode.git/clone" did not exist on "0790f07695c72fe203e95f6d8c8ff15c8003e754"

09 Jan, 2026 14 commits

[Bugfix] Fix OpenAPI schema test failures (#31921) · 02073280
Andreas Karatzas authored Jan 09, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
02073280
[Bugfix] Fix Var Length Batched Padding in Granite Speech (#31906) · dc77cb71
Alex Brooks authored Jan 09, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
dc77cb71

fix lora moe sharding when rank < max_lora_rank (#31994) · bde38c11

gnovack authored Jan 08, 2026


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

bde38c11

[Bugfix] Fix FusedMoE LoRA w2_output_size (#31949) · 707b240d
Xin Yang authored Jan 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
707b240d
[Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
29ce4822

[Bugfix] missing tokens occur in harmony streaming (#30437) · e2d49ec2

RioS authored Jan 09, 2026


Signed-off-by: RioS <aa248424@gmail.com>
Signed-off-by: Ri0S <aa248424@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

e2d49ec2

[Bugfix] Fix typo in FusedMoE LoRA reshape comment (#31992) · 8413868d
Xin Yang authored Jan 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
8413868d

[Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995

zhrrr authored Jan 09, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

8ff4a995

[Frontend] Add MCP tool streaming support to Responses API (#31761) · a4ec0c55
daniel-salib authored Jan 08, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
a4ec0c55

[Bugfix] Fix Typo from NVFP4 Refactor (#31977) · 0fa8dd24

Robert Shaw authored Jan 08, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

0fa8dd24

[Feature] Add iteration level logging and enhance nvtx marker (#31193) · 6ebe34d6

Max Hu authored Jan 08, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>

6ebe34d6

[BugFix] Add spec-decode-incompatible request param validation (#31982) · 11cec296
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
11cec296

[Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1

Robert Shaw authored Jan 08, 2026

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5825bbc1

[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change... · d62cfe54

Yongye Zhu authored Jan 08, 2026


[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change compressed tensor kernel selection (#31752)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d62cfe54

08 Jan, 2026 26 commits

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

[Compressed-Tensors] Simplify NVFP4 Conditions, enable marlin support for NVFP4A16 MoEs (#30881) · 5d3b6097
Dipika Sikka authored Jan 08, 2026

5d3b6097
[Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
e74698c2
[Frontend] Improve error message (#31987) · aa125ecf
Cyrus Leung authored Jan 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aa125ecf
Revert "feat(moe): Add is_act_and_mul=False support for Triton MoE kernels" (#31978) · 87e07a6b
Michael Goin authored Jan 08, 2026

87e07a6b
[Model Runner V2] Simplify BlockTables with UVA (#31965) · 75082432
Woosuk Kwon authored Jan 08, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
75082432
[Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
a3d909ad
[Bugfix] Fix vllm serve failure with Nemotron Nano V3 FP8 (#31960) · b8112c1d
danisereb authored Jan 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
b8112c1d
[Bugfix]: Fix Step3ReasoningParser missing is_reasoning_end_streaming (#31969) · eaba8ece
Chauncey authored Jan 08, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
eaba8ece
[Model] Support IQuestCoder model (#31575) · fe86be66
yxing-bj authored Jan 08, 2026
```
Signed-off-by: yxing <yxing@iquestlab.com>
```
fe86be66
[OpenAI] Fix tool_choice=required streaming when output has trailing extra data (#31610) · 7645bc52
Mary authored Jan 08, 2026
```
Signed-off-by: maylikenoother <ogedengbemary19@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
7645bc52

[Model] Enable LoRA support for Pixtral (#31724) · 1123a878

Ce Zhao authored Jan 08, 2026



Signed-off-by: <>
Signed-off-by: 赵策 <alcor@zhaocedeMacBook-Air.local>
Signed-off-by: 赵策 <alcor@mac.mynetworksettings.com>
Co-authored-by: 赵策 <alcor@mac.mynetworksettings.com>

1123a878

[Model] Add LFM2-VL model support (#31758) · 03fd76c5

tianshu-Michael-yu authored Jan 08, 2026


Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

03fd76c5

[Model] Add Grok-2 (#31847) · 59d260f5
Bijaya Dangol authored Jan 08, 2026
```
Signed-off-by: dangoldbj <dangoldbj23@gmail.com>
```
59d260f5

[Voxtral] Fix speech transcription api (#31388) · 18d4e481

Patrick von Platen authored Jan 08, 2026


Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: prashanth058 <prashanth.dannamaneni@uipath.com>
Co-authored-by: Anexdeus <5142168@mail.ru>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

18d4e481

[MM Encoder]: Make MMEncoderAttention's `scale` takes effect properly (#31950) · 2972a054
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
2972a054
[Model] Standardize common vision encoders (#31947) · 5576227b
Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
5576227b
[Chore] Further cleanup pooler (#31951) · d1b6fe00
Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d1b6fe00

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803) · 04a49669

omer-dayan authored Jan 08, 2026


Signed-off-by: Omer Dayan <omdayan@nvidia.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

04a49669

[Misc] Support qwen3-next lora (#31719) · 96fcd3c2
BingjiaWang authored Jan 08, 2026

96fcd3c2

fix(compile): apply partition wrapper when loading AOT cached functions (#31536) · 1f214290

DevByteAI authored Jan 08, 2026

Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1f214290

Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635) · b634e619
Lumosis authored Jan 08, 2026
```
Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: Lumosis <30372757+Lumosis@users.noreply.github.com>
```
b634e619
[Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
eac3b96e
fix(rocm): Add get_supported_kernel_block_sizes() to ROCM_ATTN (#31712) · 107cf8e9
Rabi Mishra authored Jan 08, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
107cf8e9
[Model] Enable LoRA support for tower and connector in GLM4-V (#31652) · 63baa28c
Zyyeric authored Jan 08, 2026
```
Signed-off-by: Zyyeric <eric1976808123@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
63baa28c
[Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) · e5173d3b
Andy Liu authored Jan 07, 2026

e5173d3b