Commits · 39d28108f46ac320bccdf76e84640dbf2bd02bb4 · OpenDAS / vllm_cscc

30 Nov, 2025 6 commits
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
- [Bugfix] Fix mismatched nvfp4 gemm output shape (#29742) · 47539cfd
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  47539cfd
- [Doc]: Fix typo in fused_moe layer (#29731) · 9381b5cd
  朝 authored Nov 30, 2025
```
Signed-off-by: BowTen <bowten@qq.com>
```
  9381b5cd
- [Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732) · e1464c3a
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e1464c3a
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091
  Xin Yang authored Nov 29, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a491b091
29 Nov, 2025 5 commits

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

[Chore] Enable passing `tokenizer=None` into MM processor (#29724) · fe3398fa
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
fe3398fa
[Misc] Refactor tokenizer interface (#29693) · 34a98427
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
34a98427
[Doc]: fixing typos in various files. (#29717) · 04a797cd
Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
04a797cd

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

28 Nov, 2025 12 commits

Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
3fd1fb0b

[Bugfix] fix dots.llm1.inst (#29687) · a51f4186

Jiangyun Zhu authored Nov 29, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

a51f4186

[Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30

Cyrus Leung authored Nov 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7675ba30

[Chore]: Reorganize model repo operating functions in `transformers_utils` (#29680) · f946a8d7
Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
f946a8d7
[Doc]: fixing typos in multiple files. (#29685) · fae69430
Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
fae69430

Remove upstream fa checks (#29471) · 460d8bbf

Mingyuan Ma authored Nov 28, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

460d8bbf

[Misc] Remove redundant attention var constants (#29650) · 33b06a6f
Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
33b06a6f
Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506) · 5f5521bd
Filipp Fisin authored Nov 28, 2025
```
Signed-off-by: Filipp Fisin <48059208+qGentry@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
5f5521bd
Revert "[CPU]Update CPU PyTorch to 2.9.0 (#29589)" (#29647) · b34e8775
Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
b34e8775

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

[Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97

EanWang211123 authored Nov 28, 2025


Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

37b15e97

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
745a3bae

27 Nov, 2025 9 commits
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Bugfix] Fix doc build on main (#29619) · ee9841da
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee9841da
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
- [LoRA] Continue optimizing MoE LoRA weight loading (#29322) · 2f5f9acd
  Jee Jee Li authored Nov 27, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2f5f9acd
- [Bugfix] Fix HunyuanVL XD-RoPE (#29593) · cf348c8d
  Roger Wang authored Nov 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored by: grider-transwithai <grider@transwith.ai>
```
  cf348c8d
- [Bugfix] Update Ultravox compatibility (#29588) · 00d3310d
  Cyrus Leung authored Nov 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  00d3310d
- [Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c
  Jinzhen Lin authored Nov 27, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  a67dec7c
- [Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878) · df01eda4
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
```
  df01eda4
26 Nov, 2025 8 commits
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [refactor] CTConfig methods to static/class methods (#28870) · e6031295
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e6031295
- [Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874
  Wentao Ye authored Nov 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0b0aa874
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- Fix TeleChatForCausalLM not register issue (#29473) · bb706d60
  Yejing Lai authored Nov 26, 2025
```
Signed-off-by: Lai, Yejing <yejing.lai@intel.com>
```
  bb706d60
- [Bugfix] Fix handling of image embeds in models (#29480) · e30859df
  Cyrus Leung authored Nov 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e30859df
- [Misc] Allow LM only loading for Pixtral (#29451) · 452a7c9f
  Roger Wang authored Nov 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  452a7c9f
- [Kernel] Use pre-allocated output buffer for triton kernel fused_experts (#29219) · 53d7f1f6
  Xin Yang authored Nov 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  53d7f1f6