Commits · ce888aa4d1762b6cb5c3f51f601754ad2ce95b2b · OpenDAS / vllm_cscc

13 Dec, 2025 1 commit
- fix optional and list · ce888aa4
  zhuwenwen authored Dec 13, 2025
  
  ce888aa4
02 Dec, 2025 9 commits

[Bugfix] Fix incorrect channel order for idefics3 in edge case (#29881) · 2f055ec1

Isotr0py authored Dec 03, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 0ec84221)

2f055ec1

[BUGFIX] llama_4_scaling wrongly passed to DeepseekAttention (#29908) · 9057fc2f
Julien Denize authored Dec 02, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
(cherry picked from commit 5e5646e2)
```
9057fc2f

[Bugfix] Fix DeepSeek R1 MTP weight loading (#29545) · 339e84ce

Matthew Bonanni authored Dec 02, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
(cherry picked from commit 51c57b51)

339e84ce

[Chore] Use `tokenizer.encode` and `tokenizer.decode` directly (#29851) · 34a8559b
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
(cherry picked from commit 68ffbca7)
```
34a8559b

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

Fix some Transformers nightly tests (#29802) · f5b0846b
Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f5b0846b
[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5
Add missing return in _check_vllm_model_embed_input_ids (#29834) · f441d36c
Johnny Yang authored Dec 01, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
f441d36c

[ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244) · 4b409249

Divakar Verma authored Dec 01, 2025

Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Signed-off-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

4b409249

01 Dec, 2025 3 commits

[Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209) · 092bb73b
sangbumlikeagod authored Dec 02, 2025
```
Signed-off-by: sangbumlikeagod <oironese@naver.com>
Signed-off-by: sangbumlikeagod <98077576+sangbumlikeagod@users.noreply.github.com>
```
092bb73b
[XPU] Fix AWQ skipped layer detection in IPEX quantization (#29774) · f37e8938
Fanli Lin authored Dec 01, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
f37e8938

[MoE] CuteDSL MoE with Nvfp4 DeepEP dispatch (#27141) · f72a817b

Shu Wang authored Nov 30, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f72a817b

30 Nov, 2025 7 commits
- [Misc]Remove redundant hidden_size property in ModelConfig (#29749) · 21c26279
  Xingyu Liu authored Dec 01, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  21c26279
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
- [Bugfix] Fix mismatched nvfp4 gemm output shape (#29742) · 47539cfd
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  47539cfd
- [Doc]: Fix typo in fused_moe layer (#29731) · 9381b5cd
  朝 authored Nov 30, 2025
```
Signed-off-by: BowTen <bowten@qq.com>
```
  9381b5cd
- [Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732) · e1464c3a
  Isotr0py authored Nov 30, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e1464c3a
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091
  Xin Yang authored Nov 29, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a491b091
29 Nov, 2025 5 commits

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

[Chore] Enable passing `tokenizer=None` into MM processor (#29724) · fe3398fa
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
fe3398fa
[Misc] Refactor tokenizer interface (#29693) · 34a98427
Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
34a98427
[Doc]: fixing typos in various files. (#29717) · 04a797cd
Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
04a797cd

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

28 Nov, 2025 12 commits

Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
3fd1fb0b

[Bugfix] fix dots.llm1.inst (#29687) · a51f4186

Jiangyun Zhu authored Nov 29, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

a51f4186

[Misc] Remove redundant `ClassRegistry` (#29681) · 7675ba30

Cyrus Leung authored Nov 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7675ba30

[Chore]: Reorganize model repo operating functions in `transformers_utils` (#29680) · f946a8d7
Isotr0py authored Nov 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
f946a8d7
[Doc]: fixing typos in multiple files. (#29685) · fae69430
Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
fae69430

Remove upstream fa checks (#29471) · 460d8bbf

Mingyuan Ma authored Nov 28, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

460d8bbf

[Misc] Remove redundant attention var constants (#29650) · 33b06a6f
Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
33b06a6f
Fix parameter order in GPT-OSS weight loading function for non-MXFP4 weights (#29506) · 5f5521bd
Filipp Fisin authored Nov 28, 2025
```
Signed-off-by: Filipp Fisin <48059208+qGentry@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
5f5521bd
Revert "[CPU]Update CPU PyTorch to 2.9.0 (#29589)" (#29647) · b34e8775
Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
b34e8775

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

[Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97

EanWang211123 authored Nov 28, 2025


Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

37b15e97

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
745a3bae

27 Nov, 2025 3 commits
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Bugfix] Fix doc build on main (#29619) · ee9841da
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ee9841da
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3