Commits · 2c58742dff8613a3bd7496f2008ce927e18d38d1 · OpenDAS / vllm_cscc

23 Sep, 2025 7 commits
- [BugFix] Register expert_map as named buffer for wake_up and sleep (#25458) · 61d1b355
  Joel authored Sep 23, 2025
```
Signed-off-by: wuxibin <wuxibin@bytedance.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  61d1b355
- [Bugfix] Fix idefics3 `tie_word_embeddings` (#25454) · 231c2c63
  Isotr0py authored Sep 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  231c2c63
- [Misc] Move DP for ViT code inside model executor dir (#25459) · babad6e5
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  babad6e5
- Handle triton kernel import exception (#25319) · ba8d2165
  Ming Yang authored Sep 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ba8d2165
- [Model] Enable DP for ViT in Qwen2-VL (#25445) · c98be0a2
  Cyrus Leung authored Sep 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c98be0a2
- [DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
  Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e8db44f8
- [feat] Support MRoPE + YaRN (#25384) · fc97733d
  JJJYmmm authored Sep 23, 2025
```
Signed-off-by: liuye.hj <liuye.hj@alibaba-inc.com>
Co-authored-by: liuye.hj <liuye.hj@alibaba-inc.com>
```
  fc97733d
22 Sep, 2025 5 commits

[EPLB] Reduce EPLB Inference Overhead (#24573) · 06a41334

Bowen Wang authored Sep 22, 2025

Signed-off-by: Bowen Wang <abmfy@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

06a41334

[Kernel] MI-300X triton moe configs (#23445) · ac243886
Sara-KS authored Sep 22, 2025
```
Signed-off-by: Sara Kokkila Schumacher <saraks@ibm.com>
```
ac243886
[TPU] Deprecate `xm.mark_step` in favor of ``torch_xla.sync` (#25254) · 4cf71cc8
Nicolò Lucchesi authored Sep 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
```
4cf71cc8
Enable Eagle3 speculative decoding for GPT-OSS model (#25246) · 21467f9a
Eldar Kurtić authored Sep 22, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
21467f9a

[Model] Support Dots OCR (#24645) · 7b57a433

Roger Wang authored Sep 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>

7b57a433

21 Sep, 2025 8 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [Perf] Further optimization for Qwen3-VL `fast_pos_embed_interpolate` (#25347) · af7dfb0d
  Isotr0py authored Sep 22, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  af7dfb0d
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
- [V0 Deprecation] Remove V0 Sequence class & Sampler (#25332) · 26e673fe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  26e673fe
- [MM][Perf] Minor Optimization on Qwen3-VL `fast_pos_embed_interpolate` (#25337) · 30d08911
  Roger Wang authored Sep 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  30d08911
- [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) · 035fd2bd
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  035fd2bd
- [Chore] Remove unused sampler in models (#25324) · 572ddf83
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  572ddf83
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
20 Sep, 2025 7 commits
- [Model] Cleanup InternViT's data parallel implementation (#25306) · 3c713a97
  Isotr0py authored Sep 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3c713a97
- Generate _ModelInfo properties file when loading to improve loading speed (#23558) · bf8b26ca
  Manoel Marques authored Sep 20, 2025
```
Signed-off-by: Manoel Marques <manoel.marques@ibm.com>
Signed-off-by: Manoel Marques <manoelmrqs@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bf8b26ca
- [CI Failure] Disable FlashInfer RoPE to unblock CI (#25299) · e08a3a3f
  Michael Goin authored Sep 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e08a3a3f
- [Bugfix] Fix Qwen3-VL-MoE weight loading for EP (#25300) · be874c02
  Roger Wang authored Sep 20, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  be874c02
- [Optimization] Avoid repeated model architecture conversion for pooling models (#25261) · c60e6137
  Cyrus Leung authored Sep 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c60e6137
- [BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ... · 36429096
  JartX authored Sep 20, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ and AutoRound-GPTQ) (#25268)
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  36429096
- Improve weight loading for encoder models in Transformers backend (#25289) · c308501c
  Harry Mellor authored Sep 20, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c308501c
19 Sep, 2025 13 commits

Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5

Zhiyu authored Sep 19, 2025


Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

431535b5

Fix: Correct FusedMoE layer reference in auto_round quantization (#24818) · ddc90483

David-Wen authored Sep 20, 2025

Signed-off-by: David-Wen <18927700430@163.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddc90483

[Perf] Use FlashInfer RoPE for RotaryEmbedding.forward_cuda when available (#21126) · 48ecb443

Michael Goin authored Sep 19, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

48ecb443

[Bugfix] Fix chunked a2_scales in modular kernels (#25264) · 4bdf4002
bnellnm authored Sep 19, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
4bdf4002

[Bugfix] GPT OSS Attritbute error on H100 (#25228) · 7852b82b

Varun Sundar Rabindranath authored Sep 19, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

7852b82b

[Docs] add __init__.py to... · 138f0d1e

samzong authored Sep 20, 2025


[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>

138f0d1e

Encoder model support for the Transformers backend (#25174) · 12aed7e4
Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
12aed7e4

Remove Redundant Assignment in Qwen3_VisionPatchMerger (#25224) · d90e212a

LJH-LBJ authored Sep 20, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

d90e212a

Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
aed16879
[Qwen] Remove cuda hard-code in qwen3 next (#25243) · 838d7116
Icey authored Sep 19, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
838d7116
[V0 Deprecation] Remove V0 logic from `get_input_embeddings` interface (#25242) · 5089fd74
Cyrus Leung authored Sep 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
5089fd74
[Bugfix][Perf] Misc fixes for Qwen3 VL (#25238) · 1dfea5f4
Roger Wang authored Sep 19, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
1dfea5f4
[Kernel][Performance] Add Triton kernel for Qwen3-VL interleaved MRoPE (#25055) · cea91a32
Isotr0py authored Sep 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
cea91a32