Commits · 035fd2bd2cd2fb70f5834f5ca6c2ea30cdae9187 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "452e8fd9684283d1e0bed63a0c8dc1e3141f788e"

21 Sep, 2025 2 commits
- [Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005) · 035fd2bd
  Wenlong Wang authored Sep 20, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  035fd2bd
- [Chore] Remove unused sampler in models (#25324) · 572ddf83
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  572ddf83
20 Sep, 2025 5 commits
- [Model] Cleanup InternViT's data parallel implementation (#25306) · 3c713a97
  Isotr0py authored Sep 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3c713a97
- Generate _ModelInfo properties file when loading to improve loading speed (#23558) · bf8b26ca
  Manoel Marques authored Sep 20, 2025
```
Signed-off-by: Manoel Marques <manoel.marques@ibm.com>
Signed-off-by: Manoel Marques <manoelmrqs@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bf8b26ca
- [Bugfix] Fix Qwen3-VL-MoE weight loading for EP (#25300) · be874c02
  Roger Wang authored Sep 20, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  be874c02
- [BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ... · 36429096
  JartX authored Sep 20, 2025
```
[BUGFIX] GPTQ quantization compatibility for Qwen3 Next MOE models (AutoGPTQ and AutoRound-GPTQ) (#25268)
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  36429096
- Improve weight loading for encoder models in Transformers backend (#25289) · c308501c
  Harry Mellor authored Sep 20, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c308501c
19 Sep, 2025 9 commits
- Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5
  Zhiyu authored Sep 19, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  431535b5
- [Docs] add __init__.py to... · 138f0d1e
  samzong authored Sep 20, 2025
```
[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  138f0d1e
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
- Remove Redundant Assignment in Qwen3_VisionPatchMerger (#25224) · d90e212a
  LJH-LBJ authored Sep 20, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  d90e212a
- Move `ModelConfig` from `config/__init__.py` to `config/model.py` (#25252) · aed16879
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  aed16879
- [Qwen] Remove cuda hard-code in qwen3 next (#25243) · 838d7116
  Icey authored Sep 19, 2025
```
Signed-off-by: Icey <1790571317@qq.com>
```
  838d7116
- [V0 Deprecation] Remove V0 logic from `get_input_embeddings` interface (#25242) · 5089fd74
  Cyrus Leung authored Sep 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5089fd74
- [Bugfix][Perf] Misc fixes for Qwen3 VL (#25238) · 1dfea5f4
  Roger Wang authored Sep 19, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  1dfea5f4
- [Perf] Optimize memory peak during EAGLE model loading. (#24585) · 1a0a04da
  Chen Ding authored Sep 19, 2025
```
Signed-off-by: Chen Ding <candy.dc@alibaba-inc.com>
```
  1a0a04da
18 Sep, 2025 13 commits

[feat]: Create interface for model-specific M-RoPE (#24194) · 38db529f

Aziz authored Sep 18, 2025

Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

38db529f

[fix]: remove data type hardcoding from gptoss model implementation (#23807) · 064cac7b
Nikhil Gupta authored Sep 18, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
064cac7b
[spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
c4cb0af9

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[PERF] Add `conv1d` metadata to GDN attn (#25105) · 072d7e53
Vadim Gimpelson authored Sep 18, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
072d7e53

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

[Doc] Fix cross-reference warnings (#25058) · 05b044e6

Punitvara authored Sep 18, 2025

Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

05b044e6

[Qwen] Add fp8 checkpoint support for qwen3-next. (#25079) · ef7eefe1
Tao He authored Sep 18, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
ef7eefe1
Retrieve `sliding_window` from text config in Gemma3 MM (#25085) · f4cd80f9
Harry Mellor authored Sep 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f4cd80f9
[EPLB] Add EPLB support for hunyuan_v1 (#23078) · 9d8a2d86
YiwenC authored Sep 17, 2025

9d8a2d86

[Model] enable data parallel for InternVL vision encoder (#23909) · 52bc9d5b

YiwenC authored Sep 17, 2025


Signed-off-by: Yiwen Chen <yiwen66@berkeley.edu>
Signed-off-by: YiwenC <54658925+666even666@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

52bc9d5b

[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in... · 027d37df

toncao authored Sep 18, 2025


[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

027d37df

[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955) · 3127274d

Roger Wang authored Sep 17, 2025

Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

3127274d

17 Sep, 2025 7 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Bugfix][Qwen3-Next] fixes the varlen issue in qwen3-next's MTP implementation. (#24957) · dd6a910a
Tao He authored Sep 17, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
dd6a910a

Add RADIO Vision Encoder Support to vLLM (#24595) · 252ada55

danielafrimi authored Sep 17, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: root <root@cw-dfw-h100-001-305-026.cm.cluster>

252ada55

[Model] Apply SharedFusedMoE to glm4_moe. (#24849) · c15309a7
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
c15309a7
[Model] Pass param prefix to LLMHead (#24862) · 4a9375fe
whx authored Sep 17, 2025
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
4a9375fe

[EPLB] Support EPLB for Mixtral Model (#22842) · b77bf34e

rouchenzi authored Sep 17, 2025


Signed-off-by: rouchenzi <ruochenwen@gmail.com>
Signed-off-by: rouchenzi <40842833+rouchenzi@users.noreply.github.com>
Co-authored-by: Bowen Wang <abmfy@icloud.com>

b77bf34e

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

16 Sep, 2025 4 commits
- [Misc] Add removed encoder-decoder models to previously supported models list (#24961) · d593cf28
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d593cf28
- [Model] Clean up and simplify Mamba2 Metadata Usage in both V0 and V1 (#24331) · 73cfb3c5
  Chih-Chieh Yang authored Sep 16, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  73cfb3c5
- [Bug] [Spec Dec]: Fix kv_cache dtype mismatch for Eagle3 drafter on FP8 target (#24505) · 8c546102
  vllmellm authored Sep 16, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  8c546102
- Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
  Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  759ef49b