Commits · 08ed2b9688b49b1d28c0d78edd71048d2b88c82b · OpenDAS / vllm_cscc

02 Apr, 2026 1 commit

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal,... · 08ed2b96

Luciano Martins authored Apr 02, 2026

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

08ed2b96

01 Apr, 2026 1 commit
- [Core] Simplify multimodal masking (#34246) · 4f6eed3b
  Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4f6eed3b
13 Mar, 2026 1 commit
- Use Transformers v5 `WeightRenaming` for Transformers modeling backend (#31545) · 0005d2a3
  Harry Mellor authored Mar 13, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0005d2a3
27 Feb, 2026 1 commit

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

26 Feb, 2026 1 commit

[offloader] v2: Hide weight onloading latency via prefetching (#29941) · 6831650c

Ming Yang authored Feb 25, 2026


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6831650c

14 Feb, 2026 1 commit
- [Feature][Perf] Support Selective CPU Weight Offloading (#34535) · b37b6797
  Wei Zhao authored Feb 13, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b37b6797
13 Feb, 2026 1 commit

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to... · 59d53066

Wei Zhao authored Feb 13, 2026


[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

59d53066

06 Feb, 2026 1 commit
- support view_from_cpu_tensor on XPU (#33868) · e969a169
  Xinyu Chen authored Feb 06, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  e969a169
30 Jan, 2026 1 commit
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
22 Jan, 2026 1 commit
- [Model] Extend `collect_children` and `no_init_weights` contexts (#32757) · 2b8a38b6
  Cyrus Leung authored Jan 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2b8a38b6
20 Jan, 2026 1 commit
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
18 Jan, 2026 1 commit

"refactor: refactor_repeated_interfaces" (#32486) · 2f03035a

tjp_zju authored Jan 18, 2026


Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2f03035a

27 Nov, 2025 1 commit
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
19 Nov, 2025 1 commit
- Move online quantization to `model.load_weights` (#26327) · da94c7c0
  Jerry Zhang authored Nov 18, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  da94c7c0
17 Nov, 2025 1 commit
- [Quantization] [Eagle] Add complete quantization support to the draft model in Eagle (#28435) · 95ae50b7
  Shreyas Kulkarni authored Nov 17, 2025
```
Signed-off-by: Shreyas Kulkarni <shreyas.gp269@gmail.com>
```
  95ae50b7
15 Nov, 2025 1 commit
- Add support for Eagle with separate lm-head and embed_tokens layers (#28549) · e439c784
  Eldar Kurtić authored Nov 15, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  e439c784
14 Nov, 2025 1 commit

[Bugfix] resolve Qwen3-VL GPTQModel quantized model loading failure (#28663) · cec275ef

GuanH authored Nov 15, 2025


Signed-off-by: GuanH <guansdrailib@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

cec275ef

13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
05 Nov, 2025 1 commit
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 1 commit
- Fix pooling adapters for Transformers backend (#27338) · 1f9460c4
  Harry Mellor authored Oct 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1f9460c4
23 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.platform_utils.py` (#27374) · ca76486a
  Jonathan Chen authored Oct 23, 2025
```
Signed-off-by: Jonathan <chenleejonathan@gmail.com>
```
  ca76486a
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
13 Oct, 2025 1 commit
- [Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
  wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  767c3ab8
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit

[Refactor]: Use M-RoPE interface directly while defining model class instead... · 727144be

dsinghvi authored Oct 11, 2025


[Refactor]: Use M-RoPE interface directly while defining model class instead of maintaining model specific M-RoPE implementation in mrope.py (#24172)
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: wwl2755 <wangwenlong2755@gmail.com>

727144be

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
29 Sep, 2025 1 commit
- [Misc] Remove more `get_input_embeddings_v0` (#25857) · 1b67b046
  Cyrus Leung authored Sep 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1b67b046
27 Sep, 2025 3 commits

[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
a5354b3e

Fix GPTQ model loading in Transformers backend (#25770) · ec152c87

Harry Mellor authored Sep 27, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ec152c87

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

25 Sep, 2025 1 commit

[Model] Add LongCat-Flash (#23991) · 845adb3e

XuruiYang authored Sep 25, 2025


Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>

845adb3e

19 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 logic from `get_input_embeddings` interface (#25242) · 5089fd74
  Cyrus Leung authored Sep 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5089fd74
09 Sep, 2025 1 commit
- [Bugfix] Fix hidden_size for multimodal classification model (#24501) · 9ad0688e
  Jee Jee Li authored Sep 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9ad0688e
28 Aug, 2025 1 commit
- [CI/Build][Bugfix] Fix Qwen VL tests on CPU (#23818) · 67cee40d
  Li, Jiang authored Aug 28, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  67cee40d
27 Aug, 2025 1 commit
- [Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
  Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c905684c
10 Aug, 2025 1 commit
- Improve fast_topk function with type hints and documentation (#22530) · 534c45b9
  ZiTian Zhao authored Aug 10, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  534c45b9
08 Aug, 2025 1 commit
- [Bugfix] Fix RuntimeError: Index put requires the source and destination dtypes match (#22065) · 17eaaef5
  Chauncey authored Aug 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  17eaaef5
06 Aug, 2025 1 commit

Update transformers to `v4.55` (#21931) · 796bae07

Harry Mellor authored Aug 06, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

796bae07