Commits · 87185c88d54bd97c4c08f1fd3c5a8564e4924e2a · OpenDAS / vllm_cscc

25 Nov, 2025 2 commits
- [Bugfix] Make deprecated `--task embedding` consistent with `--runner… (#29312) · 87185c88
  Maryam Tahhan authored Nov 25, 2025
```
Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
```
  87185c88
- Scheduled removal of `ParallelConfig`'s direct child EPLB fields (#29324) · a4ad43ad
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a4ad43ad
24 Nov, 2025 4 commits

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

[EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
2601f18a

[Doc]: fix typos in various files (#29230) · eca7a8fb

Didier Durand authored Nov 24, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

eca7a8fb

[Core] Deprecate `xformers` (#29262) · 0ff70821
Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
0ff70821

22 Nov, 2025 2 commits
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 4 commits

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7219bcd
[BugFix] skip combo kernel on cpu (#29129) · 8c25f9cf
Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
8c25f9cf
[LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
9875be64

20 Nov, 2025 2 commits

[V0 Deprecation] Remove `num_lookahead_slots` (#29000) · 20e4497b

Cyrus Leung authored Nov 20, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

20e4497b

[Bugfix] Revert custom attention mask for gemma3-mm (#28995) · 64192d56

Isotr0py authored Nov 20, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

64192d56

19 Nov, 2025 6 commits

[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
8f4f77a7

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

[config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961) · ba558c02

Tova Movshovitz authored Nov 19, 2025


Signed-off-by: tovam <tovam@pliops.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

ba558c02

[CPU] Refactor CPU WNA16 (#28826) · 20852c8f
Li, Jiang authored Nov 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
20852c8f

18 Nov, 2025 1 commit

[Model] Add Gemma3 GGUF multimodal support (#27772) · c2612371

Luciano Martins authored Nov 18, 2025

Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

c2612371

17 Nov, 2025 2 commits

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

[BugFix] Temporary fix for IMA with MTP = 2 and full-cg (#28315) · 64e39d66
Lucas Wilkinson authored Nov 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
64e39d66

16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

15 Nov, 2025 3 commits

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

[PERF] Remove TRTLLM Gen attn kernel limitation `max_seq_len <=131072` (#28755) · 173b356a
Vadim Gimpelson authored Nov 15, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
173b356a
[Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
638e4196

14 Nov, 2025 4 commits

[Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
e2741f6c
[Docs] Update the name of `Transformers backend` -> `Transformers modeling backend` (#28725) · 5f3cd7f7
Harry Mellor authored Nov 14, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f3cd7f7
[Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
511a6b61

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438) · 4516d44b

Jingchun Gao authored Nov 14, 2025


Signed-off-by: gaojc <1055866782@qq.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: gaojingchun (A) <g00955623@china.huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

4516d44b

13 Nov, 2025 4 commits
- [Perf] Support stream interval for reducing host overhead (#27869) · 5d6ce2b9
  elvischenv authored Nov 14, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  5d6ce2b9
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
- Fix `get_num_experts` when config sets it explicitly to `None` (#28652) · b230286f
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: bruceszchen <bruceszchen@tencent.com>
```
  b230286f
- [BugFix] Fix `mm_encoder_attn_backend` arg type checking (#28599) · 8832fff9
  Nick Hill authored Nov 12, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8832fff9
12 Nov, 2025 5 commits
- [Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  4ca5cd57
- [Model] [Config] Correctly identify granite-4.0-micro as non-hybrid model (#28563) · 64d57c3b
  Thomas Parnell authored Nov 12, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  64d57c3b
- [EPLB][ROCm]: support EPBL for ROCm backend (#27731) · a1e7fa36
  PerryZhang01 authored Nov 13, 2025
```
Signed-off-by: Perry Zhang <perzhang@amd.com>
Co-authored-by: Perry Zhang <perzhang@amd.com>
```
  a1e7fa36
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94