Commits · 66e674cdd549e89b341fb33405a2c02ec5f5ae8d · OpenDAS / vllm_cscc

05 Dec, 2025 2 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[PCP&DCP] move CUDAGraph check for PCP&DCP to the check func of platforms (#29952) · 0098a6e3
Qiu authored Dec 05, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
0098a6e3

03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [BugFix] add max-num-batched-token to scheduler hash (#29829) · 70fb77b4
  Boyuan Feng authored Dec 02, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  70fb77b4
01 Dec, 2025 1 commit
- [Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935) · eaf81485
  Nengjun Ma authored Dec 02, 2025
```
Signed-off-by: leo-pony <nengjunma@outlook.com>
```
  eaf81485
28 Nov, 2025 2 commits

[Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef

Yanan Cao authored Nov 28, 2025


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

3461e7ef

Improve enable chunked_prefill & prefix_caching logic. (#26623) · f4b76056

wang.yuqi authored Nov 28, 2025


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f4b76056

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 1 commit

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79

George D. Torres authored Nov 25, 2025


Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

56531b79

24 Nov, 2025 1 commit

[Doc]: fix typos in various files (#29230) · eca7a8fb

Didier Durand authored Nov 24, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

eca7a8fb

19 Nov, 2025 1 commit

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

15 Nov, 2025 3 commits

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

[PERF] Remove TRTLLM Gen attn kernel limitation `max_seq_len <=131072` (#28755) · 173b356a
Vadim Gimpelson authored Nov 15, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
173b356a
[Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
638e4196

14 Nov, 2025 1 commit
- [Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2741f6c
12 Nov, 2025 3 commits

Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a742134c

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

[Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
48c87936

10 Nov, 2025 1 commit
- [CI] Fix Plugin Tests Tests (#28413) · 30700b1c
  Robert Shaw authored Nov 10, 2025
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  30700b1c
08 Nov, 2025 1 commit

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

07 Nov, 2025 1 commit
- [Core] Rework handling of async scheduling config (#28250) · da786e33
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  da786e33
01 Nov, 2025 1 commit

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

30 Oct, 2025 3 commits
- [CI] Fix mypy for `vllm/v1/core` and `vllm/v1/engine` (#27108) · c01f6e52
  Wentao Ye authored Oct 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c01f6e52
- [V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784) · af826e08
  wangxiyuan authored Oct 30, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  af826e08
- [Bugfix] mamba-block-size is set for vision language model (#27773) · d7fb10c5
  Chen Zhang authored Oct 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  d7fb10c5
28 Oct, 2025 1 commit
- [Stability fix] turn off HMA allocator when connector is set (#27592) · 255e34ca
  Kuntai Du authored Oct 27, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  255e34ca
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
25 Oct, 2025 1 commit
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

17 Oct, 2025 1 commit
- [Bugfix] Use PIECEWISE cudagraphs on Blackwell if max_model_len > 131072 (#27114) · 950cf9e5
  Michael Goin authored Oct 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  950cf9e5
16 Oct, 2025 1 commit
- [BUG] Allow runai_streamer_sharded in config check (#26958) · 582f2c6b
  ahao-anyscale authored Oct 15, 2025
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  582f2c6b
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 2 commits

[Feature] Change vllm.py with pydantic validation (#26726) · c715ba37

Vladislav Bronzov authored Oct 14, 2025

Signed-off-by: Vladislav <vladislav.bronzov@gmail.com>
Signed-off-by: Vladislav Bronzov <58587565+VladOS95-cyber@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

c715ba37

[UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
3e051bda

13 Oct, 2025 1 commit

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

12 Oct, 2025 3 commits
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
- [Bugfix][DCP] Set default CUDAGraphMode to PIECEWISE for DCP (#26574) · b91d8db8
  Jaya Yuan authored Oct 12, 2025
```
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
```
  b91d8db8
- [MISC] Rename the torch profiler filename as instance_id+rank_id for merging... · 76852017
  wang.yuqi authored Oct 12, 2025
```
[MISC] Rename the torch profiler filename as instance_id+rank_id for merging the Profiler results of each Rank (#25867)
Signed-off-by: wang.yuqi <noooop@126.com>
```
  76852017