Commits · 5f5271f1ee2ef281ed8ecc66b126aa34964e797d · OpenDAS / vllm_cscc

11 Sep, 2025 4 commits

Move `LoRAConfig` from `config/__init__.py` to `config/lora.py` (#24644) · 5f5271f1
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
5f5271f1
Fix typing for `safetensors_load_strategy` (#24641) · d6249d06
Harry Mellor authored Sep 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
d6249d06

[Core] feat: Add --safetensors-load-strategy flag for faster safetensors... · 41329a0f

shengshiqi-google authored Sep 11, 2025


[Core] feat: Add --safetensors-load-strategy flag for faster safetensors loading from Lustre (#24469)
Signed-off-by: Shiqi Sheng <shengshiqi@google.com>
Signed-off-by: shengshiqi-google <160179165+shengshiqi-google@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

41329a0f

[Engine][Chore] use local variable and remove output var assignment (#24554) · 8a894084
Guy Stone authored Sep 11, 2025
```
Signed-off-by: Guy Stone <guys@spotify.com>
```
8a894084

10 Sep, 2025 3 commits

[Kernel] Flashinfer MLA (trtllm-gen) decode kernel integration (#21078) · dcb28a33

Hanjie Qiu authored Sep 10, 2025


Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

dcb28a33

[Core] Support configuration parsing plugin (#24277) · 9fb74c27

Xingyu Liu authored Sep 10, 2025

Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9fb74c27

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845) · 4377b1ae

pwschuurman authored Sep 09, 2025


Signed-off-by: Omer Dayan (SW-GPU) <omer@run.ai>
Signed-off-by: Peter Schuurman <psch@google.com>
Co-authored-by: Omer Dayan (SW-GPU) <omer@run.ai>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4377b1ae

09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
08 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e

04 Sep, 2025 2 commits

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
02 Sep, 2025 1 commit
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
01 Sep, 2025 2 commits

[Misc] Enable V1 FP16 inference on pre-Ampere GPUs (#24022) · d7fbc6dd
Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
d7fbc6dd

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

31 Aug, 2025 1 commit
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
29 Aug, 2025 1 commit

[V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b

Maximilien de Bayser authored Aug 29, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2554b27b

28 Aug, 2025 1 commit
- [Doc]: fix typos in Python scripts (#23828) · d3da2eea
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d3da2eea
27 Aug, 2025 3 commits
- [V1][Mamba] - Enable V1 by default for Mamba Models (#23650) · 853c371f
  Asaf Joseph Gardin authored Aug 27, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  853c371f
- Only run `get_attr_docs` if generating help text (#23723) · 513c1fe2
  Harry Mellor authored Aug 27, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  513c1fe2
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
26 Aug, 2025 2 commits

[Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8

Hyogeun Oh (오효근) authored Aug 27, 2025

Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

730d0ac8

[V1] Enable V1 for compute capability < 8.0 + FP32 (#23614) · 50fede66
Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
50fede66

24 Aug, 2025 2 commits
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
- [Misc] update dict parse to EPLBConfig from json dumps to dict unpacking (#23305) · 1b9b1664
  rongfu.leng authored Aug 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  1b9b1664
22 Aug, 2025 3 commits
- [Doc]: fix various typos in multiple files (#23179) · 22cf679a
  Didier Durand authored Aug 22, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  22cf679a
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
- [Core] Support custom executor qualname (#23314) · 480bdf5a
  22quinn authored Aug 21, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  480bdf5a
21 Aug, 2025 3 commits

[V1] Remove unnecessary check for main thread (#23298) · c8e33c72
Robert Shaw authored Aug 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
c8e33c72

[Sampler] Support returning final logprobs (#22387) · f571ff8e

22quinn authored Aug 20, 2025


Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f571ff8e

[CI Bugfix] Fix CI by fully removing --enable-prompt-adapter (#23284) · bbea1cef
Michael Goin authored Aug 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
bbea1cef

20 Aug, 2025 3 commits

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2

[CLI][Doc] Formalize `--mm-encoder-tp-mode` (#23190) · 5efd6905
Cyrus Leung authored Aug 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
5efd6905
[Fix] fix offline env use local mode path (#22526) · 38217877
rongfu.leng authored Aug 20, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
38217877

19 Aug, 2025 2 commits
- [Frontend] Add `/collective_rpc` API endpoint (#23075) · f7cf5b51
  22quinn authored Aug 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7cf5b51
- [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) · 78dba404
  Nikhil Suryawanshi authored Aug 19, 2025
```
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
```
  78dba404
16 Aug, 2025 2 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

Fix handling of `max_num_batched_tokens` for pooling tasks (#23004) · 52ce1420
Maximilien de Bayser authored Aug 16, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
52ce1420