Commits · 294c805f1df9ddf62c2290989710da9d48ab4973 · OpenDAS / vllm_cscc

01 Nov, 2025 1 commit

[Add] cmdline argument parsing for KV cache offloading modules (#27621) · e6751188

Yihua Cheng authored Nov 01, 2025

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e6751188

31 Oct, 2025 2 commits
- [Feature] Pydantic validation for scheduler.py and structured_outputs.py (#26519) · 5e8862e9
  Vinay R Damodaran authored Oct 31, 2025
```
Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5e8862e9
- [Cleanup] Remove no-longer-used `SpeculativeConfig.enable_chunked_prefill` (#27826) · 9e5bd307
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9e5bd307
29 Oct, 2025 2 commits

[chore] Remove models weight on S3 logic (#27725) · 3481e407
Kevin H. Luu authored Oct 29, 2025
```
Signed-off-by: kevin <kevin@anyscale.com>
```
3481e407

[Speculators] Move tests + fix integration (#27308) · 413ef7a3

Dipika Sikka authored Oct 29, 2025


Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Signed-off-by: rahul-tuli <rtuli@redhat.com>
Co-authored-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

413ef7a3

28 Oct, 2025 2 commits
- [Core] Enable async scheduling for external_launcher mode (#27394) · 2abbd351
  22quinn authored Oct 28, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  2abbd351
- [Hybrid] Add mamba_block_size to Engine Args (#27289) · 05181cc5
  Asaf Joseph Gardin authored Oct 28, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  05181cc5
27 Oct, 2025 1 commit
- [Misc] Clean up more utils (#27567) · 6ebffafb
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6ebffafb
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

23 Oct, 2025 2 commits
- [Bugfix] Fix args settings for guided decoding args (#27375) · fc059c70
  Lucia Fang authored Oct 23, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  fc059c70
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
22 Oct, 2025 1 commit

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

21 Oct, 2025 2 commits
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
- [MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
  Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c3a2c6ac
19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

18 Oct, 2025 3 commits

[fix][cpu] fix prefill attention in CPU attention backend (#27035) · ab4be40f
Fadi Arafeh authored Oct 18, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
ab4be40f

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515) · 7c572544

Hanchenli authored Oct 17, 2025


Signed-off-by: Hanchenli <lihanc2002@gmail.com>
Signed-off-by: Hanchenli <61769611+Hanchenli@users.noreply.github.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wei Wei <wwei6@meta.com>
Co-authored-by: Wei Wei <weiweinpu@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7c572544

17 Oct, 2025 2 commits

[BugFix][Core] Fix error when enable async-scheduling in multi-node env (#25887) · 6367bde7

Lehua Ding authored Oct 18, 2025


Signed-off-by: Lehua Ding <lehuading@tencent.com>
Signed-off-by: Lehua Ding <lehuading@qq.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

6367bde7

[Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) · b038d9c4

Patrick von Platen authored Oct 17, 2025

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

b038d9c4

16 Oct, 2025 2 commits

Support `set` in the CLI generation (#27031) · aa255ff5
Harry Mellor authored Oct 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
aa255ff5

Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de

Bram Wasti authored Oct 15, 2025


Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

7d8975de

14 Oct, 2025 4 commits
- [Chore] Remove `SupportsV0Only` interface and update supported models docs (#26783) · 9c4cb683
  Cyrus Leung authored Oct 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9c4cb683
- scheduler.py: Update the name of the default scheduler. (#26758) · 481545b3
  Ryan Li authored Oct 14, 2025
```
Signed-off-by: Ryan Li <ryanli@ryanli.org>
```
  481545b3
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit

Remove LoRA bias support (#25807) · ab196ede

Ashwin Phadke authored Oct 10, 2025


Signed-off-by: Ashwin Phadke <ashwinphadke12@rediffmail.com>
Signed-off-by: Ashwin Phadke <23502062+ashwin-phadke@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ab196ede

09 Oct, 2025 2 commits
- [Feature] Use pydantic validation in lora.py and load.py configs (#26413) · e4791438
  Simon Danielsson authored Oct 09, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
  e4791438
- [Misc] Redact ray runtime env before logging (#26302) · 467a4f98
  Rui Qiao authored Oct 08, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  467a4f98
08 Oct, 2025 2 commits

[Feature] Change cache.py with pydantic validation (#26390) · b25d7b56

Vinay R Damodaran authored Oct 08, 2025

Signed-off-by: Vinay Damodaran <vrdn@hey.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

b25d7b56

Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2f99f2f5

07 Oct, 2025 1 commit

[Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464

Sage Moore authored Oct 06, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2111b464

06 Oct, 2025 1 commit
- [ROCm] Split AITER unified attention into its own backend (#25507) · f231e5bc
  Gregory Shtrasberg authored Oct 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f231e5bc
05 Oct, 2025 3 commits
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[V1] [Hybrid] Mamba2 Automatic Prefix Caching (#25752) · ea507c3a

Stan Wozniak authored Oct 04, 2025


Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Signed-off-by: Thomas Ortner <boh@zurich.ibm.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Thomas Ortner <boh@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

ea507c3a

03 Oct, 2025 1 commit

[Multi Modal] Configurable MM Profiling (#25631) · 79aa2446

Wenlong Wang authored Oct 03, 2025

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

79aa2446