Commits · 4dfad17ed1f2752f9dfd2ea103a642c63f5589a6 · OpenDAS / vllm_cscc

31 Mar, 2026 1 commit

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

30 Mar, 2026 1 commit

[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping... · cc06b4e8

Nicolò Lucchesi authored Mar 30, 2026


[Mamba][Bugfix] Raise on insufficient cache blocks instead of silently capping cudagraph sizes (#38270)
Signed-off-by: NickLucche <nlucches@redhat.com>

cc06b4e8

25 Mar, 2026 1 commit
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
24 Mar, 2026 1 commit
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
04 Mar, 2026 1 commit
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
26 Feb, 2026 1 commit

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

06 Feb, 2026 1 commit

[torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c

Luka Govedič authored Feb 06, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ac32e66c

20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

14 Jan, 2026 1 commit
- [compile] raise on compile_size implicit padding (#32343) · 8471b27d
  dolpm authored Jan 14, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  8471b27d
08 Jan, 2026 1 commit

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

27 Dec, 2025 2 commits

[BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
2f12cd32

Fix/get raw stream patch #30905 (#30912) · 8711b216

baonudesifeizhai authored Dec 26, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8711b216

18 Dec, 2025 1 commit

[BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7

Lucas Wilkinson authored Dec 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30bb19a7

11 Dec, 2025 1 commit
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
07 Dec, 2025 1 commit
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
04 Dec, 2025 1 commit
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

14 Nov, 2025 1 commit
- [Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
  Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  fd75d3e8
12 Nov, 2025 1 commit
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
08 Nov, 2025 1 commit
- remove resolve_op_overloads and use splitting_ops directly (#28081) · b158df28
  Boyuan Feng authored Nov 07, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  b158df28
24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

22 Oct, 2025 1 commit
- Remove last `level` references not removed in #26355 (#27260) · 8f18feb1
  Harry Mellor authored Oct 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8f18feb1
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [torch.compile] Passing only necessary compilation config to inductor pass config (#27041) · 11ae016b
  Lucia Fang authored Oct 16, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  11ae016b
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

10 Oct, 2025 1 commit

[torch.compile] Make inductor partition rules respect splitting_ops #25691 (#25845) · cddce79f

baonudesifeizhai authored Oct 10, 2025

cddce79f

07 Oct, 2025 1 commit
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
26 Sep, 2025 1 commit

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

22 Sep, 2025 1 commit

[torch.compile] Cleanup compilation tests and custom passes, add debug utils,... · d5e0fca2

Luka Govedič authored Sep 22, 2025


[torch.compile] Cleanup compilation tests and custom passes, add debug utils, fix DCE bug (#23091), fix test (#24376), and prep for custom op matching (#24604) (#24542)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: luka <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d5e0fca2

29 Jul, 2025 1 commit
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
15 Jul, 2025 1 commit
- [BugFix] VLLM_DISABLE_COMPILE_CACHE=1 should disable all reads and writes from the cache (#20942) · ba8c3000
  Richard Zou authored Jul 14, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ba8c3000
24 Jun, 2025 1 commit
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
19 Jun, 2025 1 commit
- [BugFix] Fix use_cudagraph=False (#19612) · ed333497
  Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ed333497
10 Jun, 2025 1 commit
- [BugFix] Allow use_cudagraph to work with dynamic VLLM_USE_V1 (#19390) · 77f0d465
  Richard Zou authored Jun 10, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  77f0d465
09 Jun, 2025 1 commit
- [Misc] Cleanup compilation tests (#19343) · 3a4d4177
  Richard Zou authored Jun 09, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  3a4d4177
08 Jun, 2025 1 commit
- [Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299) · eaa2e510
  Richard Zou authored Jun 07, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  eaa2e510