Commits · 5f2f3fba1d9ed0aa433171b86c415a5f02055035 · OpenDAS / vllm_cscc

18 Dec, 2025 1 commit
- [compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
  Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  5f2f3fba
16 Dec, 2025 1 commit
- update piecewise cudagraph warning when splitting_ops=[] (#30728) · 104003dc
  Boyuan Feng authored Dec 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  104003dc
15 Dec, 2025 2 commits
- [Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
  Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a450c64a
- [Log] Skip piecewise cudagraph warn when using full cudagraph (#30657) · 917fdae5
  Boyuan Feng authored Dec 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  917fdae5
11 Dec, 2025 1 commit
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
08 Dec, 2025 1 commit
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
07 Dec, 2025 1 commit
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
05 Dec, 2025 1 commit

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

04 Dec, 2025 1 commit
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

01 Dec, 2025 1 commit
- [Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935) · eaf81485
  Nengjun Ma authored Dec 02, 2025
```
Signed-off-by: leo-pony <nengjunma@outlook.com>
```
  eaf81485
27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

25 Nov, 2025 2 commits

Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
51fc9e01

Allow oot custom compiler extension via CompilerInterface (#28623) · 888152bf

Icey authored Nov 25, 2025


Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Mengqing Cao <cmq0113@163.com>
Signed-off-by: Icey <1790571317@qq.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>

888152bf

24 Nov, 2025 1 commit

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

22 Nov, 2025 1 commit
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 1 commit
- [BugFix] skip combo kernel on cpu (#29129) · 8c25f9cf
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8c25f9cf
19 Nov, 2025 2 commits

[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036) · 8f4f77a7
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
8f4f77a7

[torch.compile] caching of config fields should be opt-out by default (#26468) · 1ffe934c

vnadathur authored Nov 19, 2025

Signed-off-by: vnadathur <glvikramn@gmail.com>
Signed-off-by: WorldExplored <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Srreyansh Sethi <107075589+WorldExplored@users.noreply.github.com>
Co-authored-by: WorldExplored <srreyansh.sethi@gmail.com>
Co-authored-by: Srreyansh Sethi <107075589+worldexplored@users.noreply.github.com>
Co-authored-by: vnadathur <236933696+vnadathur@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1ffe934c

17 Nov, 2025 1 commit
- [BugFix] Temporary fix for IMA with MTP = 2 and full-cg (#28315) · 64e39d66
  Lucas Wilkinson authored Nov 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  64e39d66
13 Nov, 2025 1 commit
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
12 Nov, 2025 3 commits
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
11 Nov, 2025 1 commit
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
10 Nov, 2025 1 commit

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248) · d17ecc6b

Ilya Markov authored Nov 11, 2025

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d17ecc6b

07 Nov, 2025 2 commits
- Fix issues from #28242 (#28257) · c0a4b95d
  Harry Mellor authored Nov 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c0a4b95d
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 1 commit
- [PERF] Decouple projections from GDN custom op. Attempt 2 (#28083) · b6a248bd
  Vadim Gimpelson authored Nov 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  b6a248bd
04 Nov, 2025 2 commits
- Revert "[PERF] Decouple projections from GDN custom op" (#28080) · d4e547bb
  Vadim Gimpelson authored Nov 05, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  d4e547bb
- [PERF] Decouple projections from GDN custom op (#27512) · 5fd8f02e
  Vadim Gimpelson authored Nov 04, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  5fd8f02e
03 Nov, 2025 1 commit

[BUG] Make 'binary' default option for saving torch compile artifacts when... · cac4c10e

ahao-anyscale authored Nov 03, 2025


[BUG] Make 'binary' default option for saving torch compile artifacts when using standalone_compile (#27616)
Signed-off-by: ahao-anyscale <ahao@anyscale.com>

cac4c10e

30 Oct, 2025 1 commit

[Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b

Zhiyuan Li authored Oct 30, 2025


Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>

4e68cc9b

28 Oct, 2025 1 commit

[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612

Lucas Kabela authored Oct 28, 2025


[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>

94666612

24 Oct, 2025 1 commit

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

20 Oct, 2025 1 commit

[LoRA] LoRA cuda graph specialization (#25914) · b63f2143

Andy Lo authored Oct 20, 2025


Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

b63f2143

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
15 Oct, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 1 commit
- [torch.compile] Fix tests for torch==2.9 inductor partition (#26116) · 2dcd12d3
  Luka Govedič authored Oct 14, 2025
```
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  2dcd12d3