Commits · 61728cd1dfb03cbbfa03924f2a2cda311cfc13ac · OpenDAS / vllm_cscc

19 Nov, 2025 3 commits

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1

Copilot authored Nov 19, 2025

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

61728cd1

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304
[CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
2c8b9182

15 Nov, 2025 1 commit

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

14 Nov, 2025 2 commits
- Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
  Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  2e0ad629
- [Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
  Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  fd75d3e8
13 Nov, 2025 2 commits
- [Bugfix] Eliminate tuple inputs to submodules in graph partitioning (#28533) · 262d263f
  Yanan Cao authored Nov 13, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  262d263f
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
12 Nov, 2025 4 commits
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
- Use FLASHINFER MLA backend when testing fp8_kv_scale_compile (#28491) · d2353954
  Adrian Abeyta authored Nov 11, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  d2353954
11 Nov, 2025 3 commits
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- [BugFix] Fix Failing Ruff Check (#28469) · 533b018f
  jvlunteren authored Nov 11, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  533b018f
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
10 Nov, 2025 2 commits

[Bugfix] Ensure calculated KV scales are applied in attention. (#27232) · a5a790ee
Adrian Abeyta authored Nov 10, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
a5a790ee

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248) · d17ecc6b

Ilya Markov authored Nov 11, 2025

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d17ecc6b

08 Nov, 2025 1 commit
- remove resolve_op_overloads and use splitting_ops directly (#28081) · b158df28
  Boyuan Feng authored Nov 07, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  b158df28
07 Nov, 2025 2 commits
- [CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all... · a736e5ff
  Copilot authored Nov 07, 2025
```
[CI] Reduce Blackwell Fusion test runtime by filtering tests and only run all tests in nightly (#28074)
```
  a736e5ff
- [Multimodal][torch.compile] Add compilation config field for turning off ViT/MM compile (#28242) · 4bf56c79
  Lucas Kabela authored Nov 06, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  4bf56c79
06 Nov, 2025 1 commit
- [CI] Add compile/test_multimodal_compile.py to CI (#28151) · bde50393
  gmagogsfm authored Nov 05, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bde50393
28 Oct, 2025 1 commit

[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic... · 94666612

Lucas Kabela authored Oct 28, 2025


[Misc][qwen2_5_vl][torch.compile] Enable `supports_torch_compile` on generic nn.Module and demonstrate speedup on Qwen Vision model (#23207)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Signed-off-by: Lucas Kabela <lucasakabela@gmail.com>

94666612

24 Oct, 2025 2 commits

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

[Bugfix][CI] Move resolving cudagraph_mode before initializing attn_metadata_builder (#27427) · 85fee74b
fhl2000 authored Oct 24, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
85fee74b

22 Oct, 2025 3 commits
- [Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
  dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a0003b56
- Remove last `level` references not removed in #26355 (#27260) · 8f18feb1
  Harry Mellor authored Oct 22, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8f18feb1
- [torch.compile] Enable silu_mul_fp8_quant fusion without custom ops enabled (#27146) · ab3e8004
  Jiangyun Zhu authored Oct 22, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ab3e8004
18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 3 commits
- [torch.compile] Enable attention and allreduce fusion without custom ops enabled (#24604) · bd7157a0
  Luka Govedič authored Oct 17, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  bd7157a0
- [torch.compile] fix simple inductor graph partition test (#27050) · 17c540a9
  Boyuan Feng authored Oct 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  17c540a9
- [torch.compile] Passing only necessary compilation config to inductor pass config (#27041) · 11ae016b
  Lucia Fang authored Oct 16, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  11ae016b
16 Oct, 2025 1 commit
- [BugFix] Work around graph partition x torch.compile cache issue (#26956) · 9b6504c3
  Richard Zou authored Oct 15, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  9b6504c3
15 Oct, 2025 4 commits

Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf

Adrian Abeyta authored Oct 15, 2025


Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

0a9ef0cf

[BugFix] Patch inductor memory plan logic (#26878) · f5743833

Boyuan Feng authored Oct 15, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

f5743833

[Graph Partition] pass tests for decorator (#26831) · f0862eae
Boyuan Feng authored Oct 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
f0862eae

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 2 commits
- [torch.compile] Fix tests for torch==2.9 inductor partition (#26116) · 2dcd12d3
  Luka Govedič authored Oct 14, 2025
```
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  2dcd12d3
- [CI Failure] Fix tests with missing TinyLlama-1.1B-Chat-v1.0-FP8-e2e (#26816) · c3a722fc
  Michael Goin authored Oct 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c3a722fc
13 Oct, 2025 1 commit

[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate... · e3fdb627

Morrison Turnansky authored Oct 13, 2025


[FrontEnd] UNREVERT CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops  (#26502)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>

e3fdb627

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a