Commits · 82580b10acaac3b129d84f17d3defbfbb2eeb161 · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
23 Mar, 2026 2 commits
- [Mypy] Fix mypy for `vllm/config` (#37808) · 45bd5c8e
  Wentao Ye authored Mar 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  45bd5c8e
- [Feature] ViT Full CUDA Graph (#35963) · f85e479e
  Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
  f85e479e
19 Mar, 2026 1 commit

[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583

Lucas Kabela authored Mar 19, 2026


[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>

7769b583

09 Mar, 2026 2 commits

[MRV2] Extensible CG dispatch rework (#35959) · 483463f7
Lucas Wilkinson authored Mar 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
483463f7

[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027) · 4b87ffbe

Copilot authored Mar 09, 2026

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4b87ffbe

06 Mar, 2026 1 commit

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

05 Mar, 2026 3 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Misc] Remove deprecated items that are due for removal (#36006) · c3598d02
  Martin Hickey authored Mar 05, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  c3598d02
04 Mar, 2026 1 commit
- [Bugfix] Cap FULL decode cudagraph sizes for Mamba/hybrid models (#34094) (#34571) · d6e04f4c
  haosdent authored Mar 04, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: zjy0516 <riverclouds.zhu@qq.com>
```
  d6e04f4c
02 Mar, 2026 1 commit

[Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308

ElizaWszola authored Mar 02, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d9c77308

27 Feb, 2026 1 commit
- [DP] Only use DP padding when cudagraphs are actually used (#34102) · 1d532f9d
  Lucas Wilkinson authored Feb 27, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1d532f9d
26 Feb, 2026 2 commits

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

[torch.compile] Sequence Parallelism threshold compile ranges (#28672) · 9d379410

Jason Li authored Feb 25, 2026


Signed-off-by: jasonlizhengjian <jasonlizhengjian@gmail.com>
Signed-off-by: Jason Li <jasonlizhengjian@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9d379410

25 Feb, 2026 1 commit
- [ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180) · f38f8c97
  Rohan Potdar authored Feb 24, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  f38f8c97
24 Feb, 2026 1 commit

[ROCm] AITER fused RoPE+KVCache (#33443) · 2ff4e511

Rohan Potdar authored Feb 23, 2026


Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: charlifu <charlifu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>

2ff4e511

11 Feb, 2026 1 commit
- [torch.compile] Enable AR+rms fusion by default available for `-O2` (#34299) · addac0e6
  Luka Govedič authored Feb 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  addac0e6
08 Feb, 2026 1 commit
- [torch.compile] Add an option to force-enable the MOE cold start optimization (#33735) · 4df841fe
  Richard Zou authored Feb 08, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  4df841fe
06 Feb, 2026 1 commit

[torch.compile] Reorganize vllm/compilation and tests/compile (0/N for vLLM IR) (#33731) · ac32e66c

Luka Govedič authored Feb 06, 2026


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ac32e66c

03 Feb, 2026 2 commits

Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
61e632ae

[torch.compile] Don't do the fast moe cold start optimization if there is... · 5eac9a1b

Richard Zou authored Feb 02, 2026


[torch.compile] Don't do the fast moe cold start optimization if there is speculative decoding (#33624)
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

5eac9a1b

31 Jan, 2026 1 commit

[fix][torch.compile] Fix cold-start compilation time increase by adding kv... · 15f40b20

Luka Govedič authored Jan 31, 2026


[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>

15f40b20

29 Jan, 2026 1 commit
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
28 Jan, 2026 3 commits
- [ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  4197168e
- Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
  Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  59bcc5b6
- [CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f1acbd68
27 Jan, 2026 2 commits
- [torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
  Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d9aa39a3
- [torch.compile] Stop assuming 32 bit indexing (#33113) · 3b8f0fe5
  Richard Zou authored Jan 26, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  3b8f0fe5
21 Jan, 2026 2 commits
- [PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744) · 1861ae8a
  whx authored Jan 22, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  1861ae8a
- [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) · 6c20e89c
  Pleaplusone authored Jan 21, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  6c20e89c
20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

14 Jan, 2026 1 commit
- [compile] raise on compile_size implicit padding (#32343) · 8471b27d
  dolpm authored Jan 14, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  8471b27d
13 Jan, 2026 1 commit
- [Misc] improve warning/assert messages (#32226) · 15b33ff0
  cjackal authored Jan 13, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  15b33ff0
11 Jan, 2026 1 commit
- make assume_32_bit_indexing configurable (#32044) · 46eb30f5
  Laith Sakka authored Jan 10, 2026
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  46eb30f5
10 Jan, 2026 1 commit
- [Misc][LLaMa4] Compile LLaMa Vision Encoder (#30709) · ea6d067a
  Lucas Kabela authored Jan 09, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  ea6d067a
09 Jan, 2026 2 commits
- [Misc][BE] Type coverage for vllm/compilation [2/3] (#31744) · aaf4b70a
  Lucas Kabela authored Jan 09, 2026
  
  aaf4b70a
- [Doc] Add developer guide for CustomOp (#30886) · 08d954f0
  Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  08d954f0
06 Jan, 2026 1 commit

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

18 Dec, 2025 1 commit

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920