Commits · 2f12cd32c06647f5f3f8d3e020eaed4cd290424a · OpenDAS / vllm_cscc

27 Dec, 2025 2 commits

[BugFix] Fix cache issue in compilation_config (#31376) · 2f12cd32
Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
2f12cd32

Fix/get raw stream patch #30905 (#30912) · 8711b216

baonudesifeizhai authored Dec 26, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8711b216

23 Dec, 2025 3 commits
- [ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
  vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  f32cfd7d
- [Chore] Update more locations to use `attention_config.backend` (#31153) · 8cef1376
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8cef1376
- [ci] Fix Pytorch compilation test oom in 2.10 (#31194) · 612d5ffd
  Angela Yi authored Dec 22, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  612d5ffd
18 Dec, 2025 2 commits

[BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 30bb19a7

Lucas Wilkinson authored Dec 18, 2025

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

30bb19a7

[compile] Fix CI for test_gpt2_cache_hit (#30902) · 5f2f3fba
Zhengxu Chen authored Dec 17, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
5f2f3fba

17 Dec, 2025 2 commits
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [CI/Build] Fix compatibility between #30244 and #30396 (#30787) · 44d3b1df
  Cyrus Leung authored Dec 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44d3b1df
16 Dec, 2025 1 commit
- [CI] Skip ci failure test (#30804) · b6ec077e
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6ec077e
14 Dec, 2025 2 commits
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- enable unbacked with aot_compile (#30462) · f569c654
  Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  f569c654
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that... · 48661d27

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm  (#30417)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

48661d27

11 Dec, 2025 2 commits
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
09 Dec, 2025 3 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[BugFix] Fix non detected failing tests (#30277) · 0b6a8a30
Ilya Markov authored Dec 09, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
0b6a8a30
Mark qwen2_5_vl as xfail (#30283) · 7b35011a
Yanan Cao authored Dec 08, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
7b35011a

08 Dec, 2025 1 commit
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
07 Dec, 2025 4 commits
- [Performance] Fused blockwise quant RMS norm (#27883) · af0444bf
  ElizaWszola authored Dec 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
```
  af0444bf
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
05 Dec, 2025 2 commits

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

04 Dec, 2025 2 commits
- [aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  1f0d1845
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
28 Nov, 2025 1 commit

[Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef

Yanan Cao authored Nov 28, 2025


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

3461e7ef

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 2 commits
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
25 Nov, 2025 2 commits
- Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51fc9e01
- [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
  elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  6330f947
24 Nov, 2025 1 commit

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

19 Nov, 2025 2 commits

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1

Copilot authored Nov 19, 2025

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

61728cd1

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304