Commits · 4fa7ce46f31cbd97b4651694caf9991cc395a259 · OpenDAS / vllm_cscc

13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 1 commit

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that... · 48661d27

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm  (#30417)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

48661d27

11 Dec, 2025 2 commits
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
09 Dec, 2025 3 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[BugFix] Fix non detected failing tests (#30277) · 0b6a8a30
Ilya Markov authored Dec 09, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
0b6a8a30
Mark qwen2_5_vl as xfail (#30283) · 7b35011a
Yanan Cao authored Dec 08, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
7b35011a

08 Dec, 2025 1 commit
- Add evaluate_guards option to DynamicShapesConfig (#27432) · 87aee9ed
  Laith Sakka authored Dec 08, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  87aee9ed
07 Dec, 2025 4 commits
- [Performance] Fused blockwise quant RMS norm (#27883) · af0444bf
  ElizaWszola authored Dec 07, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
```
  af0444bf
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
- [Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558) · 17eb25e3
  Wentao Ye authored Dec 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  17eb25e3
05 Dec, 2025 2 commits

[Compile] Conditional compilation. Introduce compile_ranges (#24252) · 4e26d3b0

Ilya Markov authored Dec 05, 2025


Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

4e26d3b0

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

04 Dec, 2025 2 commits
- [aot_compile]change VLLM backend to read fake args from example_value (#29104) · 1f0d1845
  Laith Sakka authored Dec 04, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  1f0d1845
- [Core] Remove forced None assignment for deprecated PassConfig flags (#29994) · dfdda967
  Arpit Khandelwal authored Dec 04, 2025
```
Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  dfdda967
03 Dec, 2025 1 commit

[Core] Rename PassConfig flags as per RFC #27995 (#29646) · d7284a26

Arpit Khandelwal authored Dec 02, 2025


Signed-off-by: arpitkh101 <arpit5khandelwal@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d7284a26

02 Dec, 2025 2 commits
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
28 Nov, 2025 1 commit

[Frontend] Remap -O to -cc commandline flag (#29557) · 3461e7ef

Yanan Cao authored Nov 28, 2025


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

3461e7ef

27 Nov, 2025 1 commit

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847) · 0838b52e

Morrison Turnansky authored Nov 27, 2025


Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: adabeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0838b52e

26 Nov, 2025 2 commits
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
25 Nov, 2025 2 commits
- Scheduled removal of `CompilationConfig.use_inductor` (#29323) · 51fc9e01
  Harry Mellor authored Nov 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  51fc9e01
- [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
  elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  6330f947
24 Nov, 2025 1 commit

Add option to use unbacked, and backed size obl dynamic shapes for more sounds... · 7a228b53

Laith Sakka authored Nov 24, 2025


Add option to use unbacked, and backed size obl dynamic shapes for more sounds compilation. (#26199)
Signed-off-by: Laith Sakka <lsakka@meta.com>

7a228b53

19 Nov, 2025 3 commits

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966) · 61728cd1

Copilot authored Nov 19, 2025

Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

61728cd1

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304
[CI] Reorganize compile tests so new tests are automatically included in CI (#28625) · 2c8b9182
Yanan Cao authored Nov 19, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
2c8b9182

15 Nov, 2025 1 commit

[compile] Enable sequence parallelism matching w/o custom ops enabled (#27126) · f36292db

Angela Yi authored Nov 15, 2025


Signed-off-by: angelayi <yiangela7@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

f36292db

14 Nov, 2025 2 commits
- Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) · 2e0ad629
  Laith Sakka authored Nov 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
  2e0ad629
- [Minor] avoid register new custom and just import silly_attn (#28578) · fd75d3e8
  Boyuan Feng authored Nov 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  fd75d3e8
13 Nov, 2025 2 commits
- [Bugfix] Eliminate tuple inputs to submodules in graph partitioning (#28533) · 262d263f
  Yanan Cao authored Nov 13, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  262d263f
- [Misc] Turn off encoder torch compile by default (#28634) · d3387750
  Roger Wang authored Nov 13, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  d3387750
12 Nov, 2025 4 commits
- Remove deprecated fields from `CompilationConfig` (#27593) · a742134c
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a742134c
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- [Frontend] Change CompilationMode to a proper Enum (#28165) · 48c87936
  Yanan Cao authored Nov 11, 2025
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  48c87936
- Use FLASHINFER MLA backend when testing fp8_kv_scale_compile (#28491) · d2353954
  Adrian Abeyta authored Nov 11, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  d2353954
11 Nov, 2025 2 commits
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- [BugFix] Fix Failing Ruff Check (#28469) · 533b018f
  jvlunteren authored Nov 11, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  533b018f